2024-09-13T15:20:46.511 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T15:20:46.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T15:20:46.648 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903738 branch: wip-rishabh-testing-20240910.095512-reef description: fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-modules} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} email: null first_in_suite: false job_id: '7903738' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi meta: - desc: create/rm volumes and set configs - desc: run one cephfs-mirror daemon on primary cluster - desc: configure the permissions for client.mirror - desc: 1 ceph cluster with 1 mon, 1 mgr, 3 osds, 5 mdss - desc: run the cephfs_mirror_ha.sh workunit to test cephfs-mirror daemon in HA active/active mode mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi no_nested_subset: false os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240910.095512-reef ceph: conf: client: client mount timeout: 600 debug cephfs_mirror: 20 debug client: 20 debug ms: 1 log to stderr: false rados mon op timeout: 900 rados osd op timeout: 900 client.mirror1: admin socket: /var/run/ceph/cephfs-mirror1.asok pid file: /var/run/ceph/cephfs-mirror1.pid client.mirror2: admin socket: /var/run/ceph/cephfs-mirror2.asok pid file: /var/run/ceph/cephfs-mirror2.pid client.mirror3: admin socket: /var/run/ceph/cephfs-mirror3.asok pid file: /var/run/ceph/cephfs-mirror3.pid mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 10 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 50bbe7f395997dcd871813949c49addbbf630361 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 50bbe7f395997dcd871813949c49addbbf630361 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.095512-reef sha1: 50bbe7f395997dcd871813949c49addbbf630361 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.b - mds.c - mds.d - mds.e - osd.0 - osd.1 - osd.2 - client.0 - client.1 - client.2 - client.mirror1 - client.mirror2 - client.mirror3 - client.mirror_remote seed: 1152 sha1: 50bbe7f395997dcd871813949c49addbbf630361 sleep_before_teardown: 0 subset: 984/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.095512-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 50bbe7f395997dcd871813949c49addbbf630361 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMC0KqdqFuHZoB2uKK3RKjjL+59XBYc5fxTDYzlTm/SllPBVGRzgqKICmutJB9yKApzHPsW7wgc3SIx5b+LX4VI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - exec: mon.a: - ceph fs volume create dc - ceph fs volume create dc-backup - full_sequential_finally: - exec: mon.a: - ceph config set mon mon_allow_pool_delete true - ceph fs volume rm dc --yes-i-really-mean-it - ceph fs volume rm dc-backup --yes-i-really-mean-it - cephfs-mirror: client: client.mirror1 run_in_foreground: true - cephfs-mirror: client: client.mirror2 run_in_foreground: true - cephfs-mirror: client: client.mirror3 run_in_foreground: true - exec: client.1: - sudo ceph auth caps client.0 mon 'allow r' mds 'allow rwps' osd 'allow rw tag cephfs *=*' mgr 'allow r' client.2: - sudo ceph auth caps client.1 mon 'allow r' mds 'allow rwps' osd 'allow rw tag cephfs *=*' mgr 'allow r' client.mirror1: - sudo ceph auth caps client.mirror1 mon 'profile cephfs-mirror' mds 'allow r' osd 'allow rw tag cephfs metadata=*, allow r tag cephfs data=*' mgr 'allow r' client.mirror2: - sudo ceph auth caps client.mirror2 mon 'profile cephfs-mirror' mds 'allow r' osd 'allow rw tag cephfs metadata=*, allow r tag cephfs data=*' mgr 'allow r' client.mirror3: - sudo ceph auth caps client.mirror3 mon 'profile cephfs-mirror' mds 'allow r' osd 'allow rw tag cephfs metadata=*, allow r tag cephfs data=*' mgr 'allow r' client.mirror_remote: - sudo ceph auth caps client.mirror_remote mon 'allow r' mds 'allow rwps' osd 'allow rw tag cephfs *=*' mgr 'allow r' - ceph-fuse: client.1: cephfs_name: dc client.2: cephfs_name: dc-backup - cephfs_mirror_thrash: max_thrash_delay: 10 randomize: false - workunit: cleanup: false clients: client.1: - fs/cephfs_mirror_ha_gen.sh subdir: mirror timeout: 1h - exec: client.2: - echo verifying synchronized snapshots... - workunit: cleanup: false clients: client.2: - fs/cephfs_mirror_ha_verify.sh subdir: mirror timeout: 3h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:36:41 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T15:20:46.649 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa; will attempt to use it 2024-09-13T15:20:46.649 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa/tasks 2024-09-13T15:20:46.650 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T15:20:46.651 INFO:teuthology.task.internal:Checking packages... 2024-09-13T15:20:46.673 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '50bbe7f395997dcd871813949c49addbbf630361' 2024-09-13T15:20:46.674 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T15:20:46.674 INFO:teuthology.packaging:ref: None 2024-09-13T15:20:46.674 INFO:teuthology.packaging:tag: None 2024-09-13T15:20:46.674 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.095512-reef 2024-09-13T15:20:46.674 INFO:teuthology.packaging:sha1: 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:20:46.674 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240910.095512-reef 2024-09-13T15:20:46.823 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-850-g50bbe7f3-1jammy 2024-09-13T15:20:46.825 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T15:20:46.831 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T15:20:46.832 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T15:20:46.874 INFO:teuthology.task.internal:Saving configuration 2024-09-13T15:20:46.893 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T15:20:46.907 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T15:20:46.940 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903738', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 15:15:26.639913', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPr2U0RXoa5n3vYvG0OpgmB69v8ic+yZmmmY4iqkpNWS'} 2024-09-13T15:20:46.941 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T15:20:46.946 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.b', 'mds.c', 'mds.d', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1', 'client.2', 'client.mirror1', 'client.mirror2', 'client.mirror3', 'client.mirror_remote'] 2024-09-13T15:20:46.946 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T15:20:47.004 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f08db5bc790>, signals=[15]) 2024-09-13T15:20:47.005 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T15:20:47.010 INFO:teuthology.task.internal:Opening connections... 2024-09-13T15:20:47.010 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:20:47.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:20:47.101 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T15:20:47.106 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-09-13T15:20:47.213 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-09-13T15:20:47.213 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-09-13T15:20:47.264 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T15:20:47.264 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu" 2024-09-13T15:20:47.264 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="22.04" 2024-09-13T15:20:47.264 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T15:20:47.264 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=jammy 2024-09-13T15:20:47.264 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu 2024-09-13T15:20:47.264 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian 2024-09-13T15:20:47.264 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T15:20:47.265 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T15:20:47.265 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T15:20:47.265 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T15:20:47.265 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=jammy 2024-09-13T15:20:47.265 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-09-13T15:20:47.299 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T15:20:47.306 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T15:20:47.341 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T15:20:47.341 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-09-13T15:20:47.346 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T15:20:47.374 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T15:20:47.374 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-09-13T15:20:47.405 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T15:20:47.443 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T15:20:47.456 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T15:20:47.456 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T15:20:47.457 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T15:20:47.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:20:47.462 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-09-13T15:20:47.509 INFO:teuthology.orchestra.run.smithi040.stdout:5.15.0-56-generic 2024-09-13T15:20:47.509 INFO:teuthology.task.kernel:Running kernel on smithi040: 5.15.0-56-generic 2024-09-13T15:20:47.509 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get clean 2024-09-13T15:20:47.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2024-09-13T15:20:47.770 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T15:20:47.828 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-13T15:20:47.889 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-13T15:20:47.889 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-13T15:20:48.074 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-13T15:20:48.137 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-13T15:20:48.170 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-13T15:20:48.173 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-13T15:20:48.173 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-13T15:20:48.174 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-13T15:20:48.191 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-13T15:20:48.194 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-13T15:20:48.194 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-13T15:20:48.199 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-13T15:20:48.207 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-13T15:20:48.208 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-13T15:20:48.230 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-13T15:20:48.230 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-13T15:20:48.230 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-13T15:20:48.231 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-13T15:20:48.231 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-13T15:20:48.232 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-13T15:20:48.232 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-13T15:20:48.243 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-13T15:20:48.259 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-13T15:20:48.260 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-13T15:20:48.260 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-13T15:20:48.260 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-13T15:20:48.341 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-13T15:20:48.763 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-13T15:20:48.779 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-13T15:20:48.788 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-13T15:20:48.788 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-13T15:20:48.885 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-13T15:20:48.886 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-13T15:20:48.897 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-13T15:20:48.897 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-13T15:20:48.913 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-13T15:20:48.940 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-13T15:20:48.946 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-13T15:20:48.946 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-13T15:20:48.946 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-13T15:20:49.026 INFO:teuthology.orchestra.run.smithi040.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-13T15:20:49.026 INFO:teuthology.orchestra.run.smithi040.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-13T15:20:54.841 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 16.0 MB in 2s (7,119 kB/s) 2024-09-13T15:20:56.468 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-09-13T15:20:56.487 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T15:20:56.550 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-09-13T15:20:56.774 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2024-09-13T15:20:56.774 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2024-09-13T15:20:56.976 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T15:20:56.976 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T15:20:56.977 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T15:20:56.977 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T15:20:56.977 INFO:teuthology.orchestra.run.smithi040.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T15:20:56.977 INFO:teuthology.orchestra.run.smithi040.stdout: python2.7-minimal 2024-09-13T15:20:56.977 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T15:20:56.979 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2024-09-13T15:20:56.979 INFO:teuthology.orchestra.run.smithi040.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T15:20:56.980 INFO:teuthology.orchestra.run.smithi040.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-13T15:20:56.980 INFO:teuthology.orchestra.run.smithi040.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-13T15:20:56.981 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2024-09-13T15:20:56.982 INFO:teuthology.orchestra.run.smithi040.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-13T15:20:56.982 INFO:teuthology.orchestra.run.smithi040.stdout:Recommended packages: 2024-09-13T15:20:56.982 INFO:teuthology.orchestra.run.smithi040.stdout: thermald 2024-09-13T15:20:57.036 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2024-09-13T15:20:57.036 INFO:teuthology.orchestra.run.smithi040.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-13T15:20:57.036 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-13T15:20:57.037 INFO:teuthology.orchestra.run.smithi040.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-13T15:20:57.038 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages will be upgraded: 2024-09-13T15:20:57.039 INFO:teuthology.orchestra.run.smithi040.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T15:20:57.220 INFO:teuthology.orchestra.run.smithi040.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T15:20:57.221 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 113 MB of archives. 2024-09-13T15:20:57.221 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-13T15:20:57.221 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-13T15:20:58.567 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-13T15:20:58.924 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-13T15:21:01.150 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-13T15:21:01.150 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-13T15:21:01.151 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-13T15:21:01.539 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-13T15:21:01.589 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-13T15:21:02.016 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 113 MB in 5s (24.9 MB/s) 2024-09-13T15:21:02.200 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-13T15:21:04.263 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-13T15:21:04.270 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T15:21:04.384 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T15:21:06.658 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-13T15:21:06.680 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T15:21:06.773 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T15:21:07.737 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-13T15:21:07.758 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T15:21:07.795 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T15:21:14.257 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T15:21:14.398 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T15:21:14.741 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T15:21:14.868 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T15:21:15.163 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-13T15:21:15.187 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-13T15:21:15.221 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T15:21:21.343 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-13T15:21:21.380 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-13T15:21:21.418 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T15:21:25.188 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-13T15:21:25.313 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-13T15:21:25.672 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-13T15:21:25.793 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T15:21:25.944 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-13T15:21:26.072 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T15:21:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-13T15:21:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-13T15:21:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-13T15:21:27.438 INFO:teuthology.orchestra.run.smithi040.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-13T15:21:27.592 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T15:21:29.051 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T15:21:30.519 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-13T15:21:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-13T15:21:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-13T15:21:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T15:21:30.843 INFO:teuthology.orchestra.run.smithi040.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-13T15:21:45.549 INFO:teuthology.orchestra.run.smithi040.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T15:21:45.549 INFO:teuthology.orchestra.run.smithi040.stdout:Sourcing file `/etc/default/grub' 2024-09-13T15:21:45.571 INFO:teuthology.orchestra.run.smithi040.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T15:21:45.591 INFO:teuthology.orchestra.run.smithi040.stdout:Generating grub configuration file ... 2024-09-13T15:21:45.944 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T15:21:45.968 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T15:21:46.392 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T15:21:46.398 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T15:21:46.470 INFO:teuthology.orchestra.run.smithi040.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T15:21:46.476 INFO:teuthology.orchestra.run.smithi040.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T15:21:46.647 INFO:teuthology.orchestra.run.smithi040.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T15:21:46.647 INFO:teuthology.orchestra.run.smithi040.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T15:21:46.647 INFO:teuthology.orchestra.run.smithi040.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T15:21:46.681 INFO:teuthology.orchestra.run.smithi040.stdout:done 2024-09-13T15:21:47.268 DEBUG:teuthology.orchestra.run.smithi040:> dpkg -s linux-image-generic 2024-09-13T15:21:47.287 INFO:teuthology.orchestra.run.smithi040.stdout:Package: linux-image-generic 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:Status: install ok installed 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:Priority: optional 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:Section: kernel 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:Installed-Size: 21 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: amd64 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:Source: linux-meta 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:Version: 5.15.0.121.121 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:Recommends: thermald 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout:Description: Generic Linux kernel image 2024-09-13T15:21:47.288 INFO:teuthology.orchestra.run.smithi040.stdout: This package will always depend on the latest generic kernel image 2024-09-13T15:21:47.289 INFO:teuthology.orchestra.run.smithi040.stdout: available. 2024-09-13T15:21:47.289 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-13T15:21:47.290 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T15:21:47.290 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T15:21:47.290 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T15:21:47.290 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T15:21:47.290 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get clean 2024-09-13T15:21:47.464 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2024-09-13T15:21:47.584 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T15:21:47.717 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T15:21:47.798 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T15:21:47.880 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T15:21:49.071 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-09-13T15:21:49.091 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T15:21:49.157 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-09-13T15:21:49.372 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2024-09-13T15:21:49.386 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2024-09-13T15:21:49.583 INFO:teuthology.orchestra.run.smithi040.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-13T15:21:49.584 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T15:21:49.584 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T15:21:49.584 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T15:21:49.584 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T15:21:49.584 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T15:21:49.585 INFO:teuthology.orchestra.run.smithi040.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T15:21:49.585 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T15:21:49.630 INFO:teuthology.orchestra.run.smithi040.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-13T15:21:49.632 DEBUG:teuthology.orchestra.run.smithi040:> dpkg -s linux-image-generic 2024-09-13T15:21:49.648 INFO:teuthology.orchestra.run.smithi040.stdout:Package: linux-image-generic 2024-09-13T15:21:49.648 INFO:teuthology.orchestra.run.smithi040.stdout:Status: install ok installed 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Priority: optional 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Section: kernel 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Installed-Size: 21 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: amd64 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Source: linux-meta 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Version: 5.15.0.121.121 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Recommends: thermald 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout:Description: Generic Linux kernel image 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout: This package will always depend on the latest generic kernel image 2024-09-13T15:21:49.649 INFO:teuthology.orchestra.run.smithi040.stdout: available. 2024-09-13T15:21:49.650 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-09-13T15:21:49.696 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.hT4dfYkSrd 2024-09-13T15:21:49.697 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub/grub.cfg /tmp/tmp.hT4dfYkSrd 2024-09-13T15:21:49.753 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.hT4dfYkSrd 2024-09-13T15:21:49.877 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.hT4dfYkSrd is 10KB 2024-09-13T15:21:49.891 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.hT4dfYkSrd 2024-09-13T15:21:49.897 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T15:21:49.953 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:21:49.953 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T15:21:49.953 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T15:21:50.038 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-13T15:21:50.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo update-grub 2024-09-13T15:21:51.473 INFO:teuthology.orchestra.run.smithi040.stderr:Sourcing file `/etc/default/grub' 2024-09-13T15:21:51.474 INFO:teuthology.orchestra.run.smithi040.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T15:21:51.477 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2024-09-13T15:21:51.724 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-13T15:21:51.731 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-13T15:21:51.991 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T15:21:51.996 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T15:21:52.043 INFO:teuthology.orchestra.run.smithi040.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T15:21:52.048 INFO:teuthology.orchestra.run.smithi040.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T15:21:52.230 INFO:teuthology.orchestra.run.smithi040.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T15:21:52.230 INFO:teuthology.orchestra.run.smithi040.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T15:21:52.230 INFO:teuthology.orchestra.run.smithi040.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T15:21:52.254 INFO:teuthology.orchestra.run.smithi040.stderr:done 2024-09-13T15:21:52.257 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2024-09-13T15:22:22.290 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T15:22:22.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-13T15:22:22.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:23:22.347 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T15:23:31.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-13T15:23:31.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:23:39.065 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-09-13T15:23:39.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-13T15:23:39.910 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-13T15:23:39.911 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-09-13T15:23:39.960 INFO:teuthology.orchestra.run.smithi040.stdout:5.15.0-121-generic 2024-09-13T15:23:39.961 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-13T15:23:39.961 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T15:23:39.961 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T15:23:40.961 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T15:23:40.962 DEBUG:teuthology.orchestra.run.smithi040:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T15:23:41.089 INFO:teuthology.orchestra.run.smithi040.stdout:ttyS1 2024-09-13T15:23:41.115 DEBUG:teuthology.parallel:result is None 2024-09-13T15:23:41.115 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T15:23:41.123 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T15:23:41.123 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T15:23:41.129 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T15:23:41.174 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T15:23:41.224 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T15:23:41.225 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T15:23:41.254 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T15:23:41.265 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T15:23:41.266 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T15:23:41.331 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:23:41.339 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T15:23:41.340 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T15:23:41.347 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T15:23:41.347 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T15:23:41.416 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T15:23:41.425 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T15:23:41.425 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T15:23:41.465 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T15:23:41.513 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T15:23:41.562 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:23:41.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T15:23:41.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-09-13T15:23:41.894 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T15:23:41.901 INFO:teuthology.task.internal:Starting timer... 2024-09-13T15:23:41.902 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T15:23:41.952 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T15:23:41.993 DEBUG:teuthology.task.selinux:Excluding smithi040: OS 'ubuntu' does not support SELinux 2024-09-13T15:23:41.993 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T15:23:41.993 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T15:23:41.993 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T15:23:41.993 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T15:23:42.038 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T15:23:42.050 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T15:23:42.051 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T15:31:23.857 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com')] 2024-09-13T15:31:23.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-13T15:31:23.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T15:31:23.996 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-09-13T15:31:24.077 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-09-13T15:31:24.077 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T15:31:24.088 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T15:31:24.088 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T15:31:24.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:31:24.148 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T15:31:24.148 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: Command line: ntpd -gq 2024-09-13T15:31:24.148 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: ---------------------------------------------------- 2024-09-13T15:31:24.148 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T15:31:24.148 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T15:31:24.148 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: corporation. Support and training for ntp-4 are 2024-09-13T15:31:24.148 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: available at https://www.nwtime.org/support 2024-09-13T15:31:24.148 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: ---------------------------------------------------- 2024-09-13T15:31:24.149 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: proto: precision = 0.045 usec (-24) 2024-09-13T15:31:24.149 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: basedate set to 2022-02-04 2024-09-13T15:31:24.149 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: gps base set to 2022-02-06 (week 2196) 2024-09-13T15:31:24.149 INFO:teuthology.orchestra.run.smithi040.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T15:31:24.150 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T15:31:24.150 INFO:teuthology.orchestra.run.smithi040.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T15:31:24.151 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T15:31:24.151 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T15:31:24.151 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T15:31:24.151 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T15:31:24.151 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: Listen normally on 3 ens1f0 172.21.15.40:123 2024-09-13T15:31:24.151 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: Listen normally on 4 lo [::1]:123 2024-09-13T15:31:24.151 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:12cc%4]:123 2024-09-13T15:31:24.152 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:24 ntpd[18387]: Listening on routing socket on fd #22 for interface updates 2024-09-13T15:31:25.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:25.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:25.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:25.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:25.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:25.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:25.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:25.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:25.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:31:25.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:31:25.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:25.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:25.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:31:25.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:25 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:31:26.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:26 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:26.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:26 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:26.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:26 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:26.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:26 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:26.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:26 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:31:26.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:26 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:31:27.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:27 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:27.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:27 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:27.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:27 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:27.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:27 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:27 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:27 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:27 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:31:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:27 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:31:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:27 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:27 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:27 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:31:27.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:27 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:31:28.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:28 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:28.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:28 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:28.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:28 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:28.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:28 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:28.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:28 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:31:28.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:28 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:31:29.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:29 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:29.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:29 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:29.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:29 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:29.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:29 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:29 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:29 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:29 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:31:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:29 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:31:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:29 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:29 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:29 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:31:29.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:29 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:31:30.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:30 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:30.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:30 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:30.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:30 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:30.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:30 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:30.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:30 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:31:30.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:30 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:31:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:31 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:31 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:31 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:31 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:31 ntpd[18387]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T15:31:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:31 ntpd[18387]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T15:31:31.149 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:31 ntpd[18387]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T15:31:31.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:31 ntpd[18387]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T15:31:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:13 Sep 15:31:31 ntpd[18387]: ntpd: time slew -0.000621 s 2024-09-13T15:31:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:ntpd: time slew -0.000621s 2024-09-13T15:31:31.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:31 ntpd[18387]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T15:31:31.150 INFO:teuthology.orchestra.run.smithi040.stderr:13 Sep 15:31:31 ntpd[18387]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T15:31:31.203 INFO:teuthology.orchestra.run.smithi040.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T15:31:31.203 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================== 2024-09-13T15:31:31.204 INFO:teuthology.orchestra.run.smithi040.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T15:31:31.204 INFO:teuthology.orchestra.run.smithi040.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T15:31:31.204 INFO:teuthology.orchestra.run.smithi040.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T15:31:31.204 INFO:teuthology.orchestra.run.smithi040.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T15:31:31.205 INFO:teuthology.run_tasks:Running task install... 2024-09-13T15:31:31.213 DEBUG:teuthology.task.install:project ceph 2024-09-13T15:31:31.213 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}} 2024-09-13T15:31:31.213 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'} 2024-09-13T15:31:31.213 INFO:teuthology.task.install:Using flavor: default 2024-09-13T15:31:31.219 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T15:31:31.219 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T15:31:31.219 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-key list | grep Ceph 2024-09-13T15:31:31.305 INFO:teuthology.orchestra.run.smithi040.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T15:31:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T15:31:31.334 INFO:teuthology.orchestra.run.smithi040.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T15:31:31.335 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T15:31:31.336 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T15:31:31.336 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:31:31.495 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default/ 2024-09-13T15:31:31.495 INFO:teuthology.task.install.deb:Package version is 18.2.4-850-g50bbe7f3-1jammy 2024-09-13T15:31:31.620 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:31:31.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T15:31:31.634 DEBUG:teuthology.orchestra.run.smithi040:> sudo apt-get update 2024-09-13T15:31:31.804 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T15:31:31.805 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T15:31:31.814 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T15:31:31.831 INFO:teuthology.orchestra.run.smithi040.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T15:31:31.860 INFO:teuthology.orchestra.run.smithi040.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T15:31:31.882 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T15:31:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T15:31:31.925 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,423 B] 2024-09-13T15:31:31.954 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-13T15:31:32.173 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 28.8 kB in 0s (81.6 kB/s) 2024-09-13T15:31:33.226 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-09-13T15:31:33.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-850-g50bbe7f3-1jammy cephadm=18.2.4-850-g50bbe7f3-1jammy ceph-mds=18.2.4-850-g50bbe7f3-1jammy ceph-mgr=18.2.4-850-g50bbe7f3-1jammy ceph-common=18.2.4-850-g50bbe7f3-1jammy ceph-fuse=18.2.4-850-g50bbe7f3-1jammy ceph-test=18.2.4-850-g50bbe7f3-1jammy ceph-volume=18.2.4-850-g50bbe7f3-1jammy radosgw=18.2.4-850-g50bbe7f3-1jammy python3-rados=18.2.4-850-g50bbe7f3-1jammy python3-rgw=18.2.4-850-g50bbe7f3-1jammy python3-cephfs=18.2.4-850-g50bbe7f3-1jammy python3-rbd=18.2.4-850-g50bbe7f3-1jammy libcephfs2=18.2.4-850-g50bbe7f3-1jammy libcephfs-dev=18.2.4-850-g50bbe7f3-1jammy librados2=18.2.4-850-g50bbe7f3-1jammy librbd1=18.2.4-850-g50bbe7f3-1jammy rbd-fuse=18.2.4-850-g50bbe7f3-1jammy python3-cephfs=18.2.4-850-g50bbe7f3-1jammy cephfs-shell=18.2.4-850-g50bbe7f3-1jammy cephfs-top=18.2.4-850-g50bbe7f3-1jammy cephfs-mirror=18.2.4-850-g50bbe7f3-1jammy 2024-09-13T15:31:33.299 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-09-13T15:31:33.488 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2024-09-13T15:31:33.489 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2024-09-13T15:31:33.682 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T15:31:33.683 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T15:31:33.683 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T15:31:33.683 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T15:31:33.683 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T15:31:33.683 INFO:teuthology.orchestra.run.smithi040.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T15:31:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T15:31:33.684 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2024-09-13T15:31:33.684 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T15:31:33.684 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T15:31:33.685 INFO:teuthology.orchestra.run.smithi040.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T15:31:33.685 INFO:teuthology.orchestra.run.smithi040.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T15:31:33.685 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-13T15:31:33.685 INFO:teuthology.orchestra.run.smithi040.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-13T15:31:33.686 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T15:31:33.687 INFO:teuthology.orchestra.run.smithi040.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-13T15:31:33.687 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-13T15:31:33.687 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-13T15:31:33.687 INFO:teuthology.orchestra.run.smithi040.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T15:31:33.687 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2024-09-13T15:31:33.687 INFO:teuthology.orchestra.run.smithi040.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-13T15:31:33.687 INFO:teuthology.orchestra.run.smithi040.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-13T15:31:33.687 INFO:teuthology.orchestra.run.smithi040.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-13T15:31:33.687 INFO:teuthology.orchestra.run.smithi040.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-13T15:31:33.688 INFO:teuthology.orchestra.run.smithi040.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-13T15:31:33.688 INFO:teuthology.orchestra.run.smithi040.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-13T15:31:33.688 INFO:teuthology.orchestra.run.smithi040.stdout: python3-watchdog 2024-09-13T15:31:33.688 INFO:teuthology.orchestra.run.smithi040.stdout:Recommended packages: 2024-09-13T15:31:33.688 INFO:teuthology.orchestra.run.smithi040.stdout: btrfs-tools 2024-09-13T15:31:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2024-09-13T15:31:33.799 INFO:teuthology.orchestra.run.smithi040.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T15:31:33.800 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T15:31:33.800 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T15:31:33.800 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-13T15:31:33.800 INFO:teuthology.orchestra.run.smithi040.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T15:31:33.800 INFO:teuthology.orchestra.run.smithi040.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-13T15:31:33.800 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-13T15:31:33.801 INFO:teuthology.orchestra.run.smithi040.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-13T15:31:33.801 INFO:teuthology.orchestra.run.smithi040.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T15:31:33.801 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T15:31:33.801 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-13T15:31:33.801 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-13T15:31:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T15:31:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T15:31:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T15:31:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T15:31:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T15:31:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T15:31:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T15:31:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-13T15:31:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T15:31:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T15:31:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T15:31:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T15:31:33.803 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T15:31:33.803 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-13T15:31:33.803 INFO:teuthology.orchestra.run.smithi040.stdout: socat xmlstarlet 2024-09-13T15:31:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:0 upgraded, 115 newly installed, 0 to remove and 331 not upgraded. 2024-09-13T15:31:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 163 MB of archives. 2024-09-13T15:31:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 747 MB of additional disk space will be used. 2024-09-13T15:31:33.862 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-13T15:31:33.880 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T15:31:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-13T15:31:33.930 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-13T15:31:33.938 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T15:31:33.947 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-850-g50bbe7f3-1jammy [3,451 kB] 2024-09-13T15:31:33.955 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T15:31:33.957 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T15:31:33.967 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T15:31:34.013 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T15:31:34.017 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T15:31:34.029 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T15:31:34.033 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T15:31:34.033 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T15:31:34.041 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T15:31:34.042 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T15:31:34.042 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T15:31:34.044 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T15:31:34.044 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T15:31:34.051 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T15:31:34.051 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T15:31:34.068 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T15:31:34.068 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T15:31:34.069 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T15:31:34.071 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T15:31:34.072 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T15:31:34.072 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T15:31:34.073 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T15:31:34.074 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T15:31:34.085 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T15:31:34.085 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T15:31:34.101 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T15:31:34.102 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T15:31:34.102 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T15:31:34.108 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T15:31:34.108 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T15:31:34.109 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T15:31:34.109 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T15:31:34.111 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T15:31:34.118 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T15:31:34.119 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T15:31:34.130 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T15:31:34.131 INFO:teuthology.orchestra.run.smithi040.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T15:31:34.133 INFO:teuthology.orchestra.run.smithi040.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T15:31:34.134 INFO:teuthology.orchestra.run.smithi040.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T15:31:34.135 INFO:teuthology.orchestra.run.smithi040.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T15:31:34.137 INFO:teuthology.orchestra.run.smithi040.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T15:31:34.148 INFO:teuthology.orchestra.run.smithi040.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-850-g50bbe7f3-1jammy [3,108 kB] 2024-09-13T15:31:34.191 INFO:teuthology.orchestra.run.smithi040.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T15:31:34.192 INFO:teuthology.orchestra.run.smithi040.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T15:31:34.193 INFO:teuthology.orchestra.run.smithi040.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T15:31:34.193 INFO:teuthology.orchestra.run.smithi040.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T15:31:34.194 INFO:teuthology.orchestra.run.smithi040.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T15:31:34.195 INFO:teuthology.orchestra.run.smithi040.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T15:31:34.195 INFO:teuthology.orchestra.run.smithi040.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T15:31:34.197 INFO:teuthology.orchestra.run.smithi040.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T15:31:34.197 INFO:teuthology.orchestra.run.smithi040.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T15:31:34.198 INFO:teuthology.orchestra.run.smithi040.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-850-g50bbe7f3-1jammy [684 kB] 2024-09-13T15:31:34.206 INFO:teuthology.orchestra.run.smithi040.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-850-g50bbe7f3-1jammy [356 kB] 2024-09-13T15:31:34.210 INFO:teuthology.orchestra.run.smithi040.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T15:31:34.210 INFO:teuthology.orchestra.run.smithi040.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-850-g50bbe7f3-1jammy [32.8 kB] 2024-09-13T15:31:34.211 INFO:teuthology.orchestra.run.smithi040.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-850-g50bbe7f3-1jammy [180 kB] 2024-09-13T15:31:34.213 INFO:teuthology.orchestra.run.smithi040.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-850-g50bbe7f3-1jammy [63.8 kB] 2024-09-13T15:31:34.214 INFO:teuthology.orchestra.run.smithi040.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-850-g50bbe7f3-1jammy [334 kB] 2024-09-13T15:31:34.218 INFO:teuthology.orchestra.run.smithi040.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-850-g50bbe7f3-1jammy [5,933 kB] 2024-09-13T15:31:34.228 INFO:teuthology.orchestra.run.smithi040.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T15:31:34.230 INFO:teuthology.orchestra.run.smithi040.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T15:31:34.231 INFO:teuthology.orchestra.run.smithi040.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T15:31:34.246 INFO:teuthology.orchestra.run.smithi040.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T15:31:34.247 INFO:teuthology.orchestra.run.smithi040.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T15:31:34.247 INFO:teuthology.orchestra.run.smithi040.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T15:31:34.247 INFO:teuthology.orchestra.run.smithi040.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T15:31:34.248 INFO:teuthology.orchestra.run.smithi040.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T15:31:34.249 INFO:teuthology.orchestra.run.smithi040.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T15:31:34.249 INFO:teuthology.orchestra.run.smithi040.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T15:31:34.264 INFO:teuthology.orchestra.run.smithi040.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T15:31:34.267 INFO:teuthology.orchestra.run.smithi040.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T15:31:34.281 INFO:teuthology.orchestra.run.smithi040.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T15:31:34.283 INFO:teuthology.orchestra.run.smithi040.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T15:31:34.283 INFO:teuthology.orchestra.run.smithi040.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T15:31:34.286 INFO:teuthology.orchestra.run.smithi040.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T15:31:34.289 INFO:teuthology.orchestra.run.smithi040.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-13T15:31:34.289 INFO:teuthology.orchestra.run.smithi040.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T15:31:34.293 INFO:teuthology.orchestra.run.smithi040.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T15:31:34.296 INFO:teuthology.orchestra.run.smithi040.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T15:31:34.298 INFO:teuthology.orchestra.run.smithi040.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T15:31:34.300 INFO:teuthology.orchestra.run.smithi040.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T15:31:34.315 INFO:teuthology.orchestra.run.smithi040.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T15:31:34.315 INFO:teuthology.orchestra.run.smithi040.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T15:31:34.316 INFO:teuthology.orchestra.run.smithi040.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T15:31:34.317 INFO:teuthology.orchestra.run.smithi040.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-850-g50bbe7f3-1jammy [112 kB] 2024-09-13T15:31:34.320 INFO:teuthology.orchestra.run.smithi040.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-850-g50bbe7f3-1jammy [445 kB] 2024-09-13T15:31:34.325 INFO:teuthology.orchestra.run.smithi040.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-850-g50bbe7f3-1jammy [22.1 MB] 2024-09-13T15:31:34.768 INFO:teuthology.orchestra.run.smithi040.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-850-g50bbe7f3-1jammy [5,005 kB] 2024-09-13T15:31:34.825 INFO:teuthology.orchestra.run.smithi040.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-850-g50bbe7f3-1jammy [241 kB] 2024-09-13T15:31:34.828 INFO:teuthology.orchestra.run.smithi040.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-850-g50bbe7f3-1jammy [130 kB] 2024-09-13T15:31:34.829 INFO:teuthology.orchestra.run.smithi040.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-850-g50bbe7f3-1jammy [1,495 kB] 2024-09-13T15:31:34.842 INFO:teuthology.orchestra.run.smithi040.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-850-g50bbe7f3-1jammy [6,085 kB] 2024-09-13T15:31:34.934 INFO:teuthology.orchestra.run.smithi040.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-850-g50bbe7f3-1jammy [22.4 MB] 2024-09-13T15:31:35.377 INFO:teuthology.orchestra.run.smithi040.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-850-g50bbe7f3-1jammy [14.2 kB] 2024-09-13T15:31:35.377 INFO:teuthology.orchestra.run.smithi040.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-850-g50bbe7f3-1jammy [835 kB] 2024-09-13T15:31:35.387 INFO:teuthology.orchestra.run.smithi040.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-850-g50bbe7f3-1jammy [2,159 kB] 2024-09-13T15:31:35.412 INFO:teuthology.orchestra.run.smithi040.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-850-g50bbe7f3-1jammy [240 kB] 2024-09-13T15:31:35.415 INFO:teuthology.orchestra.run.smithi040.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-850-g50bbe7f3-1jammy [145 kB] 2024-09-13T15:31:35.417 INFO:teuthology.orchestra.run.smithi040.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-850-g50bbe7f3-1jammy [2,233 kB] 2024-09-13T15:31:35.441 INFO:teuthology.orchestra.run.smithi040.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-850-g50bbe7f3-1jammy [8,625 kB] 2024-09-13T15:31:35.568 INFO:teuthology.orchestra.run.smithi040.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-850-g50bbe7f3-1jammy [14.3 kB] 2024-09-13T15:31:35.569 INFO:teuthology.orchestra.run.smithi040.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-850-g50bbe7f3-1jammy [42.8 MB] 2024-09-13T15:31:36.472 INFO:teuthology.orchestra.run.smithi040.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-850-g50bbe7f3-1jammy [122 kB] 2024-09-13T15:31:36.474 INFO:teuthology.orchestra.run.smithi040.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.4-850-g50bbe7f3-1jammy [233 kB] 2024-09-13T15:31:36.479 INFO:teuthology.orchestra.run.smithi040.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.4-850-g50bbe7f3-1jammy [34.0 kB] 2024-09-13T15:31:36.480 INFO:teuthology.orchestra.run.smithi040.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.4-850-g50bbe7f3-1jammy [23.5 kB] 2024-09-13T15:31:36.481 INFO:teuthology.orchestra.run.smithi040.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-850-g50bbe7f3-1jammy [38.3 kB] 2024-09-13T15:31:36.482 INFO:teuthology.orchestra.run.smithi040.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-850-g50bbe7f3-1jammy [11.7 MB] 2024-09-13T15:31:36.641 INFO:teuthology.orchestra.run.smithi040.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-850-g50bbe7f3-1jammy [93.1 kB] 2024-09-13T15:31:37.198 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 163 MB in 3s (57.6 MB/s) 2024-09-13T15:31:37.343 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T15:31:37.422 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-13T15:31:37.428 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-13T15:31:37.474 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-13T15:31:37.719 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T15:31:37.746 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T15:31:37.777 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T15:31:38.097 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T15:31:38.124 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-13T15:31:38.163 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-13T15:31:38.475 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-13T15:31:38.501 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-13T15:31:38.583 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T15:31:38.920 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T15:31:38.946 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T15:31:38.986 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T15:31:39.281 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T15:31:39.305 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T15:31:39.340 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T15:31:39.668 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T15:31:39.694 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T15:31:39.734 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T15:31:40.180 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T15:31:40.207 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T15:31:40.255 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T15:31:40.641 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T15:31:40.668 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T15:31:40.708 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T15:31:41.011 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T15:31:41.038 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T15:31:41.077 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T15:31:41.431 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T15:31:41.458 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T15:31:41.497 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T15:31:41.809 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librados2. 2024-09-13T15:31:41.835 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../011-librados2_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:31:41.875 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librados2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:42.278 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librbd1. 2024-09-13T15:31:42.305 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../012-librbd1_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:31:42.336 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librbd1 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:42.764 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T15:31:42.791 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../013-libcephfs2_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:31:42.831 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libcephfs2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:43.108 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rados. 2024-09-13T15:31:43.124 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../014-python3-rados_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:31:43.166 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rados (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:43.578 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T15:31:43.604 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T15:31:43.644 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-ceph-argparse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:43.864 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T15:31:43.880 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../016-python3-cephfs_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:31:43.913 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cephfs (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:44.225 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T15:31:44.252 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T15:31:44.291 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-ceph-common (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:44.603 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T15:31:44.629 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T15:31:44.673 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T15:31:44.964 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T15:31:44.991 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../019-python3-rbd_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:31:45.030 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rbd (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:45.342 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T15:31:45.368 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T15:31:45.400 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T15:31:45.711 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package librgw2. 2024-09-13T15:31:45.738 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../021-librgw2_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:31:45.777 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking librgw2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:46.308 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T15:31:46.332 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../022-python3-rgw_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:31:46.372 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rgw (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:46.692 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T15:31:46.719 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T15:31:46.758 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T15:31:47.011 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T15:31:47.037 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../024-libradosstriper1_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:31:47.077 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libradosstriper1 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:47.690 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-common. 2024-09-13T15:31:47.717 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../025-ceph-common_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:31:47.756 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-common (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:49.062 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-base. 2024-09-13T15:31:49.089 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../026-ceph-base_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:31:49.155 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-base (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:31:49.708 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T15:31:49.724 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T15:31:49.757 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T15:31:50.044 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T15:31:50.060 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T15:31:50.102 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T15:31:50.422 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T15:31:50.449 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T15:31:50.488 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T15:31:50.733 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T15:31:50.760 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T15:31:50.801 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T15:31:51.102 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T15:31:51.129 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T15:31:51.169 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T15:31:51.472 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T15:31:51.499 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T15:31:51.539 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T15:31:51.800 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-portend. 2024-09-13T15:31:51.816 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-09-13T15:31:51.850 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T15:31:52.128 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T15:31:52.144 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T15:31:52.186 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T15:31:52.514 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T15:31:52.541 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T15:31:52.581 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T15:31:52.893 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T15:31:52.920 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T15:31:52.960 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T15:31:53.254 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T15:31:53.281 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T15:31:53.320 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T15:31:53.651 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T15:31:53.678 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T15:31:53.717 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T15:31:53.970 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-mako. 2024-09-13T15:31:53.997 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T15:31:54.036 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T15:31:54.365 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T15:31:54.391 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T15:31:54.431 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T15:31:54.759 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T15:31:54.786 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T15:31:54.825 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T15:31:55.062 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-webob. 2024-09-13T15:31:55.089 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T15:31:55.120 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T15:31:55.448 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T15:31:55.475 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T15:31:55.517 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T15:31:55.826 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T15:31:55.853 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T15:31:55.892 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T15:31:56.195 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-paste. 2024-09-13T15:31:56.223 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T15:31:56.261 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T15:31:56.565 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T15:31:56.581 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T15:31:56.623 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T15:31:56.926 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T15:31:56.953 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T15:31:56.993 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T15:31:57.279 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T15:31:57.306 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T15:31:57.345 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T15:31:57.615 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T15:31:57.642 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T15:31:57.673 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T15:31:58.203 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T15:31:58.230 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T15:31:58.269 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T15:31:58.589 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-idna. 2024-09-13T15:31:58.616 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../051-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T15:31:58.655 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T15:31:58.967 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T15:31:58.994 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T15:31:59.033 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T15:31:59.362 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-requests. 2024-09-13T15:31:59.389 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T15:31:59.436 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T15:31:59.723 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T15:31:59.750 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T15:31:59.789 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T15:32:00.076 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T15:32:00.099 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T15:32:00.142 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-modules-core (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:00.497 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T15:32:00.524 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:00.563 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:00.883 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T15:32:00.910 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../057-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T15:32:00.949 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T15:32:01.253 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T15:32:01.280 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../058-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T15:32:01.319 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T15:32:01.664 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T15:32:01.691 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../059-ceph-mgr_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:01.730 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:02.083 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T15:32:02.100 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../060-ceph-mon_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:02.133 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mon (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:02.754 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T15:32:02.782 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../061-ceph-osd_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:02.822 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-osd (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:03.873 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph. 2024-09-13T15:32:03.901 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../062-ceph_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:03.940 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:04.243 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T15:32:04.270 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../063-ceph-fuse_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:04.301 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-fuse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:04.646 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T15:32:04.673 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../064-ceph-mds_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:04.712 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mds (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:05.099 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephadm. 2024-09-13T15:32:05.126 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../065-cephadm_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:05.165 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephadm (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:05.460 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T15:32:05.487 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../066-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T15:32:05.526 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T15:32:05.821 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T15:32:05.848 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../067-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T15:32:05.887 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T15:32:06.885 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-babel. 2024-09-13T15:32:06.913 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../068-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T15:32:06.951 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T15:32:08.063 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T15:32:08.079 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../069-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T15:32:08.112 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T15:32:08.599 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T15:32:08.626 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../070-ceph-mgr-cephadm_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T15:32:08.657 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-cephadm (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:08.944 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T15:32:08.972 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T15:32:09.002 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T15:32:09.314 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-py. 2024-09-13T15:32:09.341 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-09-13T15:32:09.380 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T15:32:09.709 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T15:32:09.737 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T15:32:09.775 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T15:32:10.078 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-toml. 2024-09-13T15:32:10.105 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-09-13T15:32:10.144 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T15:32:10.397 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T15:32:10.425 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T15:32:10.455 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T15:32:10.785 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T15:32:10.812 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T15:32:10.867 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T15:32:11.137 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-routes. 2024-09-13T15:32:11.164 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T15:32:11.195 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T15:32:11.515 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T15:32:11.543 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T15:32:11.581 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-dashboard (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:12.804 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T15:32:12.820 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T15:32:12.862 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T15:32:13.374 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T15:32:13.401 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T15:32:13.440 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T15:32:13.802 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T15:32:13.830 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T15:32:13.869 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T15:32:14.155 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T15:32:14.182 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T15:32:14.221 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T15:32:15.032 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T15:32:15.060 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T15:32:15.098 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:16.060 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T15:32:16.087 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T15:32:16.126 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T15:32:16.429 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T15:32:16.457 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T15:32:16.495 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T15:32:16.824 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T15:32:16.851 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T15:32:16.890 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T15:32:17.202 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T15:32:17.230 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-13T15:32:17.268 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T15:32:17.589 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T15:32:17.607 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T15:32:17.646 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T15:32:17.942 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T15:32:17.970 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T15:32:18.000 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T15:32:18.278 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T15:32:18.306 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T15:32:18.344 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T15:32:18.664 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T15:32:18.692 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T15:32:18.731 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T15:32:19.574 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T15:32:19.602 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T15:32:19.644 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:19.922 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T15:32:19.950 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T15:32:19.989 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T15:32:20.325 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T15:32:20.353 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T15:32:20.391 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T15:32:20.636 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package jq. 2024-09-13T15:32:20.652 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T15:32:20.686 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T15:32:20.922 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package socat. 2024-09-13T15:32:20.947 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T15:32:20.989 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T15:32:21.284 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T15:32:21.311 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T15:32:21.350 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T15:32:21.671 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-test. 2024-09-13T15:32:21.699 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../098-ceph-test_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:21.729 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-test (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:23.651 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T15:32:23.678 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../099-ceph-volume_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T15:32:23.717 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ceph-volume (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:24.121 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T15:32:24.149 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:24.187 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-mirror (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:24.490 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T15:32:24.518 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-09-13T15:32:24.557 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-13T15:32:24.826 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T15:32:24.843 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../102-cephfs-shell_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T15:32:24.884 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-shell (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:25.146 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T15:32:25.162 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../103-cephfs-top_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T15:32:25.204 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking cephfs-top (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:25.457 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T15:32:25.485 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:25.523 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libcephfs-dev (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:25.876 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T15:32:25.904 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T15:32:25.943 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T15:32:26.281 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T15:32:26.309 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T15:32:26.347 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T15:32:26.750 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T15:32:26.779 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T15:32:26.816 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T15:32:27.137 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T15:32:27.165 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T15:32:27.203 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T15:32:27.531 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T15:32:27.560 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T15:32:27.597 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T15:32:28.052 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T15:32:28.080 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T15:32:28.118 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T15:32:28.454 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T15:32:28.482 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T15:32:28.521 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T15:32:28.924 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T15:32:28.952 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T15:32:28.998 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T15:32:29.903 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package radosgw. 2024-09-13T15:32:29.931 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../113-radosgw_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:29.969 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking radosgw (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:30.697 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T15:32:30.713 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../114-rbd-fuse_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T15:32:30.755 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking rbd-fuse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T15:32:31.310 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T15:32:31.436 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T15:32:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T15:32:32.048 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T15:32:32.485 INFO:teuthology.orchestra.run.smithi040.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T15:32:32.571 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephadm (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:33.164 INFO:teuthology.orchestra.run.smithi040.stdout:Adding system user cephadm....done 2024-09-13T15:32:33.311 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T15:32:33.914 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T15:32:34.156 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T15:32:34.257 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T15:32:34.492 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T15:32:34.762 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T15:32:34.888 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T15:32:35.198 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T15:32:35.541 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T15:32:35.784 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-13T15:32:36.043 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T15:32:36.320 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T15:32:36.587 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T15:32:36.855 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T15:32:37.106 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-ceph-argparse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:37.349 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T15:32:37.475 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-13T15:32:37.734 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T15:32:38.002 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T15:32:38.128 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T15:32:38.513 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T15:32:38.639 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T15:32:38.898 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T15:32:39.149 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T15:32:39.442 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T15:32:40.152 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T15:32:40.429 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T15:32:40.555 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T15:32:40.672 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T15:32:40.948 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T15:32:41.358 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T15:32:41.609 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T15:32:41.994 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T15:32:42.295 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-13T15:32:42.613 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T15:32:42.973 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T15:32:43.207 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T15:32:43.308 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-ceph-common (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:43.609 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T15:32:43.961 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T15:32:45.208 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T15:32:45.342 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T15:32:45.618 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T15:32:45.769 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T15:32:45.904 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T15:32:46.213 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T15:32:46.472 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T15:32:46.724 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T15:32:46.833 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T15:32:46.959 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T15:32:47.277 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T15:32:47.537 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T15:32:47.804 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T15:32:48.064 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T15:32:48.290 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T15:32:48.532 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T15:32:48.650 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T15:32:48.934 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T15:32:49.060 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T15:32:49.362 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T15:32:49.663 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T15:32:49.914 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T15:32:50.317 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T15:32:50.733 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T15:32:50.859 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T15:32:51.261 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T15:32:51.529 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T15:32:51.788 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T15:32:51.897 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T15:32:52.207 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T15:32:52.491 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T15:32:52.784 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T15:32:52.910 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T15:32:53.186 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T15:32:53.471 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T15:32:53.747 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T15:32:54.107 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T15:32:54.433 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T15:32:54.777 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T15:32:54.911 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librados2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:55.037 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librgw2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:55.257 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libsqlite3-mod-ceph (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:55.366 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libcephfs2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:55.492 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libradosstriper1 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:55.618 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T15:32:55.895 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up librbd1 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:56.021 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-modules-core (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:56.122 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-fuse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:56.327 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T15:32:56.327 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T15:32:56.807 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libcephfs-dev (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:56.925 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rados (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:57.050 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-top (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:57.176 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T15:32:58.481 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rbd (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:58.582 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up rbd-fuse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:58.708 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-rgw (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:58.851 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up python3-cephfs (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:58.977 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-shell (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:59.103 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-common (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:32:59.638 INFO:teuthology.orchestra.run.smithi040.stdout:Adding group ceph....done 2024-09-13T15:33:00.007 INFO:teuthology.orchestra.run.smithi040.stdout:Adding system user ceph....done 2024-09-13T15:33:00.183 INFO:teuthology.orchestra.run.smithi040.stdout:Setting system user ceph properties....done 2024-09-13T15:33:00.194 INFO:teuthology.orchestra.run.smithi040.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T15:33:00.335 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T15:33:00.651 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T15:33:01.113 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up cephfs-mirror (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:01.330 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:33:01.330 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T15:33:01.824 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-test (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:02.009 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up radosgw (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:02.607 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:33:02.608 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T15:33:03.096 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-base (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:03.420 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T15:33:03.870 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mds (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:04.087 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T15:33:04.087 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T15:33:04.580 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:04.815 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T15:33:04.815 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T15:33:05.256 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-osd (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:05.537 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T15:33:05.537 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T15:33:06.063 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-k8sevents (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:06.187 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:06.338 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mon (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:06.556 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T15:33:06.557 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T15:33:07.039 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-cephadm (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:07.173 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:07.274 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-mgr-dashboard (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:07.459 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ceph-volume (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T15:33:07.812 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T15:33:08.504 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T15:33:09.010 INFO:teuthology.orchestra.run.smithi040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T15:33:09.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T15:33:09.126 INFO:teuthology.orchestra.run.smithi040.stdout:Reading package lists... 2024-09-13T15:33:09.343 INFO:teuthology.orchestra.run.smithi040.stdout:Building dependency tree... 2024-09-13T15:33:09.344 INFO:teuthology.orchestra.run.smithi040.stdout:Reading state information... 2024-09-13T15:33:09.562 INFO:teuthology.orchestra.run.smithi040.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-13T15:33:09.562 INFO:teuthology.orchestra.run.smithi040.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-13T15:33:09.562 INFO:teuthology.orchestra.run.smithi040.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-13T15:33:09.562 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T15:33:09.562 INFO:teuthology.orchestra.run.smithi040.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T15:33:09.562 INFO:teuthology.orchestra.run.smithi040.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T15:33:09.562 INFO:teuthology.orchestra.run.smithi040.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T15:33:09.563 INFO:teuthology.orchestra.run.smithi040.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T15:33:09.563 INFO:teuthology.orchestra.run.smithi040.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T15:33:09.563 INFO:teuthology.orchestra.run.smithi040.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T15:33:09.564 INFO:teuthology.orchestra.run.smithi040.stdout:The following additional packages will be installed: 2024-09-13T15:33:09.564 INFO:teuthology.orchestra.run.smithi040.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-13T15:33:09.564 INFO:teuthology.orchestra.run.smithi040.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-13T15:33:09.565 INFO:teuthology.orchestra.run.smithi040.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-13T15:33:09.565 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-13T15:33:09.565 INFO:teuthology.orchestra.run.smithi040.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T15:33:09.570 INFO:teuthology.orchestra.run.smithi040.stdout:Suggested packages: 2024-09-13T15:33:09.570 INFO:teuthology.orchestra.run.smithi040.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-13T15:33:09.570 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-13T15:33:09.570 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-13T15:33:09.612 INFO:teuthology.orchestra.run.smithi040.stdout:The following NEW packages will be installed: 2024-09-13T15:33:09.613 INFO:teuthology.orchestra.run.smithi040.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-13T15:33:09.613 INFO:teuthology.orchestra.run.smithi040.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-13T15:33:09.614 INFO:teuthology.orchestra.run.smithi040.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-13T15:33:09.614 INFO:teuthology.orchestra.run.smithi040.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-13T15:33:09.614 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-13T15:33:09.614 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-13T15:33:09.614 INFO:teuthology.orchestra.run.smithi040.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T15:33:09.616 INFO:teuthology.orchestra.run.smithi040.stdout:The following packages will be upgraded: 2024-09-13T15:33:09.617 INFO:teuthology.orchestra.run.smithi040.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-13T15:33:09.799 INFO:teuthology.orchestra.run.smithi040.stdout:4 upgraded, 39 newly installed, 0 to remove and 327 not upgraded. 2024-09-13T15:33:09.799 INFO:teuthology.orchestra.run.smithi040.stdout:Need to get 55.8 MB of archives. 2024-09-13T15:33:09.799 INFO:teuthology.orchestra.run.smithi040.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-13T15:33:09.799 INFO:teuthology.orchestra.run.smithi040.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-13T15:33:10.422 INFO:teuthology.orchestra.run.smithi040.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-13T15:33:10.438 INFO:teuthology.orchestra.run.smithi040.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-13T15:33:10.562 INFO:teuthology.orchestra.run.smithi040.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-13T15:33:10.563 INFO:teuthology.orchestra.run.smithi040.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-13T15:33:10.564 INFO:teuthology.orchestra.run.smithi040.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-13T15:33:10.592 INFO:teuthology.orchestra.run.smithi040.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-13T15:33:10.594 INFO:teuthology.orchestra.run.smithi040.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-13T15:33:10.597 INFO:teuthology.orchestra.run.smithi040.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-13T15:33:10.600 INFO:teuthology.orchestra.run.smithi040.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-13T15:33:10.601 INFO:teuthology.orchestra.run.smithi040.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-13T15:33:10.603 INFO:teuthology.orchestra.run.smithi040.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-13T15:33:10.666 INFO:teuthology.orchestra.run.smithi040.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-13T15:33:10.666 INFO:teuthology.orchestra.run.smithi040.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-13T15:33:10.667 INFO:teuthology.orchestra.run.smithi040.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-13T15:33:10.747 INFO:teuthology.orchestra.run.smithi040.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-13T15:33:11.538 INFO:teuthology.orchestra.run.smithi040.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-13T15:33:11.543 INFO:teuthology.orchestra.run.smithi040.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-13T15:33:11.543 INFO:teuthology.orchestra.run.smithi040.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-13T15:33:11.550 INFO:teuthology.orchestra.run.smithi040.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-13T15:33:11.550 INFO:teuthology.orchestra.run.smithi040.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-13T15:33:11.561 INFO:teuthology.orchestra.run.smithi040.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-13T15:33:11.565 INFO:teuthology.orchestra.run.smithi040.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-13T15:33:11.583 INFO:teuthology.orchestra.run.smithi040.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-13T15:33:11.583 INFO:teuthology.orchestra.run.smithi040.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-13T15:33:11.639 INFO:teuthology.orchestra.run.smithi040.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-13T15:33:11.670 INFO:teuthology.orchestra.run.smithi040.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-13T15:33:11.692 INFO:teuthology.orchestra.run.smithi040.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-13T15:33:11.759 INFO:teuthology.orchestra.run.smithi040.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-13T15:33:11.764 INFO:teuthology.orchestra.run.smithi040.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-13T15:33:11.765 INFO:teuthology.orchestra.run.smithi040.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-13T15:33:11.765 INFO:teuthology.orchestra.run.smithi040.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-13T15:33:11.766 INFO:teuthology.orchestra.run.smithi040.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-13T15:33:11.787 INFO:teuthology.orchestra.run.smithi040.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-13T15:33:11.792 INFO:teuthology.orchestra.run.smithi040.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-13T15:33:12.330 INFO:teuthology.orchestra.run.smithi040.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-13T15:33:12.330 INFO:teuthology.orchestra.run.smithi040.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-13T15:33:12.330 INFO:teuthology.orchestra.run.smithi040.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-13T15:33:12.330 INFO:teuthology.orchestra.run.smithi040.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-13T15:33:12.331 INFO:teuthology.orchestra.run.smithi040.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-13T15:33:12.331 INFO:teuthology.orchestra.run.smithi040.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-13T15:33:12.360 INFO:teuthology.orchestra.run.smithi040.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-13T15:33:12.361 INFO:teuthology.orchestra.run.smithi040.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-13T15:33:12.793 INFO:teuthology.orchestra.run.smithi040.stdout:Preconfiguring packages ... 2024-09-13T15:33:12.968 INFO:teuthology.orchestra.run.smithi040.stdout:Fetched 55.8 MB in 3s (20.4 MB/s) 2024-09-13T15:33:13.295 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173231 files and directories currently installed.) 2024-09-13T15:33:13.301 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T15:33:13.513 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T15:33:14.124 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-13T15:33:15.083 INFO:teuthology.orchestra.run.smithi040.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-13T15:33:15.358 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package flex. 2024-09-13T15:33:15.444 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173231 files and directories currently installed.) 2024-09-13T15:33:15.450 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-13T15:33:15.498 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-13T15:33:16.023 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T15:33:16.221 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-13T15:33:16.630 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T15:33:17.177 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173304 files and directories currently installed.) 2024-09-13T15:33:17.182 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T15:33:17.311 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T15:33:17.704 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T15:33:17.834 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T15:33:18.161 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T15:33:18.552 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package bison. 2024-09-13T15:33:18.658 INFO:teuthology.orchestra.run.smithi040.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173304 files and directories currently installed.) 2024-09-13T15:33:18.663 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-13T15:33:18.721 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T15:33:19.105 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T15:33:19.133 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-13T15:33:19.171 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T15:33:19.483 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package dump. 2024-09-13T15:33:19.511 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-13T15:33:19.549 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking dump (0.4b47-3) ... 2024-09-13T15:33:19.845 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package indent. 2024-09-13T15:33:19.870 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:33:19.911 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T15:33:20.157 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T15:33:20.173 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-13T15:33:20.206 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T15:33:20.543 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T15:33:20.571 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-13T15:33:20.610 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T15:33:20.871 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T15:33:20.899 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-13T15:33:20.946 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T15:33:21.249 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-13T15:33:21.277 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-13T15:33:21.316 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T15:33:21.535 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-13T15:33:21.551 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-13T15:33:21.593 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T15:33:21.855 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libjson-perl. 2024-09-13T15:33:21.871 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-13T15:33:21.913 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-13T15:33:22.224 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-13T15:33:22.241 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-13T15:33:22.282 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T15:33:23.960 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T15:33:23.976 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:33:24.010 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T15:33:24.263 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T15:33:24.291 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:33:24.329 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T15:33:24.649 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T15:33:24.677 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T15:33:24.715 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T15:33:25.085 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T15:33:25.113 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-13T15:33:25.152 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T15:33:25.482 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T15:33:25.510 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T15:33:25.548 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T15:33:25.901 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T15:33:25.930 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:33:25.968 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:33:26.288 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T15:33:26.316 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:33:26.346 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T15:33:26.649 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T15:33:26.674 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:33:26.715 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T15:33:26.968 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T15:33:26.984 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T15:33:27.026 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T15:33:27.496 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T15:33:27.513 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-13T15:33:27.546 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T15:33:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package modemmanager. 2024-09-13T15:33:27.928 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T15:33:27.966 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T15:33:28.732 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package network-manager. 2024-09-13T15:33:28.760 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T15:33:28.807 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-13T15:33:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package ppp. 2024-09-13T15:33:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-13T15:33:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T15:33:30.045 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T15:33:30.073 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-13T15:33:30.111 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-13T15:33:30.356 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T15:33:30.390 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-13T15:33:30.414 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-13T15:33:30.718 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T15:33:30.746 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-13T15:33:30.788 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client-common (238) ... 2024-09-13T15:33:31.013 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-13T15:33:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:33:31.071 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:33:31.718 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T15:33:31.746 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-13T15:33:31.803 INFO:teuthology.orchestra.run.smithi040.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T15:33:31.833 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-common (238) ... 2024-09-13T15:33:32.292 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-14. 2024-09-13T15:33:32.320 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:33:32.362 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:33:33.662 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql. 2024-09-13T15:33:33.679 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-13T15:33:33.711 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql (14+238) ... 2024-09-13T15:33:33.955 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T15:33:33.984 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-13T15:33:34.022 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-client (14+238) ... 2024-09-13T15:33:34.266 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T15:33:34.284 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-13T15:33:34.333 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-13T15:33:34.635 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package tcl8.6. 2024-09-13T15:33:34.664 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-13T15:33:34.702 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T15:33:34.971 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package tcl. 2024-09-13T15:33:35.000 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-13T15:33:35.043 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-13T15:33:35.391 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T15:33:35.419 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-13T15:33:35.466 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T15:33:35.812 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T15:33:35.829 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-13T15:33:35.870 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-13T15:33:36.190 INFO:teuthology.orchestra.run.smithi040.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T15:33:36.219 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-13T15:33:36.257 INFO:teuthology.orchestra.run.smithi040.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T15:33:36.544 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client-common (238) ... 2024-09-13T15:33:36.729 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-13T15:33:36.847 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T15:33:36.973 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:33:37.099 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T15:33:37.225 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T15:33:37.351 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:33:37.866 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T15:33:37.974 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T15:33:38.361 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T15:33:38.361 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T15:33:38.885 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T15:33:39.011 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T15:33:39.112 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T15:33:39.213 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-13T15:33:39.339 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T15:33:39.632 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T15:33:40.417 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T15:33:40.543 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T15:33:41.148 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T15:33:41.274 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up dump (0.4b47-3) ... 2024-09-13T15:33:41.377 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T15:33:41.442 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T15:33:41.568 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T15:33:41.694 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-13T15:33:41.812 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-13T15:33:41.921 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T15:33:41.997 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-13T15:33:42.065 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T15:33:42.191 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T15:33:42.392 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T15:33:42.518 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T15:33:42.644 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-13T15:33:42.812 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-client (14+238) ... 2024-09-13T15:33:42.913 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-13T15:33:43.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:43.357 INFO:teuthology.orchestra.run.smithi040.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T15:33:43.357 INFO:teuthology.orchestra.run.smithi040.stdout:which means they are currently configured by ifupdown: 2024-09-13T15:33:43.357 INFO:teuthology.orchestra.run.smithi040.stdout:- ens1f0 2024-09-13T15:33:43.357 INFO:teuthology.orchestra.run.smithi040.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T15:33:43.358 INFO:teuthology.orchestra.run.smithi040.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T15:33:43.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:43.494 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T15:33:43.814 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T15:33:44.129 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T15:33:44.591 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T15:33:44.742 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T15:33:44.868 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-13T15:33:44.986 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-common (238) ... 2024-09-13T15:33:45.890 INFO:teuthology.orchestra.run.smithi040.stdout:Adding user postgres to group ssl-cert 2024-09-13T15:33:46.147 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:46.148 INFO:teuthology.orchestra.run.smithi040.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T15:33:46.369 INFO:teuthology.orchestra.run.smithi040.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T15:33:46.369 INFO:teuthology.orchestra.run.smithi040.stdout:Removing obsolete dictionary files: 2024-09-13T15:33:46.950 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T15:33:47.313 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:33:47.637 INFO:teuthology.orchestra.run.smithi040.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-13T15:33:47.653 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-13T15:33:47.695 INFO:teuthology.orchestra.run.smithi040.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T15:33:47.695 INFO:teuthology.orchestra.run.smithi040.stdout:This user must also own the server process. 2024-09-13T15:33:47.695 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:47.695 INFO:teuthology.orchestra.run.smithi040.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T15:33:47.695 INFO:teuthology.orchestra.run.smithi040.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T15:33:47.696 INFO:teuthology.orchestra.run.smithi040.stdout:The default text search configuration will be set to "english". 2024-09-13T15:33:47.696 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:47.696 INFO:teuthology.orchestra.run.smithi040.stdout:Data page checksums are disabled. 2024-09-13T15:33:47.696 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:47.696 INFO:teuthology.orchestra.run.smithi040.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-13T15:33:47.696 INFO:teuthology.orchestra.run.smithi040.stdout:creating subdirectories ... ok 2024-09-13T15:33:47.696 INFO:teuthology.orchestra.run.smithi040.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T15:33:47.711 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default max_connections ... 100 2024-09-13T15:33:47.733 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default shared_buffers ... 128MB 2024-09-13T15:33:47.740 INFO:teuthology.orchestra.run.smithi040.stdout:selecting default time zone ... Etc/UTC 2024-09-13T15:33:47.741 INFO:teuthology.orchestra.run.smithi040.stdout:creating configuration files ... ok 2024-09-13T15:33:47.860 INFO:teuthology.orchestra.run.smithi040.stdout:running bootstrap script ... ok 2024-09-13T15:33:48.533 INFO:teuthology.orchestra.run.smithi040.stdout:performing post-bootstrap initialization ... ok 2024-09-13T15:33:49.107 INFO:teuthology.orchestra.run.smithi040.stdout:syncing data to disk ... ok 2024-09-13T15:33:49.522 INFO:teuthology.orchestra.run.smithi040.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T15:33:52.303 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T15:33:52.404 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-13T15:33:52.521 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up postgresql (14+238) ... 2024-09-13T15:33:52.647 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T15:33:52.773 INFO:teuthology.orchestra.run.smithi040.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T15:33:53.045 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T15:33:53.045 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T15:33:53.576 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T15:33:53.844 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T15:33:54.146 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T15:33:54.298 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T15:33:55.668 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-13T15:33:55.768 INFO:teuthology.orchestra.run.smithi040.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T15:33:56.380 INFO:teuthology.orchestra.run.smithi040.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T15:33:56.387 DEBUG:teuthology.parallel:result is None 2024-09-13T15:33:56.388 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:33:56.548 DEBUG:teuthology.orchestra.run.smithi040:> dpkg-query -W -f '${Version}' ceph 2024-09-13T15:33:56.568 INFO:teuthology.orchestra.run.smithi040.stdout:18.2.4-850-g50bbe7f3-1jammy 2024-09-13T15:33:56.568 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850-g50bbe7f3-1jammy 2024-09-13T15:33:56.568 INFO:teuthology.task.install:The correct ceph version 18.2.4-850-g50bbe7f3-1jammy is installed. 2024-09-13T15:33:56.570 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T15:33:56.570 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:33:56.570 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T15:33:56.624 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T15:33:56.625 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:33:56.625 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T15:33:56.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T15:33:56.731 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T15:33:56.731 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:33:56.732 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T15:33:56.788 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T15:33:56.843 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T15:33:56.844 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:33:56.844 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T15:33:56.900 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T15:33:56.960 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T15:33:57.047 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T15:33:57.047 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2024-09-13T15:33:57.060 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T15:33:57.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T15:33:57.116 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T15:33:57.116 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T15:33:57.184 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T15:33:57.185 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T15:33:57.185 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T15:33:57.185 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:33:57.185 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T15:33:57.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T15:33:57.306 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T15:33:57.306 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug cephfs_mirror': 20, 'debug client': 20, 'debug ms': 1, 'log to stderr': False, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.mirror1': {'admin socket': '/var/run/ceph/cephfs-mirror1.asok', 'pid file': '/var/run/ceph/cephfs-mirror1.pid'}, 'client.mirror2': {'admin socket': '/var/run/ceph/cephfs-mirror2.asok', 'pid file': '/var/run/ceph/cephfs-mirror2.pid'}, 'client.mirror3': {'admin socket': '/var/run/ceph/cephfs-mirror3.asok', 'pid file': '/var/run/ceph/cephfs-mirror3.pid'}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 10, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T15:33:57.306 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903738', 'branch': 'wip-rishabh-testing-20240910.095512-reef', 'description': 'fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-modules} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit}', 'email': None, 'first_in_suite': False, 'job_id': '7903738', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'meta': [{'desc': 'create/rm volumes and set configs'}, {'desc': 'run one cephfs-mirror daemon on primary cluster'}, {'desc': 'configure the permissions for client.mirror'}, {'desc': '1 ceph cluster with 1 mon, 1 mgr, 3 osds, 5 mdss'}, {'desc': 'run the cephfs_mirror_ha.sh workunit to test cephfs-mirror daemon in HA active/active mode'}], 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi', 'no_nested_subset': False, 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.095512-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug cephfs_mirror': 20, 'debug client': 20, 'debug ms': 1, 'log to stderr': False, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.mirror1': {'admin socket': '/var/run/ceph/cephfs-mirror1.asok', 'pid file': '/var/run/ceph/cephfs-mirror1.pid'}, 'client.mirror2': {'admin socket': '/var/run/ceph/cephfs-mirror2.asok', 'pid file': '/var/run/ceph/cephfs-mirror2.pid'}, 'client.mirror3': {'admin socket': '/var/run/ceph/cephfs-mirror3.asok', 'pid file': '/var/run/ceph/cephfs-mirror3.pid'}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 10, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.095512-reef', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'mds.b', 'mds.c', 'mds.d', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'client.0', 'client.1', 'client.2', 'client.mirror1', 'client.mirror2', 'client.mirror3', 'client.mirror_remote']], 'seed': 1152, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'sleep_before_teardown': 0, 'subset': '984/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.095512-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMC0KqdqFuHZoB2uKK3RKjjL+59XBYc5fxTDYzlTm/SllPBVGRzgqKICmutJB9yKApzHPsW7wgc3SIx5b+LX4VI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug cephfs_mirror': 20, 'debug client': 20, 'debug ms': 1, 'log to stderr': False, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.mirror1': {'admin socket': '/var/run/ceph/cephfs-mirror1.asok', 'pid file': '/var/run/ceph/cephfs-mirror1.pid'}, 'client.mirror2': {'admin socket': '/var/run/ceph/cephfs-mirror2.asok', 'pid file': '/var/run/ceph/cephfs-mirror2.pid'}, 'client.mirror3': {'admin socket': '/var/run/ceph/cephfs-mirror3.asok', 'pid file': '/var/run/ceph/cephfs-mirror3.pid'}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 10, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'exec': {'mon.a': ['ceph fs volume create dc', 'ceph fs volume create dc-backup']}}, {'full_sequential_finally': [{'exec': {'mon.a': ['ceph config set mon mon_allow_pool_delete true', 'ceph fs volume rm dc --yes-i-really-mean-it', 'ceph fs volume rm dc-backup --yes-i-really-mean-it']}}]}, {'cephfs-mirror': {'client': 'client.mirror1', 'run_in_foreground': True}}, {'cephfs-mirror': {'client': 'client.mirror2', 'run_in_foreground': True}}, {'cephfs-mirror': {'client': 'client.mirror3', 'run_in_foreground': True}}, {'exec': {'client.1': ["sudo ceph auth caps client.0 mon 'allow r' mds 'allow rwps' osd 'allow rw tag cephfs *=*' mgr 'allow r'"], 'client.2': ["sudo ceph auth caps client.1 mon 'allow r' mds 'allow rwps' osd 'allow rw tag cephfs *=*' mgr 'allow r'"], 'client.mirror1': ["sudo ceph auth caps client.mirror1 mon 'profile cephfs-mirror' mds 'allow r' osd 'allow rw tag cephfs metadata=*, allow r tag cephfs data=*' mgr 'allow r'"], 'client.mirror2': ["sudo ceph auth caps client.mirror2 mon 'profile cephfs-mirror' mds 'allow r' osd 'allow rw tag cephfs metadata=*, allow r tag cephfs data=*' mgr 'allow r'"], 'client.mirror3': ["sudo ceph auth caps client.mirror3 mon 'profile cephfs-mirror' mds 'allow r' osd 'allow rw tag cephfs metadata=*, allow r tag cephfs data=*' mgr 'allow r'"], 'client.mirror_remote': ["sudo ceph auth caps client.mirror_remote mon 'allow r' mds 'allow rwps' osd 'allow rw tag cephfs *=*' mgr 'allow r'"]}}, {'ceph-fuse': {'client.1': {'cephfs_name': 'dc'}, 'client.2': {'cephfs_name': 'dc-backup'}}}, {'cephfs_mirror_thrash': {'max_thrash_delay': 10, 'randomize': False}}, {'workunit': {'cleanup': False, 'clients': {'client.1': ['fs/cephfs_mirror_ha_gen.sh']}, 'subdir': 'mirror', 'timeout': '1h'}}, {'exec': {'client.2': ['echo verifying synchronized snapshots...']}}, {'workunit': {'cleanup': False, 'clients': {'client.2': ['fs/cephfs_mirror_ha_verify.sh']}, 'subdir': 'mirror', 'timeout': '3h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:36:41', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T15:33:57.307 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T15:33:57.349 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T15:33:57.405 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:33:57.405 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T15:33:57.453 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T15:33:57.453 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2024-09-13T15:33:57.501 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T15:33:57.502 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:33:57.502 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-13T15:33:57.502 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:33:57.502 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-13 15:27:46.758307868 +0000 2024-09-13T15:33:57.502 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-13 15:27:46.502310142 +0000 2024-09-13T15:33:57.502 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-13 15:27:46.502310142 +0000 2024-09-13T15:33:57.502 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-09-13T15:33:57.502 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T15:33:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-13T15:33:57.555 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-13T15:33:57.556 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000447937 s, 1.1 MB/s 2024-09-13T15:33:57.557 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T15:33:57.607 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2024-09-13T15:33:57.652 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T15:33:57.653 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:33:57.653 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-09-13T15:33:57.653 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:33:57.653 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-13 15:27:47.238303607 +0000 2024-09-13T15:33:57.653 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-13 15:27:46.978305915 +0000 2024-09-13T15:33:57.653 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-13 15:27:46.978305915 +0000 2024-09-13T15:33:57.653 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-09-13T15:33:57.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T15:33:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-13T15:33:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-13T15:33:57.707 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000390571 s, 1.3 MB/s 2024-09-13T15:33:57.709 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T15:33:57.758 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2024-09-13T15:33:57.804 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T15:33:57.805 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:33:57.805 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-09-13T15:33:57.805 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:33:57.805 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-13 15:27:47.754299026 +0000 2024-09-13T15:33:57.805 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-13 15:27:47.498301299 +0000 2024-09-13T15:33:57.805 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-13 15:27:47.498301299 +0000 2024-09-13T15:33:57.805 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-09-13T15:33:57.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T15:33:57.859 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-13T15:33:57.860 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-13T15:33:57.860 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000345623 s, 1.5 MB/s 2024-09-13T15:33:57.861 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T15:33:57.910 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2024-09-13T15:33:57.958 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T15:33:57.958 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:33:57.958 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 941 Links: 1 2024-09-13T15:33:57.958 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:33:57.958 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-09-13 15:27:48.226294836 +0000 2024-09-13T15:33:57.958 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-13 15:27:47.998296860 +0000 2024-09-13T15:33:57.958 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-13 15:27:47.998296860 +0000 2024-09-13T15:33:57.958 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-09-13T15:33:57.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T15:33:58.011 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-09-13T15:33:58.011 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-09-13T15:33:58.011 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000289108 s, 1.8 MB/s 2024-09-13T15:33:58.012 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T15:33:58.062 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-13T15:33:58.062 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-13T15:33:58.062 INFO:tasks.ceph:Generating config... 2024-09-13T15:33:58.064 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T15:33:58.064 INFO:tasks.ceph:[client] debug cephfs_mirror = 20 2024-09-13T15:33:58.065 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T15:33:58.065 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T15:33:58.065 INFO:tasks.ceph:[client] log to stderr = False 2024-09-13T15:33:58.065 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T15:33:58.065 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T15:33:58.065 INFO:tasks.ceph:[client.mirror1] admin socket = /var/run/ceph/cephfs-mirror1.asok 2024-09-13T15:33:58.065 INFO:tasks.ceph:[client.mirror1] pid file = /var/run/ceph/cephfs-mirror1.pid 2024-09-13T15:33:58.066 INFO:tasks.ceph:[client.mirror2] admin socket = /var/run/ceph/cephfs-mirror2.asok 2024-09-13T15:33:58.066 INFO:tasks.ceph:[client.mirror2] pid file = /var/run/ceph/cephfs-mirror2.pid 2024-09-13T15:33:58.066 INFO:tasks.ceph:[client.mirror3] admin socket = /var/run/ceph/cephfs-mirror3.asok 2024-09-13T15:33:58.066 INFO:tasks.ceph:[client.mirror3] pid file = /var/run/ceph/cephfs-mirror3.pid 2024-09-13T15:33:58.066 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T15:33:58.066 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T15:33:58.066 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T15:33:58.066 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T15:33:58.067 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T15:33:58.067 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T15:33:58.067 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T15:33:58.067 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T15:33:58.067 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T15:33:58.067 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T15:33:58.067 INFO:tasks.ceph:[mgr] debug client = 10 2024-09-13T15:33:58.067 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T15:33:58.068 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T15:33:58.068 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T15:33:58.068 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T15:33:58.068 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T15:33:58.068 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T15:33:58.068 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T15:33:58.068 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T15:33:58.068 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T15:33:58.069 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T15:33:58.069 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T15:33:58.069 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T15:33:58.069 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T15:33:58.069 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T15:33:58.069 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T15:33:58.069 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T15:33:58.069 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T15:33:58.070 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T15:33:58.070 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T15:33:58.070 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T15:33:58.070 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T15:33:58.070 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T15:33:58.070 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T15:33:58.071 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T15:33:58.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T15:33:58.137 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T15:33:58.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T15:33:58.241 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T15:33:58.297 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40')] 2024-09-13T15:33:58.297 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 10}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug cephfs_mirror': 20, 'debug client': 20, 'debug ms': 1, 'log to stderr': False, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds.d': {}, 'mds.e': {}, 'client.mirror1': {'admin socket': '/var/run/ceph/cephfs-mirror1.asok', 'pid file': '/var/run/ceph/cephfs-mirror1.pid'}, 'client.mirror2': {'admin socket': '/var/run/ceph/cephfs-mirror2.asok', 'pid file': '/var/run/ceph/cephfs-mirror2.pid'}, 'client.mirror3': {'admin socket': '/var/run/ceph/cephfs-mirror3.asok', 'pid file': '/var/run/ceph/cephfs-mirror3.pid'}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T15:33:58.298 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:33:58.298 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T15:33:58.345 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:33:58.424 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:33:58.424 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid 0a577d39-ad8f-45a9-8f50-4745653ec5d3 2024-09-13T15:33:58.424 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = pacific 2024-09-13T15:33:58.424 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2024-09-13T15:33:58.425 INFO:teuthology.orchestra.run.smithi040.stdout:fsid 0a577d39-ad8f-45a9-8f50-4745653ec5d3 2024-09-13T15:33:58.425 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2024-09-13T15:33:58.424356+0000 2024-09-13T15:33:58.425 INFO:teuthology.orchestra.run.smithi040.stdout:created 2024-09-13T15:33:58.424356+0000 2024-09-13T15:33:58.425 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 16 (pacific) 2024-09-13T15:33:58.425 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2024-09-13T15:33:58.425 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-09-13T15:33:58.425 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-13T15:33:58.426 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T15:33:58.472 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0a577d39-ad8f-45a9-8f50-4745653ec5d3... 2024-09-13T15:33:58.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T15:33:58.547 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2024-09-13T15:33:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2024-09-13T15:33:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T15:33:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2024-09-13T15:33:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2024-09-13T15:33:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2024-09-13T15:33:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.547 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2024-09-13T15:33:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2024-09-13T15:33:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2024-09-13T15:33:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2024-09-13T15:33:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T15:33:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2024-09-13T15:33:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T15:33:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T15:33:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.548 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.549 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = 172.21.15.40 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 0a577d39-ad8f-45a9-8f50-4745653ec5d3 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2024-09-13T15:33:58.550 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2024-09-13T15:33:58.551 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2024-09-13T15:33:58.552 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.552 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2024-09-13T15:33:58.552 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.552 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2024-09-13T15:33:58.552 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.552 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2024-09-13T15:33:58.552 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.552 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2024-09-13T15:33:58.552 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2024-09-13T15:33:58.552 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.552 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2024-09-13T15:33:58.553 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2024-09-13T15:33:58.553 INFO:teuthology.orchestra.run.smithi040.stdout: bdev async discard = True 2024-09-13T15:33:58.553 INFO:teuthology.orchestra.run.smithi040.stdout: bdev enable discard = True 2024-09-13T15:33:58.553 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore allocator = bitmap 2024-09-13T15:33:58.553 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2024-09-13T15:33:58.553 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2024-09-13T15:33:58.553 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 1/20 2024-09-13T15:33:58.553 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 1/20 2024-09-13T15:33:58.553 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-13T15:33:58.553 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 4/10 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-09-13T15:33:58.554 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 10 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:33:58.555 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2024-09-13T15:33:58.556 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2024-09-13T15:33:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2024-09-13T15:33:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on pool no app = False 2024-09-13T15:33:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:33:58.557 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2024-09-13T15:33:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2024-09-13T15:33:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2024-09-13T15:33:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2024-09-13T15:33:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T15:33:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T15:33:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2024-09-13T15:33:58.557 INFO:teuthology.orchestra.run.smithi040.stdout: debug cephfs_mirror = 20 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: log to stderr = False 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.e] 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout:[client.mirror1] 2024-09-13T15:33:58.558 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/cephfs-mirror1.asok 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/cephfs-mirror1.pid 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout:[client.mirror2] 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/cephfs-mirror2.asok 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/cephfs-mirror2.pid 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout:[client.mirror3] 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/cephfs-mirror3.asok 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/cephfs-mirror3.pid 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2024-09-13T15:33:58.559 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2024-09-13T15:33:58.560 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2024-09-13T15:33:58.560 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2024-09-13T15:33:58.560 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2024-09-13T15:33:58.560 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2024-09-13T15:33:58.560 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2024-09-13T15:33:58.561 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T15:33:58.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T15:33:58.653 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T15:33:58.653 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:33:58.653 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T15:33:58.659 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:33:58.659 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T15:33:58.704 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:33:58.705 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:33:58.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T15:33:58.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T15:33:58.770 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:33:58.770 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:33:58.817 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T15:33:58.817 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T15:33:58.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T15:33:58.902 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T15:33:58.905 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T15:33:58.906 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T15:33:58.989 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T15:33:58.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T15:33:59.047 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T15:33:59.134 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T15:33:59.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T15:33:59.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T15:33:59.278 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T15:33:59.281 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T15:33:59.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T15:33:59.423 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T15:33:59.426 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T15:33:59.479 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-13T15:33:59.555 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-13T15:33:59.557 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-13T15:33:59.611 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T15:33:59.611 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T15:33:59.685 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T15:33:59.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T15:33:59.771 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T15:33:59.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T15:33:59.855 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T15:33:59.866 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror1 /etc/ceph/ceph.client.mirror1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.mirror1.keyring 2024-09-13T15:33:59.940 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.mirror1.keyring 2024-09-13T15:33:59.950 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror2 /etc/ceph/ceph.client.mirror2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.mirror2.keyring 2024-09-13T15:34:00.024 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.mirror2.keyring 2024-09-13T15:34:00.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror3 /etc/ceph/ceph.client.mirror3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.mirror3.keyring 2024-09-13T15:34:00.103 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.mirror3.keyring 2024-09-13T15:34:00.112 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror_remote /etc/ceph/ceph.client.mirror_remote.keyring && sudo chmod 0644 /etc/ceph/ceph.client.mirror_remote.keyring 2024-09-13T15:34:00.188 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.mirror_remote.keyring 2024-09-13T15:34:00.199 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T15:34:00.199 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2024-09-13T15:34:00.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T15:34:00.251 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-13T15:34:00.251 INFO:tasks.ceph:role: osd.0 2024-09-13T15:34:00.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:34:00.251 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T15:34:00.312 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:34:00.313 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:34:00.313 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:34:00.313 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T15:34:00.313 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:34:00.313 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:34:00.313 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:34:00.313 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:34:00.313 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:34:00.313 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:34:00.770 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-13T15:34:00.772 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-13T15:34:00.772 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T15:34:00.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T15:34:00.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:34:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:34:00.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T15:34:00.930 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-13T15:34:00.930 INFO:tasks.ceph:role: osd.1 2024-09-13T15:34:00.930 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:34:00.930 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T15:34:00.991 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:34:00.992 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:34:00.992 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:34:00.992 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T15:34:00.992 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:34:00.992 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:34:00.992 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:34:00.992 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:34:00.992 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:34:00.992 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:34:01.458 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-13T15:34:01.460 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-13T15:34:01.460 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T15:34:01.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T15:34:01.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:34:01.635 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:34:01.635 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T15:34:01.689 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-13T15:34:01.689 INFO:tasks.ceph:role: osd.2 2024-09-13T15:34:01.689 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:34:01.689 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T15:34:01.753 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:34:01.753 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:34:01.753 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:34:01.753 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T15:34:01.753 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:34:01.753 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:34:01.753 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:34:01.753 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:34:01.754 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:34:01.754 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:34:02.226 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-09-13T15:34:02.228 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-09-13T15:34:02.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T15:34:02.371 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T15:34:02.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:34:02.384 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:34:02.384 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:34:02.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:02.500+0000 7f21b46a27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T15:34:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:02.500+0000 7f21b46a27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T15:34:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:02.500+0000 7f21b46a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T15:34:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:02.500+0000 7f21b46a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T15:34:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:02.500+0000 7f21b46a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T15:34:02.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:02.500+0000 7f21b46a27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T15:34:05.491 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T15:34:05.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:34:05.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:05.580+0000 7fc71ff637c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T15:34:05.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:05.584+0000 7fc71ff637c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T15:34:05.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:05.584+0000 7fc71ff637c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T15:34:05.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:05.584+0000 7fc71ff637c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T15:34:05.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:05.584+0000 7fc71ff637c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T15:34:05.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:05.584+0000 7fc71ff637c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T15:34:08.570 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T15:34:08.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:34:08.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:08.704+0000 7f0cacc4c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T15:34:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:08.704+0000 7f0cacc4c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T15:34:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:08.704+0000 7f0cacc4c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T15:34:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:08.704+0000 7f0cacc4c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T15:34:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:08.704+0000 7f0cacc4c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T15:34:08.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:08.704+0000 7f0cacc4c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T15:34:11.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T15:34:11.751 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T15:34:11.751 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:11.752 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T15:34:11.809 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:11.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T15:34:11.864 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:11.865 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T15:34:11.920 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:11.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T15:34:11.976 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:11.977 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T15:34:12.033 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:12.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-13T15:34:12.088 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:12.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T15:34:12.145 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:12.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T15:34:12.199 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:12.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T15:34:12.256 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:12.256 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T15:34:12.305 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:12.305 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T15:34:12.356 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:12.356 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T15:34:12.405 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:12.405 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.mirror1.keyring of=/dev/stdout 2024-09-13T15:34:12.453 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:12.453 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.mirror2.keyring of=/dev/stdout 2024-09-13T15:34:12.500 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:12.501 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.mirror3.keyring of=/dev/stdout 2024-09-13T15:34:12.553 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:12.553 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.mirror_remote.keyring of=/dev/stdout 2024-09-13T15:34:12.596 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T15:34:12.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T15:34:12.651 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2024-09-13T15:34:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBmW+RmdGTRNRAA667Mia3hBx2F2sIWuMK2xA== 2024-09-13T15:34:12.652 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-09-13T15:34:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBmW+Rm9On2OhAAPNlMCV3t7x7u0y+zKI85iA== 2024-09-13T15:34:12.652 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-09-13T15:34:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBnW+RmluT/BxAAHrlDP6fj2fpDnBEDyC0eUQ== 2024-09-13T15:34:12.652 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2024-09-13T15:34:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBnW+RmC7mVEBAAJ+DTKStmX7HFosmO/P7y3w== 2024-09-13T15:34:12.652 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2024-09-13T15:34:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBnW+Rmr4hCGRAAjRhAvt7nWStkdPLmii03Rg== 2024-09-13T15:34:12.652 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.e] 2024-09-13T15:34:12.652 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBnW+RmaxUVIRAAwqblxDokA56SURoWWngmHg== 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBqW+RmzI8vHhAAnxXfQV6Ec7Fwe6O8c03Brg== 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBtW+RmcfYIIxAAQ1yylXd4AF5UDyAlTvMWdA== 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBwW+RmSkVGKhAAtundbxX5P21WMcendb+4Ig== 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBnW+RmMWPfKBAA5YX/nuKCxpewa2LaCXoELQ== 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBnW+Rm5X78LRAAB6iADgh9oPim1hfbB3r5+g== 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout:[client.2] 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBnW+RmVIkDMxAAlZswW2FQdXvyVhmqD96qlg== 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout:[client.mirror1] 2024-09-13T15:34:12.653 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBnW+RmuqkMOBAAv+9iept73b8Sp4xhZHsGvg== 2024-09-13T15:34:12.654 INFO:teuthology.orchestra.run.smithi040.stdout:[client.mirror2] 2024-09-13T15:34:12.654 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBoW+RmTAR3ARAApq+ka/gbMmzgbvQnkG8rFA== 2024-09-13T15:34:12.654 INFO:teuthology.orchestra.run.smithi040.stdout:[client.mirror3] 2024-09-13T15:34:12.654 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBoW+RmtpAsBhAAo2+dwwWzRMkzGNJqu9pW8g== 2024-09-13T15:34:12.654 INFO:teuthology.orchestra.run.smithi040.stdout:[client.mirror_remote] 2024-09-13T15:34:12.654 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQBoW+RmtqFBCxAAHucxLHQvzTK2HLByyIjKSg== 2024-09-13T15:34:12.655 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T15:34:12.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:34:12.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:34:12.834 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:34:12.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:34:12.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:34:13.054 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:34:13.093 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:34:13.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:34:13.261 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:34:13.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:34:13.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:34:13.441 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.mirror1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:34:13.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.mirror2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:34:13.612 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.mirror3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:34:13.703 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.mirror_remote --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:34:13.744 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T15:34:13.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T15:34:13.803 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T15:34:13.893 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T15:34:13.905 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:34:13.955 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T15:34:13.956 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T15:34:13.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T15:34:14.001 INFO:tasks.ceph.mon.a:Started 2024-09-13T15:34:14.001 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T15:34:14.001 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T15:34:14.002 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T15:34:14.003 INFO:tasks.ceph.mgr.x:Started 2024-09-13T15:34:14.004 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T15:34:14.004 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T15:34:14.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd92afc5640 1 Processor -- start 2024-09-13T15:34:14.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd92afc5640 1 -- start start 2024-09-13T15:34:14.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd92afc5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9240718a0 0x7fd9240be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:14.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd92afc5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9240b9330 con 0x7fd924071c80 2024-09-13T15:34:14.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd92afc5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9240be780 con 0x7fd9240718a0 2024-09-13T15:34:14.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd928d61640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9240718a0 0x7fd9240be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:14.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd923fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd924071c80 0x7fd9240b8890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59968/0 (socket says 172.21.15.40:59968) 2024-09-13T15:34:14.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd928d61640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd9240718a0 0x7fd9240be0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58942/0 (socket says 172.21.15.40:58942) 2024-09-13T15:34:14.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd923fff640 1 -- 172.21.15.40:0/3291749302 learned_addr learned my addr 172.21.15.40:0/3291749302 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:14.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd928d61640 1 -- 172.21.15.40:0/3291749302 >> v2:172.21.15.40:3300/0 conn(0x7fd9240718a0 msgr2=0x7fd9240be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:34:14.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd928d61640 1 -- 172.21.15.40:0/3291749302 >> v2:172.21.15.40:3300/0 conn(0x7fd9240718a0 msgr2=0x7fd9240be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:34:14.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd928d61640 1 --2- 172.21.15.40:0/3291749302 >> v2:172.21.15.40:3300/0 conn(0x7fd9240718a0 0x7fd9240be0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:34:14.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.124+0000 7fd928d61640 1 --2- 172.21.15.40:0/3291749302 >> v2:172.21.15.40:3300/0 conn(0x7fd9240718a0 0x7fd9240be0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:34:14.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.136+0000 7fd9237fe640 1 -- 172.21.15.40:0/3291749302 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483182825 0 0) 0x7fd9240b9330 con 0x7fd924071c80 2024-09-13T15:34:14.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.136+0000 7fd9237fe640 1 -- 172.21.15.40:0/3291749302 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd90c005740 con 0x7fd924071c80 2024-09-13T15:34:14.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.136+0000 7fd9237fe640 1 -- 172.21.15.40:0/3291749302 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3069974461 0 0) 0x7fd90c005740 con 0x7fd924071c80 2024-09-13T15:34:14.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.136+0000 7fd9237fe640 1 -- 172.21.15.40:0/3291749302 >> v2:172.21.15.40:3300/0 conn(0x7fd9240718a0 msgr2=0x7fd9240be0e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:34:14.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.136+0000 7fd9237fe640 1 --2- 172.21.15.40:0/3291749302 >> v2:172.21.15.40:3300/0 conn(0x7fd9240718a0 0x7fd9240be0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:14.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.136+0000 7fd9237fe640 1 -- 172.21.15.40:0/3291749302 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9240b8fa0 con 0x7fd924071c80 2024-09-13T15:34:14.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.136+0000 7fd9237fe640 1 -- 172.21.15.40:0/3291749302 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 3934534855 0 0) 0x7fd918001600 con 0x7fd924071c80 2024-09-13T15:34:14.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.136+0000 7fd9237fe640 1 -- 172.21.15.40:0/3291749302 >> v1:172.21.15.40:6789/0 conn(0x7fd924071c80 legacy=0x7fd9240b8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:14.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.136+0000 7fd9237fe640 1 --2- 172.21.15.40:0/3291749302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 0x7fd90c005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:14.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.136+0000 7fd9237fe640 1 -- 172.21.15.40:0/3291749302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9240be780 con 0x7fd90c005b90 2024-09-13T15:34:14.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.136+0000 7fd928d61640 1 --2- 172.21.15.40:0/3291749302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 0x7fd90c005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:14.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.136+0000 7fd928d61640 1 -- 172.21.15.40:0/3291749302 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c005740 con 0x7fd90c005b90 2024-09-13T15:34:14.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.156+0000 7fd928d61640 1 --2- 172.21.15.40:0/3291749302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 0x7fd90c005f90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd91400c7a0 tx=0x7fd91401c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981accb4ae8232e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:14.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.156+0000 7fd9237fe640 1 -- 172.21.15.40:0/3291749302 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9140ab5b0 con 0x7fd90c005b90 2024-09-13T15:34:14.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.156+0000 7fd9237fe640 1 -- 172.21.15.40:0/3291749302 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9140ab710 con 0x7fd90c005b90 2024-09-13T15:34:14.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.156+0000 7fd9237fe640 1 -- 172.21.15.40:0/3291749302 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9140ab9f0 con 0x7fd90c005b90 2024-09-13T15:34:14.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.156+0000 7fd92afc5640 1 -- 172.21.15.40:0/3291749302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 msgr2=0x7fd90c005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:14.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.156+0000 7fd92afc5640 1 --2- 172.21.15.40:0/3291749302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 0x7fd90c005f90 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd91400c7a0 tx=0x7fd91401c5f0 comp rx=0 tx=0).stop 2024-09-13T15:34:14.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.156+0000 7fd92afc5640 1 -- 172.21.15.40:0/3291749302 shutdown_connections 2024-09-13T15:34:14.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.156+0000 7fd92afc5640 1 --2- 172.21.15.40:0/3291749302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 0x7fd90c005f90 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:14.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.156+0000 7fd92afc5640 1 --2- 172.21.15.40:0/3291749302 >> v2:172.21.15.40:3300/0 conn(0x7fd9240718a0 0x7fd9240be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:14.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.156+0000 7fd92afc5640 1 -- 172.21.15.40:0/3291749302 >> 172.21.15.40:0/3291749302 conn(0x7fd92406cf30 msgr2=0x7fd924070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:14.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.156+0000 7fd92afc5640 1 -- 172.21.15.40:0/3291749302 shutdown_connections 2024-09-13T15:34:14.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.156+0000 7fd92afc5640 1 -- 172.21.15.40:0/3291749302 wait complete. 2024-09-13T15:34:14.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd92afc5640 1 Processor -- start 2024-09-13T15:34:14.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd92afc5640 1 -- start start 2024-09-13T15:34:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd92afc5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 0x7fd9240bb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd92afc5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9240bbf30 con 0x7fd90c005b90 2024-09-13T15:34:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd928d61640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 0x7fd9240bb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd928d61640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 0x7fd9240bb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58984/0 (socket says 172.21.15.40:58984) 2024-09-13T15:34:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd928d61640 1 -- 172.21.15.40:0/1837648730 learned_addr learned my addr 172.21.15.40:0/1837648730 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:14.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd928d61640 1 -- 172.21.15.40:0/1837648730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92415abf0 con 0x7fd90c005b90 2024-09-13T15:34:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd928d61640 1 --2- 172.21.15.40:0/1837648730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 0x7fd9240bb9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd9140ad040 tx=0x7fd90c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd9217fa640 1 -- 172.21.15.40:0/1837648730 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9140abc60 con 0x7fd90c005b90 2024-09-13T15:34:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd9217fa640 1 -- 172.21.15.40:0/1837648730 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9140abdc0 con 0x7fd90c005b90 2024-09-13T15:34:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd92afc5640 1 -- 172.21.15.40:0/1837648730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9240bc1b0 con 0x7fd90c005b90 2024-09-13T15:34:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd9217fa640 1 -- 172.21.15.40:0/1837648730 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9140bd580 con 0x7fd90c005b90 2024-09-13T15:34:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd92afc5640 1 -- 172.21.15.40:0/1837648730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd924148700 con 0x7fd90c005b90 2024-09-13T15:34:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd9217fa640 1 -- 172.21.15.40:0/1837648730 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd9140bd9e0 con 0x7fd90c005b90 2024-09-13T15:34:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd9217fa640 1 -- 172.21.15.40:0/1837648730 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd9140c7a30 con 0x7fd90c005b90 2024-09-13T15:34:14.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.160+0000 7fd92afc5640 1 -- 172.21.15.40:0/1837648730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd924067730 con 0x7fd90c005b90 2024-09-13T15:34:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.168+0000 7fd9217fa640 1 -- 172.21.15.40:0/1837648730 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd9140c2070 con 0x7fd90c005b90 2024-09-13T15:34:14.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.228+0000 7fd92afc5640 1 -- 172.21.15.40:0/1837648730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd9240be0e0 con 0x7fd90c005b90 2024-09-13T15:34:14.239 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.232+0000 7fd9217fa640 1 -- 172.21.15.40:0/1837648730 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd91400f040 con 0x7fd90c005b90 2024-09-13T15:34:14.239 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2024-09-13T15:34:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.236+0000 7fd92afc5640 1 -- 172.21.15.40:0/1837648730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 msgr2=0x7fd9240bb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:14.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.236+0000 7fd92afc5640 1 --2- 172.21.15.40:0/1837648730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 0x7fd9240bb9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd9140ad040 tx=0x7fd90c007a10 comp rx=0 tx=0).stop 2024-09-13T15:34:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.236+0000 7fd92afc5640 1 -- 172.21.15.40:0/1837648730 shutdown_connections 2024-09-13T15:34:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.236+0000 7fd92afc5640 1 --2- 172.21.15.40:0/1837648730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd90c005b90 0x7fd9240bb9f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.236+0000 7fd92afc5640 1 -- 172.21.15.40:0/1837648730 >> 172.21.15.40:0/1837648730 conn(0x7fd92406cf30 msgr2=0x7fd92406a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.236+0000 7fd92afc5640 1 -- 172.21.15.40:0/1837648730 shutdown_connections 2024-09-13T15:34:14.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.236+0000 7fd92afc5640 1 -- 172.21.15.40:0/1837648730 wait complete. 2024-09-13T15:34:14.258 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T15:34:14.258 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T15:34:14.258 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:14.258 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T15:34:14.267 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:14.268 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T15:34:14.323 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:34:14.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T15:34:14.363 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:14.356+0000 7f19a8500180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T15:34:14.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 4c63eaa2-bbc3-4d24-b5a2-273b613288e1 0 2024-09-13T15:34:14.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.536+0000 7f5e6e81c640 1 Processor -- start 2024-09-13T15:34:14.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.536+0000 7f5e6e81c640 1 -- start start 2024-09-13T15:34:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.536+0000 7f5e6e81c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e680beb90 0x7f5e680b7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.536+0000 7f5e6e81c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e680b7860 con 0x7f5e680bef70 2024-09-13T15:34:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.536+0000 7f5e6e81c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e680b9330 con 0x7f5e680beb90 2024-09-13T15:34:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e677fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5e680bef70 0x7f5e680b97d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59976/0 (socket says 172.21.15.40:59976) 2024-09-13T15:34:14.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e677fe640 1 -- 172.21.15.40:0/65015036 learned_addr learned my addr 172.21.15.40:0/65015036 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e67fff640 1 --2- 172.21.15.40:0/65015036 >> v2:172.21.15.40:3300/0 conn(0x7f5e680beb90 0x7f5e680b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e67fff640 1 -- 172.21.15.40:0/65015036 >> v1:172.21.15.40:6789/0 conn(0x7f5e680bef70 legacy=0x7f5e680b97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:14.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e67fff640 1 -- 172.21.15.40:0/65015036 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6806c380 con 0x7f5e680beb90 2024-09-13T15:34:14.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e67fff640 1 --2- 172.21.15.40:0/65015036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e680beb90 0x7f5e680b7320 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009740 tx=0x7f5e5801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd1bcf5e654e02d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:14.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e66ffd640 1 -- 172.21.15.40:0/65015036 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e580ab530 con 0x7f5e680beb90 2024-09-13T15:34:14.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e66ffd640 1 -- 172.21.15.40:0/65015036 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e580a7050 con 0x7f5e680beb90 2024-09-13T15:34:14.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e66ffd640 1 -- 172.21.15.40:0/65015036 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e580ab7e0 con 0x7f5e680beb90 2024-09-13T15:34:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e6e81c640 1 -- 172.21.15.40:0/65015036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e680beb90 msgr2=0x7f5e680b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e6e81c640 1 --2- 172.21.15.40:0/65015036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e680beb90 0x7f5e680b7320 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5e58009740 tx=0x7f5e5801c390 comp rx=0 tx=0).stop 2024-09-13T15:34:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e6e81c640 1 -- 172.21.15.40:0/65015036 shutdown_connections 2024-09-13T15:34:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e6e81c640 1 --2- 172.21.15.40:0/65015036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e680beb90 0x7f5e680b7320 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e6e81c640 1 -- 172.21.15.40:0/65015036 >> 172.21.15.40:0/65015036 conn(0x7f5e68070cf0 msgr2=0x7f5e68071100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:14.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e6e81c640 1 -- 172.21.15.40:0/65015036 shutdown_connections 2024-09-13T15:34:14.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.540+0000 7f5e6e81c640 1 -- 172.21.15.40:0/65015036 wait complete. 2024-09-13T15:34:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e6e81c640 1 Processor -- start 2024-09-13T15:34:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e6e81c640 1 -- start start 2024-09-13T15:34:14.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e6e81c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e680beb90 0x7f5e68142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e6e81c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680bcdb0 con 0x7f5e680beb90 2024-09-13T15:34:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e67fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e680beb90 0x7f5e68142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e67fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e680beb90 0x7f5e68142b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58996/0 (socket says 172.21.15.40:58996) 2024-09-13T15:34:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e67fff640 1 -- 172.21.15.40:0/3009553370 learned_addr learned my addr 172.21.15.40:0/3009553370 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e67fff640 1 -- 172.21.15.40:0/3009553370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e58009420 con 0x7f5e680beb90 2024-09-13T15:34:14.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e67fff640 1 --2- 172.21.15.40:0/3009553370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e680beb90 0x7f5e68142b00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5e580ae040 tx=0x7f5e5801abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e64ff9640 1 -- 172.21.15.40:0/3009553370 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e580b7450 con 0x7f5e680beb90 2024-09-13T15:34:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e64ff9640 1 -- 172.21.15.40:0/3009553370 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e580b75b0 con 0x7f5e680beb90 2024-09-13T15:34:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e6e81c640 1 -- 172.21.15.40:0/3009553370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e68157b30 con 0x7f5e680beb90 2024-09-13T15:34:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e64ff9640 1 -- 172.21.15.40:0/3009553370 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e580b7890 con 0x7f5e680beb90 2024-09-13T15:34:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e6e81c640 1 -- 172.21.15.40:0/3009553370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e68143040 con 0x7f5e680beb90 2024-09-13T15:34:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e64ff9640 1 -- 172.21.15.40:0/3009553370 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5e580b7cf0 con 0x7f5e680beb90 2024-09-13T15:34:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e64ff9640 1 -- 172.21.15.40:0/3009553370 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5e580c0d90 con 0x7f5e680beb90 2024-09-13T15:34:14.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.544+0000 7f5e6e81c640 1 -- 172.21.15.40:0/3009553370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e68159b40 con 0x7f5e680beb90 2024-09-13T15:34:14.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.548+0000 7f5e64ff9640 1 -- 172.21.15.40:0/3009553370 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f5e580bb020 con 0x7f5e680beb90 2024-09-13T15:34:14.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.616+0000 7f5e6e81c640 1 -- 172.21.15.40:0/3009553370 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4c63eaa2-bbc3-4d24-b5a2-273b613288e1", "id": 0} v 0) v1 -- 0x7f5e680b7320 con 0x7f5e680beb90 2024-09-13T15:34:14.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.620+0000 7f5e64ff9640 1 -- 172.21.15.40:0/3009553370 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4c63eaa2-bbc3-4d24-b5a2-273b613288e1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5e580b0070 con 0x7f5e680beb90 2024-09-13T15:34:14.626 INFO:teuthology.orchestra.run.smithi040.stdout:0 2024-09-13T15:34:14.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.620+0000 7f5e6e81c640 1 -- 172.21.15.40:0/3009553370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e680beb90 msgr2=0x7f5e68142b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:14.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.620+0000 7f5e6e81c640 1 --2- 172.21.15.40:0/3009553370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e680beb90 0x7f5e68142b00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5e580ae040 tx=0x7f5e5801abd0 comp rx=0 tx=0).stop 2024-09-13T15:34:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.620+0000 7f5e6e81c640 1 -- 172.21.15.40:0/3009553370 shutdown_connections 2024-09-13T15:34:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.620+0000 7f5e6e81c640 1 --2- 172.21.15.40:0/3009553370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e680beb90 0x7f5e68142b00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.620+0000 7f5e6e81c640 1 -- 172.21.15.40:0/3009553370 >> 172.21.15.40:0/3009553370 conn(0x7f5e68070cf0 msgr2=0x7f5e68147d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.620+0000 7f5e6e81c640 1 -- 172.21.15.40:0/3009553370 shutdown_connections 2024-09-13T15:34:14.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.620+0000 7f5e6e81c640 1 -- 172.21.15.40:0/3009553370 wait complete. 2024-09-13T15:34:14.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 379bdd5f-9524-4dc4-ab42-d1df72a6efb2 1 2024-09-13T15:34:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.752+0000 7fb770ea1640 1 Processor -- start 2024-09-13T15:34:14.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.752+0000 7fb770ea1640 1 -- start start 2024-09-13T15:34:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb770ea1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb76c0be9d0 0x7fb76c06bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb770ea1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76c065fb0 con 0x7fb76c06c050 2024-09-13T15:34:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb770ea1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76c066450 con 0x7fb76c0be9d0 2024-09-13T15:34:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb76a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb76c0be9d0 0x7fb76c06bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb769d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb76c06c050 0x7fb76c0b8580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59992/0 (socket says 172.21.15.40:59992) 2024-09-13T15:34:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb769d9b640 1 -- 172.21.15.40:0/111480637 learned_addr learned my addr 172.21.15.40:0/111480637 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb76a59c640 1 -- 172.21.15.40:0/111480637 >> v1:172.21.15.40:6789/0 conn(0x7fb76c06c050 legacy=0x7fb76c0b8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb76a59c640 1 -- 172.21.15.40:0/111480637 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c0b94a0 con 0x7fb76c0be9d0 2024-09-13T15:34:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb76a59c640 1 --2- 172.21.15.40:0/111480637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb76c0be9d0 0x7fb76c06bb10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb760009740 tx=0x7fb76001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a61b828817d481a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:14.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb76959a640 1 -- 172.21.15.40:0/111480637 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7600ac540 con 0x7fb76c0be9d0 2024-09-13T15:34:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb76959a640 1 -- 172.21.15.40:0/111480637 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7600ac6a0 con 0x7fb76c0be9d0 2024-09-13T15:34:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb76959a640 1 -- 172.21.15.40:0/111480637 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7600ac960 con 0x7fb76c0be9d0 2024-09-13T15:34:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb770ea1640 1 -- 172.21.15.40:0/111480637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb76c0be9d0 msgr2=0x7fb76c06bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb770ea1640 1 --2- 172.21.15.40:0/111480637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb76c0be9d0 0x7fb76c06bb10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb760009740 tx=0x7fb76001c390 comp rx=0 tx=0).stop 2024-09-13T15:34:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb770ea1640 1 -- 172.21.15.40:0/111480637 shutdown_connections 2024-09-13T15:34:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb770ea1640 1 --2- 172.21.15.40:0/111480637 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb76c0be9d0 0x7fb76c06bb10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb770ea1640 1 -- 172.21.15.40:0/111480637 >> 172.21.15.40:0/111480637 conn(0x7fb76c070c80 msgr2=0x7fb76c071090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb770ea1640 1 -- 172.21.15.40:0/111480637 shutdown_connections 2024-09-13T15:34:14.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.756+0000 7fb770ea1640 1 -- 172.21.15.40:0/111480637 wait complete. 2024-09-13T15:34:14.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb770ea1640 1 Processor -- start 2024-09-13T15:34:14.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb770ea1640 1 -- start start 2024-09-13T15:34:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb770ea1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb76c06c050 0x7fb76c15e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb770ea1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c146610 con 0x7fb76c06c050 2024-09-13T15:34:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb76a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb76c06c050 0x7fb76c15e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb76a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb76c06c050 0x7fb76c15e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59002/0 (socket says 172.21.15.40:59002) 2024-09-13T15:34:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb76a59c640 1 -- 172.21.15.40:0/3871559623 learned_addr learned my addr 172.21.15.40:0/3871559623 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb76a59c640 1 -- 172.21.15.40:0/3871559623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760009420 con 0x7fb76c06c050 2024-09-13T15:34:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb76a59c640 1 --2- 172.21.15.40:0/3871559623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb76c06c050 0x7fb76c15e980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb760019fc0 tx=0x7fb760019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb75affd640 1 -- 172.21.15.40:0/3871559623 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7600b5540 con 0x7fb76c06c050 2024-09-13T15:34:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb75affd640 1 -- 172.21.15.40:0/3871559623 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7600b56a0 con 0x7fb76c06c050 2024-09-13T15:34:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb770ea1640 1 -- 172.21.15.40:0/3871559623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76c148950 con 0x7fb76c06c050 2024-09-13T15:34:14.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb75affd640 1 -- 172.21.15.40:0/3871559623 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7600b5940 con 0x7fb76c06c050 2024-09-13T15:34:14.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb770ea1640 1 -- 172.21.15.40:0/3871559623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76c15eec0 con 0x7fb76c06c050 2024-09-13T15:34:14.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb75affd640 1 -- 172.21.15.40:0/3871559623 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb7600b3040 con 0x7fb76c06c050 2024-09-13T15:34:14.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb75affd640 1 -- 172.21.15.40:0/3871559623 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fb7600bde40 con 0x7fb76c06c050 2024-09-13T15:34:14.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.760+0000 7fb770ea1640 1 -- 172.21.15.40:0/3871559623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76c06bb10 con 0x7fb76c06c050 2024-09-13T15:34:14.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.764+0000 7fb75affd640 1 -- 172.21.15.40:0/3871559623 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb7600b1070 con 0x7fb76c06c050 2024-09-13T15:34:14.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.832+0000 7fb770ea1640 1 -- 172.21.15.40:0/3871559623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "379bdd5f-9524-4dc4-ab42-d1df72a6efb2", "id": 1} v 0) v1 -- 0x7fb76c0bd0c0 con 0x7fb76c06c050 2024-09-13T15:34:14.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.832+0000 7fb75affd640 1 -- 172.21.15.40:0/3871559623 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "379bdd5f-9524-4dc4-ab42-d1df72a6efb2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb7600bd4a0 con 0x7fb76c06c050 2024-09-13T15:34:14.840 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-09-13T15:34:14.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.836+0000 7fb770ea1640 1 -- 172.21.15.40:0/3871559623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb76c06c050 msgr2=0x7fb76c15e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:14.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.836+0000 7fb770ea1640 1 --2- 172.21.15.40:0/3871559623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb76c06c050 0x7fb76c15e980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb760019fc0 tx=0x7fb760019130 comp rx=0 tx=0).stop 2024-09-13T15:34:14.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.836+0000 7fb770ea1640 1 -- 172.21.15.40:0/3871559623 shutdown_connections 2024-09-13T15:34:14.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.836+0000 7fb770ea1640 1 --2- 172.21.15.40:0/3871559623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb76c06c050 0x7fb76c15e980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:14.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.836+0000 7fb770ea1640 1 -- 172.21.15.40:0/3871559623 >> 172.21.15.40:0/3871559623 conn(0x7fb76c070c80 msgr2=0x7fb76c0c0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:14.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.836+0000 7fb770ea1640 1 -- 172.21.15.40:0/3871559623 shutdown_connections 2024-09-13T15:34:14.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.836+0000 7fb770ea1640 1 -- 172.21.15.40:0/3871559623 wait complete. 2024-09-13T15:34:14.850 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:14.844+0000 7f19a8500180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T15:34:14.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 6b7fc5d5-3632-436a-a2a6-bd0beb5490a4 2 2024-09-13T15:34:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.964+0000 7ff1012ba640 1 Processor -- start 2024-09-13T15:34:14.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.964+0000 7ff1012ba640 1 -- start start 2024-09-13T15:34:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.964+0000 7ff1012ba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff0fc0bd580 0x7ff0fc06a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.964+0000 7ff1012ba640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc0bfc90 con 0x7ff0fc0bf0f0 2024-09-13T15:34:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.964+0000 7ff1012ba640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc151800 con 0x7ff0fc0bd580 2024-09-13T15:34:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.964+0000 7ff0fa7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff0fc0bf0f0 0x7ff0fc06ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60002/0 (socket says 172.21.15.40:60002) 2024-09-13T15:34:14.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.964+0000 7ff0fa7fc640 1 -- 172.21.15.40:0/2707899763 learned_addr learned my addr 172.21.15.40:0/2707899763 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.964+0000 7ff0faffd640 1 --2- 172.21.15.40:0/2707899763 >> v2:172.21.15.40:3300/0 conn(0x7ff0fc0bd580 0x7ff0fc06a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.964+0000 7ff0f9ffb640 1 -- 172.21.15.40:0/2707899763 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219165392 0 0) 0x7ff0fc0bfc90 con 0x7ff0fc0bf0f0 2024-09-13T15:34:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.964+0000 7ff0f9ffb640 1 -- 172.21.15.40:0/2707899763 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0e4003530 con 0x7ff0fc0bf0f0 2024-09-13T15:34:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.964+0000 7ff0faffd640 1 -- 172.21.15.40:0/2707899763 >> v1:172.21.15.40:6789/0 conn(0x7ff0fc0bf0f0 legacy=0x7ff0fc06ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:14.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.964+0000 7ff0faffd640 1 -- 172.21.15.40:0/2707899763 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0b7270 con 0x7ff0fc0bd580 2024-09-13T15:34:14.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff0faffd640 1 --2- 172.21.15.40:0/2707899763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0fc0bd580 0x7ff0fc06a9a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009740 tx=0x7ff0ec01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27f879c5b450d06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:14.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff0f9ffb640 1 -- 172.21.15.40:0/2707899763 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0ab400 con 0x7ff0fc0bd580 2024-09-13T15:34:14.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff0f9ffb640 1 -- 172.21.15.40:0/2707899763 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec0a7050 con 0x7ff0fc0bd580 2024-09-13T15:34:14.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff0f9ffb640 1 -- 172.21.15.40:0/2707899763 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec0ab690 con 0x7ff0fc0bd580 2024-09-13T15:34:14.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff1012ba640 1 -- 172.21.15.40:0/2707899763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0fc0bd580 msgr2=0x7ff0fc06a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:14.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff1012ba640 1 --2- 172.21.15.40:0/2707899763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0fc0bd580 0x7ff0fc06a9a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009740 tx=0x7ff0ec01c420 comp rx=0 tx=0).stop 2024-09-13T15:34:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff1012ba640 1 -- 172.21.15.40:0/2707899763 shutdown_connections 2024-09-13T15:34:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff1012ba640 1 --2- 172.21.15.40:0/2707899763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0fc0bd580 0x7ff0fc06a9a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff1012ba640 1 -- 172.21.15.40:0/2707899763 >> 172.21.15.40:0/2707899763 conn(0x7ff0fc06f450 msgr2=0x7ff0fc06f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff1012ba640 1 -- 172.21.15.40:0/2707899763 shutdown_connections 2024-09-13T15:34:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff1012ba640 1 -- 172.21.15.40:0/2707899763 wait complete. 2024-09-13T15:34:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff1012ba640 1 Processor -- start 2024-09-13T15:34:14.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff1012ba640 1 -- start start 2024-09-13T15:34:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff1012ba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0fc0bd580 0x7ff0fc147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff1012ba640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc142360 con 0x7ff0fc0bd580 2024-09-13T15:34:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff0faffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0fc0bd580 0x7ff0fc147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:14.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff0faffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0fc0bd580 0x7ff0fc147e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59020/0 (socket says 172.21.15.40:59020) 2024-09-13T15:34:14.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff0faffd640 1 -- 172.21.15.40:0/772744478 learned_addr learned my addr 172.21.15.40:0/772744478 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:14.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.968+0000 7ff0faffd640 1 -- 172.21.15.40:0/772744478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec009420 con 0x7ff0fc0bd580 2024-09-13T15:34:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.972+0000 7ff0faffd640 1 --2- 172.21.15.40:0/772744478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0fc0bd580 0x7ff0fc147e40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec019030 tx=0x7ff0ec0191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.972+0000 7ff0e37fe640 1 -- 172.21.15.40:0/772744478 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec003960 con 0x7ff0fc0bd580 2024-09-13T15:34:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.972+0000 7ff0e37fe640 1 -- 172.21.15.40:0/772744478 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec003ac0 con 0x7ff0fc0bd580 2024-09-13T15:34:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.972+0000 7ff0e37fe640 1 -- 172.21.15.40:0/772744478 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec003d60 con 0x7ff0fc0bd580 2024-09-13T15:34:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.972+0000 7ff1012ba640 1 -- 172.21.15.40:0/772744478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc1e9c30 con 0x7ff0fc0bd580 2024-09-13T15:34:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.972+0000 7ff1012ba640 1 -- 172.21.15.40:0/772744478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc1e9e60 con 0x7ff0fc0bd580 2024-09-13T15:34:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.972+0000 7ff0e37fe640 1 -- 172.21.15.40:0/772744478 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff0ec0b2040 con 0x7ff0fc0bd580 2024-09-13T15:34:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.972+0000 7ff0e37fe640 1 -- 172.21.15.40:0/772744478 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7ff0ec0b4910 con 0x7ff0fc0bd580 2024-09-13T15:34:14.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.972+0000 7ff1012ba640 1 -- 172.21.15.40:0/772744478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc0c2390 con 0x7ff0fc0bd580 2024-09-13T15:34:14.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:14.972+0000 7ff0e37fe640 1 -- 172.21.15.40:0/772744478 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff0ec0dde30 con 0x7ff0fc0bd580 2024-09-13T15:34:15.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.040+0000 7ff1012ba640 1 -- 172.21.15.40:0/772744478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6b7fc5d5-3632-436a-a2a6-bd0beb5490a4", "id": 2} v 0) v1 -- 0x7ff0fc06a9a0 con 0x7ff0fc0bd580 2024-09-13T15:34:15.045 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:15.040+0000 7f19a8500180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T15:34:15.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.044+0000 7ff0e37fe640 1 -- 172.21.15.40:0/772744478 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b7fc5d5-3632-436a-a2a6-bd0beb5490a4", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff0ec0cc070 con 0x7ff0fc0bd580 2024-09-13T15:34:15.048 INFO:teuthology.orchestra.run.smithi040.stdout:2 2024-09-13T15:34:15.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.044+0000 7ff1012ba640 1 -- 172.21.15.40:0/772744478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0fc0bd580 msgr2=0x7ff0fc147e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:15.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.044+0000 7ff1012ba640 1 --2- 172.21.15.40:0/772744478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0fc0bd580 0x7ff0fc147e40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec019030 tx=0x7ff0ec0191c0 comp rx=0 tx=0).stop 2024-09-13T15:34:15.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.044+0000 7ff1012ba640 1 -- 172.21.15.40:0/772744478 shutdown_connections 2024-09-13T15:34:15.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.044+0000 7ff1012ba640 1 --2- 172.21.15.40:0/772744478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff0fc0bd580 0x7ff0fc147e40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:15.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.044+0000 7ff1012ba640 1 -- 172.21.15.40:0/772744478 >> 172.21.15.40:0/772744478 conn(0x7ff0fc06f450 msgr2=0x7ff0fc14e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:15.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.044+0000 7ff1012ba640 1 -- 172.21.15.40:0/772744478 shutdown_connections 2024-09-13T15:34:15.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.044+0000 7ff1012ba640 1 -- 172.21.15.40:0/772744478 wait complete. 2024-09-13T15:34:15.064 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T15:34:15.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T15:34:15.066 INFO:tasks.ceph.osd.0:Started 2024-09-13T15:34:15.066 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T15:34:15.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T15:34:15.068 INFO:tasks.ceph.osd.1:Started 2024-09-13T15:34:15.068 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T15:34:15.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T15:34:15.070 INFO:tasks.ceph.osd.2:Started 2024-09-13T15:34:15.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:15.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.176+0000 7fbdaa002640 1 Processor -- start 2024-09-13T15:34:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.176+0000 7fbdaa002640 1 -- start start 2024-09-13T15:34:15.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.176+0000 7fbdaa002640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbda40706b0 0x7fbda40b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.176+0000 7fbdaa002640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda40b6470 con 0x7fbda4070a90 2024-09-13T15:34:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.176+0000 7fbdaa002640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda4151710 con 0x7fbda40706b0 2024-09-13T15:34:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.176+0000 7fbda37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbda40706b0 0x7fbda40b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.176+0000 7fbda37fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbda40706b0 0x7fbda40b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59052/0 (socket says 172.21.15.40:59052) 2024-09-13T15:34:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.176+0000 7fbda37fe640 1 -- 172.21.15.40:0/3728309731 learned_addr learned my addr 172.21.15.40:0/3728309731 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.176+0000 7fbda2ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbda4070a90 0x7fbda40713b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60038/0 (socket says 172.21.15.40:60038) 2024-09-13T15:34:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.176+0000 7fbda37fe640 1 -- 172.21.15.40:0/3728309731 >> v1:172.21.15.40:6789/0 conn(0x7fbda4070a90 legacy=0x7fbda40713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:15.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.176+0000 7fbda37fe640 1 -- 172.21.15.40:0/3728309731 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda4150400 con 0x7fbda40706b0 2024-09-13T15:34:15.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbda37fe640 1 --2- 172.21.15.40:0/3728309731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda40706b0 0x7fbda40b87e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbd940097f0 tx=0x7fbd9401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3549eea83cbaa9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:15.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbda27fc640 1 -- 172.21.15.40:0/3728309731 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd940a8900 con 0x7fbda40706b0 2024-09-13T15:34:15.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbda27fc640 1 -- 172.21.15.40:0/3728309731 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd940a8a60 con 0x7fbda40706b0 2024-09-13T15:34:15.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbda27fc640 1 -- 172.21.15.40:0/3728309731 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd940a8d20 con 0x7fbda40706b0 2024-09-13T15:34:15.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbdaa002640 1 -- 172.21.15.40:0/3728309731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda40706b0 msgr2=0x7fbda40b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:15.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbdaa002640 1 --2- 172.21.15.40:0/3728309731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda40706b0 0x7fbda40b87e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbd940097f0 tx=0x7fbd9401ecd0 comp rx=0 tx=0).stop 2024-09-13T15:34:15.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbdaa002640 1 -- 172.21.15.40:0/3728309731 shutdown_connections 2024-09-13T15:34:15.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbdaa002640 1 --2- 172.21.15.40:0/3728309731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda40706b0 0x7fbda40b87e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:15.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbdaa002640 1 -- 172.21.15.40:0/3728309731 >> 172.21.15.40:0/3728309731 conn(0x7fbda4065d40 msgr2=0x7fbda4066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:15.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbdaa002640 1 -- 172.21.15.40:0/3728309731 shutdown_connections 2024-09-13T15:34:15.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbdaa002640 1 -- 172.21.15.40:0/3728309731 wait complete. 2024-09-13T15:34:15.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbdaa002640 1 Processor -- start 2024-09-13T15:34:15.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbdaa002640 1 -- start start 2024-09-13T15:34:15.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbdaa002640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda40706b0 0x7fbda41414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:15.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbdaa002640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda406c4a0 con 0x7fbda40706b0 2024-09-13T15:34:15.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbda37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda40706b0 0x7fbda41414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:15.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbda37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda40706b0 0x7fbda41414b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59058/0 (socket says 172.21.15.40:59058) 2024-09-13T15:34:15.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbda37fe640 1 -- 172.21.15.40:0/3739495207 learned_addr learned my addr 172.21.15.40:0/3739495207 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:15.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbda37fe640 1 -- 172.21.15.40:0/3739495207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd940094d0 con 0x7fbda40706b0 2024-09-13T15:34:15.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.180+0000 7fbda37fe640 1 --2- 172.21.15.40:0/3739495207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda40706b0 0x7fbda41414b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbd9401c900 tx=0x7fbd9401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:15.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.184+0000 7fbd9bfff640 1 -- 172.21.15.40:0/3739495207 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd940bf070 con 0x7fbda40706b0 2024-09-13T15:34:15.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.184+0000 7fbd9bfff640 1 -- 172.21.15.40:0/3739495207 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd940b08f0 con 0x7fbda40706b0 2024-09-13T15:34:15.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.184+0000 7fbdaa002640 1 -- 172.21.15.40:0/3739495207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda4071b50 con 0x7fbda40706b0 2024-09-13T15:34:15.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.184+0000 7fbd9bfff640 1 -- 172.21.15.40:0/3739495207 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd940b0bd0 con 0x7fbda40706b0 2024-09-13T15:34:15.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.184+0000 7fbdaa002640 1 -- 172.21.15.40:0/3739495207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda406c980 con 0x7fbda40706b0 2024-09-13T15:34:15.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.184+0000 7fbd9bfff640 1 -- 172.21.15.40:0/3739495207 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fbd940b7070 con 0x7fbda40706b0 2024-09-13T15:34:15.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.184+0000 7fbd9bfff640 1 -- 172.21.15.40:0/3739495207 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fbd940bbc00 con 0x7fbda40706b0 2024-09-13T15:34:15.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.184+0000 7fbdaa002640 1 -- 172.21.15.40:0/3739495207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda406c5e0 con 0x7fbda40706b0 2024-09-13T15:34:15.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.184+0000 7fbd9bfff640 1 -- 172.21.15.40:0/3739495207 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fbd940b5070 con 0x7fbda40706b0 2024-09-13T15:34:15.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.252+0000 7fbdaa002640 1 -- 172.21.15.40:0/3739495207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbda40b87e0 con 0x7fbda40706b0 2024-09-13T15:34:15.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.252+0000 7fbd9bfff640 1 -- 172.21.15.40:0/3739495207 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v5) v1 ==== 74+0+3426 (secure 0 0 0) 0x7fbd940d2090 con 0x7fbda40706b0 2024-09-13T15:34:15.259 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:15.259 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:15.045388+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.256+0000 7fbdaa002640 1 -- 172.21.15.40:0/3739495207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda40706b0 msgr2=0x7fbda41414b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.256+0000 7fbdaa002640 1 --2- 172.21.15.40:0/3739495207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda40706b0 0x7fbda41414b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbd9401c900 tx=0x7fbd9401ba70 comp rx=0 tx=0).stop 2024-09-13T15:34:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.256+0000 7fbdaa002640 1 -- 172.21.15.40:0/3739495207 shutdown_connections 2024-09-13T15:34:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.256+0000 7fbdaa002640 1 --2- 172.21.15.40:0/3739495207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbda40706b0 0x7fbda41414b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:15.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.256+0000 7fbdaa002640 1 -- 172.21.15.40:0/3739495207 >> 172.21.15.40:0/3739495207 conn(0x7fbda4065d40 msgr2=0x7fbda40b7380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.256+0000 7fbdaa002640 1 -- 172.21.15.40:0/3739495207 shutdown_connections 2024-09-13T15:34:15.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:15.256+0000 7fbdaa002640 1 -- 172.21.15.40:0/3739495207 wait complete. 2024-09-13T15:34:15.275 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T15:34:15.276 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T15:34:15.577 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:15.662 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:15.656+0000 7f19a8500180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T15:34:15.677 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-13T15:34:15.672+0000 7f3ecb6997c0 -1 Falling back to public interface 2024-09-13T15:34:15.692 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.688+0000 7f7b8371d640 1 Processor -- start 2024-09-13T15:34:15.692 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.688+0000 7f7b8371d640 1 -- start start 2024-09-13T15:34:15.694 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.688+0000 7f7b8371d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7b7c0c0dd0 0x7f7b7c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:15.694 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.688+0000 7f7b8371d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c06c0a0 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.694 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.688+0000 7f7b8371d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7c154220 con 0x7f7b7c0c0dd0 2024-09-13T15:34:15.694 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.688+0000 7f7b80cb8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7b7c0c0dd0 0x7f7b7c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:15.694 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.688+0000 7f7b814b9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7b7c0c09f0 0x7f7b7c15dda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60044/0 (socket says 172.21.15.40:60044) 2024-09-13T15:34:15.694 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.688+0000 7f7b814b9640 1 -- 172.21.15.40:0/890228905 learned_addr learned my addr 172.21.15.40:0/890228905 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:15.694 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.688+0000 7f7b80cb8640 1 -- 172.21.15.40:0/890228905 >> v1:172.21.15.40:6789/0 conn(0x7f7b7c0c09f0 legacy=0x7f7b7c15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:15.694 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.688+0000 7f7b73fff640 1 -- 172.21.15.40:0/890228905 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2761733147 0 0) 0x7f7b7c06c0a0 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.694 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.688+0000 7f7b80cb8640 1 -- 172.21.15.40:0/890228905 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c06c2f0 con 0x7f7b7c0c0dd0 2024-09-13T15:34:15.696 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b80cb8640 1 --2- 172.21.15.40:0/890228905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b7c0c0dd0 0x7f7b7c15e4b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009740 tx=0x7f7b6c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dcd51530df957fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:15.697 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b73fff640 1 -- 172.21.15.40:0/890228905 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b6c0ab530 con 0x7f7b7c0c0dd0 2024-09-13T15:34:15.697 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b73fff640 1 -- 172.21.15.40:0/890228905 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c0a7050 con 0x7f7b7c0c0dd0 2024-09-13T15:34:15.697 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b73fff640 1 -- 172.21.15.40:0/890228905 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b6c0ab7e0 con 0x7f7b7c0c0dd0 2024-09-13T15:34:15.697 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b8371d640 1 -- 172.21.15.40:0/890228905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b7c0c0dd0 msgr2=0x7f7b7c15e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:15.697 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b8371d640 1 --2- 172.21.15.40:0/890228905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b7c0c0dd0 0x7f7b7c15e4b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c009740 tx=0x7f7b6c01c390 comp rx=0 tx=0).stop 2024-09-13T15:34:15.698 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b8371d640 1 -- 172.21.15.40:0/890228905 shutdown_connections 2024-09-13T15:34:15.698 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b8371d640 1 --2- 172.21.15.40:0/890228905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b7c0c0dd0 0x7f7b7c15e4b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:15.698 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b8371d640 1 -- 172.21.15.40:0/890228905 >> 172.21.15.40:0/890228905 conn(0x7f7b7c065df0 msgr2=0x7f7b7c066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:15.698 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b8371d640 1 -- 172.21.15.40:0/890228905 shutdown_connections 2024-09-13T15:34:15.698 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b8371d640 1 -- 172.21.15.40:0/890228905 wait complete. 2024-09-13T15:34:15.698 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b8371d640 1 Processor -- start 2024-09-13T15:34:15.698 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b8371d640 1 -- start start 2024-09-13T15:34:15.699 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b8371d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b7c0c09f0 0x7f7b7c06d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:15.699 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b8371d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c14e420 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.699 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b814b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b7c0c09f0 0x7f7b7c06d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:15.699 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b814b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b7c0c09f0 0x7f7b7c06d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59080/0 (socket says 172.21.15.40:59080) 2024-09-13T15:34:15.700 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.692+0000 7f7b814b9640 1 -- 172.21.15.40:0/549276482 learned_addr learned my addr 172.21.15.40:0/549276482 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:15.700 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.696+0000 7f7b814b9640 1 -- 172.21.15.40:0/549276482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c009420 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.701 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.696+0000 7f7b814b9640 1 --2- 172.21.15.40:0/549276482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b7c0c09f0 0x7f7b7c06d240 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800c420 tx=0x7f7b7800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:15.701 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.696+0000 7f7b71ffb640 1 -- 172.21.15.40:0/549276482 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b780074d0 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.701 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.696+0000 7f7b71ffb640 1 -- 172.21.15.40:0/549276482 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b78007630 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.701 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.696+0000 7f7b8371d640 1 -- 172.21.15.40:0/549276482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c14cda0 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.701 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.696+0000 7f7b71ffb640 1 -- 172.21.15.40:0/549276482 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b78004960 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.701 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.696+0000 7f7b8371d640 1 -- 172.21.15.40:0/549276482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c14e8c0 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.701 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.696+0000 7f7b71ffb640 1 -- 172.21.15.40:0/549276482 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7b7801d440 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.701 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.696+0000 7f7b71ffb640 1 -- 172.21.15.40:0/549276482 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f7b7801c840 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.701 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.696+0000 7f7b8371d640 1 -- 172.21.15.40:0/549276482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7c071240 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.703 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.696+0000 7f7b71ffb640 1 -- 172.21.15.40:0/549276482 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7b78018070 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.704 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-13T15:34:15.700+0000 7f9da58057c0 -1 Falling back to public interface 2024-09-13T15:34:15.712 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-13T15:34:15.708+0000 7feb0c09f7c0 -1 Falling back to public interface 2024-09-13T15:34:15.721 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:15.716+0000 7f19a8500180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T15:34:15.764 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.760+0000 7f7b8371d640 1 -- 172.21.15.40:0/549276482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b7c06c960 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.765 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.760+0000 7f7b71ffb640 1 -- 172.21.15.40:0/549276482 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v5) v1 ==== 74+0+3426 (secure 0 0 0) 0x7f7b7801c460 con 0x7f7b7c0c09f0 2024-09-13T15:34:15.765 INFO:teuthology.misc.health.smithi040.stdout: 2024-09-13T15:34:15.765 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":5,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:15.045388+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:15.766 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.760+0000 7f7b8371d640 1 -- 172.21.15.40:0/549276482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b7c0c09f0 msgr2=0x7f7b7c06d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:15.766 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.760+0000 7f7b8371d640 1 --2- 172.21.15.40:0/549276482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b7c0c09f0 0x7f7b7c06d240 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800c420 tx=0x7f7b7800c8e0 comp rx=0 tx=0).stop 2024-09-13T15:34:15.766 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.760+0000 7f7b8371d640 1 -- 172.21.15.40:0/549276482 shutdown_connections 2024-09-13T15:34:15.766 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.760+0000 7f7b8371d640 1 --2- 172.21.15.40:0/549276482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b7c0c09f0 0x7f7b7c06d240 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:15.766 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.760+0000 7f7b8371d640 1 -- 172.21.15.40:0/549276482 >> 172.21.15.40:0/549276482 conn(0x7f7b7c065df0 msgr2=0x7f7b7c14f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:15.766 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.760+0000 7f7b8371d640 1 -- 172.21.15.40:0/549276482 shutdown_connections 2024-09-13T15:34:15.767 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:15.760+0000 7f7b8371d640 1 -- 172.21.15.40:0/549276482 wait complete. 2024-09-13T15:34:15.777 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:15.772+0000 7f19a8500180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T15:34:15.780 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-13T15:34:15.858 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:15.852+0000 7f19a8500180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T15:34:15.913 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:15.908+0000 7f19a8500180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T15:34:15.993 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:15.988+0000 7f19a8500180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T15:34:16.047 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:16.040+0000 7f19a8500180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T15:34:16.205 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:16.200+0000 7f19a8500180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T15:34:16.267 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:16.260+0000 7f19a8500180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T15:34:16.962 INFO:tasks.ceph.mgr.x.smithi040.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T15:34:16.963 INFO:tasks.ceph.mgr.x.smithi040.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T15:34:16.963 INFO:tasks.ceph.mgr.x.smithi040.stderr: from numpy import show_config as show_numpy_config 2024-09-13T15:34:17.039 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:17.032+0000 7f19a8500180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T15:34:17.228 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:17.220+0000 7f19a8500180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:34:17.395 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:17.388+0000 7f19a8500180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T15:34:17.466 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:17.460+0000 7f19a8500180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T15:34:17.615 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:17.608+0000 7f19a8500180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:34:18.287 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:18.280+0000 7f19a8500180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T15:34:18.371 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:18.364+0000 7f19a8500180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T15:34:18.564 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:18.556+0000 7f19a8500180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T15:34:18.640 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:18.636+0000 7f19a8500180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T15:34:18.963 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:18.956+0000 7f19a8500180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T15:34:19.028 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:19.020+0000 7f19a8500180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T15:34:19.116 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-13T15:34:19.112+0000 7feb0c09f7c0 -1 osd.2 0 log_to_monitors true 2024-09-13T15:34:19.528 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-13T15:34:19.524+0000 7f3ecb6997c0 -1 osd.1 0 log_to_monitors true 2024-09-13T15:34:19.614 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-13T15:34:19.608+0000 7f9da58057c0 -1 osd.0 0 log_to_monitors true 2024-09-13T15:34:20.064 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:34:20.060+0000 7f194f9b2640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-13T15:34:22.083 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:22.243 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.236+0000 7f7f24562640 1 Processor -- start 2024-09-13T15:34:22.244 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.236+0000 7f7f24562640 1 -- start start 2024-09-13T15:34:22.245 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.240+0000 7f7f24562640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f1c070f00 0x7f7f1c152e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:22.245 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.240+0000 7f7f24562640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1c158160 con 0x7f7f1c157970 2024-09-13T15:34:22.245 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.240+0000 7f7f24562640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1c153900 con 0x7f7f1c070f00 2024-09-13T15:34:22.245 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.240+0000 7f7f222fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f1c070f00 0x7f7f1c152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:22.245 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.240+0000 7f7f21afd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7f1c157970 0x7f7f1c0c0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60060/0 (socket says 172.21.15.40:60060) 2024-09-13T15:34:22.245 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.240+0000 7f7f21afd640 1 -- 172.21.15.40:0/1171069065 learned_addr learned my addr 172.21.15.40:0/1171069065 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:22.245 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.240+0000 7f7f222fe640 1 --2- 172.21.15.40:0/1171069065 >> v2:172.21.15.40:3300/0 conn(0x7f7f1c070f00 0x7f7f1c152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59170/0 (socket says 172.21.15.40:59170) 2024-09-13T15:34:22.246 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.240+0000 7f7f222fe640 1 -- 172.21.15.40:0/1171069065 >> v1:172.21.15.40:6789/0 conn(0x7f7f1c157970 legacy=0x7f7f1c0c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:22.246 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.240+0000 7f7f222fe640 1 -- 172.21.15.40:0/1171069065 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c0a3900 con 0x7f7f1c070f00 2024-09-13T15:34:22.249 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.244+0000 7f7f222fe640 1 --2- 172.21.15.40:0/1171069065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f1c070f00 0x7f7f1c152e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009740 tx=0x7f7f1801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e827e56b05f1d233 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:22.249 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.244+0000 7f7f212fc640 1 -- 172.21.15.40:0/1171069065 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f180ab530 con 0x7f7f1c070f00 2024-09-13T15:34:22.250 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.244+0000 7f7f212fc640 1 -- 172.21.15.40:0/1171069065 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f180a7050 con 0x7f7f1c070f00 2024-09-13T15:34:22.250 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.244+0000 7f7f212fc640 1 -- 172.21.15.40:0/1171069065 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f180ab7e0 con 0x7f7f1c070f00 2024-09-13T15:34:22.251 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.244+0000 7f7f24562640 1 -- 172.21.15.40:0/1171069065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f1c070f00 msgr2=0x7f7f1c152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:22.251 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.244+0000 7f7f24562640 1 --2- 172.21.15.40:0/1171069065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f1c070f00 0x7f7f1c152e10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009740 tx=0x7f7f1801c420 comp rx=0 tx=0).stop 2024-09-13T15:34:22.251 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.244+0000 7f7f24562640 1 -- 172.21.15.40:0/1171069065 shutdown_connections 2024-09-13T15:34:22.251 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.244+0000 7f7f24562640 1 --2- 172.21.15.40:0/1171069065 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f1c070f00 0x7f7f1c152e10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:22.251 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.244+0000 7f7f24562640 1 -- 172.21.15.40:0/1171069065 >> 172.21.15.40:0/1171069065 conn(0x7f7f1c06e730 msgr2=0x7f7f1c06eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:22.251 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.244+0000 7f7f24562640 1 -- 172.21.15.40:0/1171069065 shutdown_connections 2024-09-13T15:34:22.251 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.244+0000 7f7f24562640 1 -- 172.21.15.40:0/1171069065 wait complete. 2024-09-13T15:34:22.253 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.248+0000 7f7f24562640 1 Processor -- start 2024-09-13T15:34:22.253 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.248+0000 7f7f24562640 1 -- start start 2024-09-13T15:34:22.254 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.248+0000 7f7f24562640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f1c070f00 0x7f7f1c1f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:22.254 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.248+0000 7f7f24562640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c14d480 con 0x7f7f1c070f00 2024-09-13T15:34:22.255 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.248+0000 7f7f222fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f1c070f00 0x7f7f1c1f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:22.255 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.248+0000 7f7f222fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f1c070f00 0x7f7f1c1f97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:59178/0 (socket says 172.21.15.40:59178) 2024-09-13T15:34:22.255 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.248+0000 7f7f222fe640 1 -- 172.21.15.40:0/894117682 learned_addr learned my addr 172.21.15.40:0/894117682 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:22.255 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.248+0000 7f7f222fe640 1 -- 172.21.15.40:0/894117682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18009420 con 0x7f7f1c070f00 2024-09-13T15:34:22.256 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.252+0000 7f7f222fe640 1 --2- 172.21.15.40:0/894117682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f1c070f00 0x7f7f1c1f97c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f1801a050 tx=0x7f7f1801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:22.256 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.252+0000 7f7f12ffd640 1 -- 172.21.15.40:0/894117682 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f180b8070 con 0x7f7f1c070f00 2024-09-13T15:34:22.256 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.252+0000 7f7f12ffd640 1 -- 172.21.15.40:0/894117682 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f180b4460 con 0x7f7f1c070f00 2024-09-13T15:34:22.257 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.252+0000 7f7f12ffd640 1 -- 172.21.15.40:0/894117682 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f180b4740 con 0x7f7f1c070f00 2024-09-13T15:34:22.257 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.252+0000 7f7f24562640 1 -- 172.21.15.40:0/894117682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c14cfc0 con 0x7f7f1c070f00 2024-09-13T15:34:22.257 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.252+0000 7f7f24562640 1 -- 172.21.15.40:0/894117682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c158750 con 0x7f7f1c070f00 2024-09-13T15:34:22.257 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.252+0000 7f7f12ffd640 1 -- 172.21.15.40:0/894117682 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 43251+0+0 (secure 0 0 0) 0x7f7f180b2070 con 0x7f7f1c070f00 2024-09-13T15:34:22.257 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.252+0000 7f7f24562640 1 -- 172.21.15.40:0/894117682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f04005260 con 0x7f7f1c070f00 2024-09-13T15:34:22.259 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.252+0000 7f7f12ffd640 1 --2- 172.21.15.40:0/894117682 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7f000353c0 0x7f7f00037880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:22.259 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.252+0000 7f7f12ffd640 1 -- 172.21.15.40:0/894117682 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1361+0+0 (secure 0 0 0) 0x7f7f180e0650 con 0x7f7f1c070f00 2024-09-13T15:34:22.259 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.252+0000 7f7f21afd640 1 --2- 172.21.15.40:0/894117682 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7f000353c0 0x7f7f00037880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:22.259 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.252+0000 7f7f21afd640 1 --2- 172.21.15.40:0/894117682 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7f000353c0 0x7f7f00037880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c001610 tx=0x7f7f0c007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:22.267 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.260+0000 7f7f12ffd640 1 -- 172.21.15.40:0/894117682 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7f180b0020 con 0x7f7f1c070f00 2024-09-13T15:34:22.583 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.576+0000 7f7f24562640 1 -- 172.21.15.40:0/894117682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f04005510 con 0x7f7f1c070f00 2024-09-13T15:34:22.584 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.580+0000 7f7f12ffd640 1 -- 172.21.15.40:0/894117682 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) v1 ==== 74+0+3426 (secure 0 0 0) 0x7f7f180bbb10 con 0x7f7f1c070f00 2024-09-13T15:34:22.584 INFO:teuthology.misc.health.smithi040.stdout: 2024-09-13T15:34:22.584 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":7,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:21.107435+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:22.587 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.580+0000 7f7f24562640 1 -- 172.21.15.40:0/894117682 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7f000353c0 msgr2=0x7f7f00037880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:22.588 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.580+0000 7f7f24562640 1 --2- 172.21.15.40:0/894117682 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7f000353c0 0x7f7f00037880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c001610 tx=0x7f7f0c007ad0 comp rx=0 tx=0).stop 2024-09-13T15:34:22.588 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.580+0000 7f7f24562640 1 -- 172.21.15.40:0/894117682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f1c070f00 msgr2=0x7f7f1c1f97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:22.588 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.580+0000 7f7f24562640 1 --2- 172.21.15.40:0/894117682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f1c070f00 0x7f7f1c1f97c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7f1801a050 tx=0x7f7f1801ac60 comp rx=0 tx=0).stop 2024-09-13T15:34:22.588 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.580+0000 7f7f24562640 1 -- 172.21.15.40:0/894117682 shutdown_connections 2024-09-13T15:34:22.588 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.584+0000 7f7f24562640 1 --2- 172.21.15.40:0/894117682 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7f000353c0 0x7f7f00037880 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:22.588 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.584+0000 7f7f24562640 1 --2- 172.21.15.40:0/894117682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f1c070f00 0x7f7f1c1f97c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:22.588 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.584+0000 7f7f24562640 1 -- 172.21.15.40:0/894117682 >> 172.21.15.40:0/894117682 conn(0x7f7f1c06e730 msgr2=0x7f7f1c06eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:22.588 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.584+0000 7f7f24562640 1 -- 172.21.15.40:0/894117682 shutdown_connections 2024-09-13T15:34:22.588 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:22.584+0000 7f7f24562640 1 -- 172.21.15.40:0/894117682 wait complete. 2024-09-13T15:34:22.612 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-09-13T15:34:22.826 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-13T15:34:22.820+0000 7feb07821640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T15:34:22.853 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-09-13T15:34:22.848+0000 7feaffe66640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:34:22.863 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-13T15:34:22.856+0000 7f3ec6e1b640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T15:34:22.866 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-13T15:34:22.860+0000 7f9da0f87640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T15:34:22.893 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-09-13T15:34:22.888+0000 7f3ebf460640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:34:22.893 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-09-13T15:34:22.888+0000 7f9d995cc640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:34:27.308 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:34:28.914 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:29.040 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.036+0000 7f94b102f640 1 Processor -- start 2024-09-13T15:34:29.040 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.036+0000 7f94b102f640 1 -- start start 2024-09-13T15:34:29.041 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.036+0000 7f94b102f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94ac08afa0 0x7f94ac08b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:29.041 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.036+0000 7f94b102f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ac0c0ba0 con 0x7f94ac0a56a0 2024-09-13T15:34:29.041 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.036+0000 7f94b102f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ac0c46e0 con 0x7f94ac08afa0 2024-09-13T15:34:29.041 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.036+0000 7f94aad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94ac08afa0 0x7f94ac08b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:29.041 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.036+0000 7f94aad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94ac08afa0 0x7f94ac08b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58116/0 (socket says 172.21.15.40:58116) 2024-09-13T15:34:29.041 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.036+0000 7f94aad9d640 1 -- 172.21.15.40:0/1409550266 learned_addr learned my addr 172.21.15.40:0/1409550266 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:29.042 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.036+0000 7f94aad9d640 1 -- 172.21.15.40:0/1409550266 >> v1:172.21.15.40:6789/0 conn(0x7f94ac0a56a0 legacy=0x7f94ac0c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:29.042 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.036+0000 7f94aad9d640 1 -- 172.21.15.40:0/1409550266 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac153d10 con 0x7f94ac08afa0 2024-09-13T15:34:29.042 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.036+0000 7f94a9d9b640 1 -- 172.21.15.40:0/1409550266 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497897107 0 0) 0x7f94ac0c0ba0 con 0x7f94ac0a56a0 2024-09-13T15:34:29.044 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94aad9d640 1 --2- 172.21.15.40:0/1409550266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ac08afa0 0x7f94ac08b380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f949c0097f0 tx=0x7f949c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192b426ee9805c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:29.044 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94a9d9b640 1 -- 172.21.15.40:0/1409550266 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f949c0ab530 con 0x7f94ac08afa0 2024-09-13T15:34:29.044 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94a9d9b640 1 -- 172.21.15.40:0/1409550266 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c0a7050 con 0x7f94ac08afa0 2024-09-13T15:34:29.044 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94a9d9b640 1 -- 172.21.15.40:0/1409550266 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f949c0ab7e0 con 0x7f94ac08afa0 2024-09-13T15:34:29.045 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 -- 172.21.15.40:0/1409550266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ac08afa0 msgr2=0x7f94ac08b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:29.045 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 --2- 172.21.15.40:0/1409550266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ac08afa0 0x7f94ac08b380 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f949c0097f0 tx=0x7f949c01c450 comp rx=0 tx=0).stop 2024-09-13T15:34:29.045 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 -- 172.21.15.40:0/1409550266 shutdown_connections 2024-09-13T15:34:29.045 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 --2- 172.21.15.40:0/1409550266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ac08afa0 0x7f94ac08b380 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:29.045 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 -- 172.21.15.40:0/1409550266 >> 172.21.15.40:0/1409550266 conn(0x7f94ac065df0 msgr2=0x7f94ac066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:29.045 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 -- 172.21.15.40:0/1409550266 shutdown_connections 2024-09-13T15:34:29.045 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 -- 172.21.15.40:0/1409550266 wait complete. 2024-09-13T15:34:29.046 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 Processor -- start 2024-09-13T15:34:29.046 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 -- start start 2024-09-13T15:34:29.046 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ac08afa0 0x7f94ac0b8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:29.046 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ac1531b0 con 0x7f94ac08afa0 2024-09-13T15:34:29.047 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94aad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ac08afa0 0x7f94ac0b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:29.047 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94aad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ac08afa0 0x7f94ac0b8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58132/0 (socket says 172.21.15.40:58132) 2024-09-13T15:34:29.047 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94aad9d640 1 -- 172.21.15.40:0/3439812543 learned_addr learned my addr 172.21.15.40:0/3439812543 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:29.048 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94aad9d640 1 -- 172.21.15.40:0/3439812543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949c0094d0 con 0x7f94ac08afa0 2024-09-13T15:34:29.048 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94aad9d640 1 --2- 172.21.15.40:0/3439812543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ac08afa0 0x7f94ac0b8930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f949c01a080 tx=0x7f949c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:29.048 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94937fe640 1 -- 172.21.15.40:0/3439812543 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f949c0b6420 con 0x7f94ac08afa0 2024-09-13T15:34:29.048 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94937fe640 1 -- 172.21.15.40:0/3439812543 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c0b6580 con 0x7f94ac08afa0 2024-09-13T15:34:29.048 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 -- 172.21.15.40:0/3439812543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ac0bb670 con 0x7f94ac08afa0 2024-09-13T15:34:29.048 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94937fe640 1 -- 172.21.15.40:0/3439812543 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f949c0b6840 con 0x7f94ac08afa0 2024-09-13T15:34:29.048 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.040+0000 7f94b102f640 1 -- 172.21.15.40:0/3439812543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ac14a5e0 con 0x7f94ac08afa0 2024-09-13T15:34:29.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.044+0000 7f94b102f640 1 -- 172.21.15.40:0/3439812543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ac08b380 con 0x7f94ac08afa0 2024-09-13T15:34:29.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.044+0000 7f94937fe640 1 -- 172.21.15.40:0/3439812543 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 43251+0+0 (secure 0 0 0) 0x7f949c0b2040 con 0x7f94ac08afa0 2024-09-13T15:34:29.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.044+0000 7f94937fe640 1 --2- 172.21.15.40:0/3439812543 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f94980353c0 0x7f9498037880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:29.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.044+0000 7f94937fe640 1 -- 172.21.15.40:0/3439812543 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2587+0+0 (secure 0 0 0) 0x7f949c0e1720 con 0x7f94ac08afa0 2024-09-13T15:34:29.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.044+0000 7f94aa59c640 1 --2- 172.21.15.40:0/3439812543 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f94980353c0 0x7f9498037880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:29.049 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.044+0000 7f94aa59c640 1 --2- 172.21.15.40:0/3439812543 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f94980353c0 0x7f9498037880 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f94a0000fe0 tx=0x7f94a0007890 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:29.053 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.048+0000 7f94937fe640 1 -- 172.21.15.40:0/3439812543 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f949c0b69a0 con 0x7f94ac08afa0 2024-09-13T15:34:29.215 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.208+0000 7f94b102f640 1 -- 172.21.15.40:0/3439812543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94ac0c1f20 con 0x7f94ac08afa0 2024-09-13T15:34:29.217 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.212+0000 7f94937fe640 1 -- 172.21.15.40:0/3439812543 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+6733 (secure 0 0 0) 0x7f949c0b0030 con 0x7f94ac08afa0 2024-09-13T15:34:29.217 INFO:teuthology.misc.health.smithi040.stdout: 2024-09-13T15:34:29.217 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":12,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:27.876030+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:29.219 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.212+0000 7f94b102f640 1 -- 172.21.15.40:0/3439812543 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f94980353c0 msgr2=0x7f9498037880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:29.219 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.212+0000 7f94b102f640 1 --2- 172.21.15.40:0/3439812543 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f94980353c0 0x7f9498037880 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f94a0000fe0 tx=0x7f94a0007890 comp rx=0 tx=0).stop 2024-09-13T15:34:29.219 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.212+0000 7f94b102f640 1 -- 172.21.15.40:0/3439812543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ac08afa0 msgr2=0x7f94ac0b8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:29.220 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.212+0000 7f94b102f640 1 --2- 172.21.15.40:0/3439812543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ac08afa0 0x7f94ac0b8930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f949c01a080 tx=0x7f949c01ac90 comp rx=0 tx=0).stop 2024-09-13T15:34:29.220 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.212+0000 7f94b102f640 1 -- 172.21.15.40:0/3439812543 shutdown_connections 2024-09-13T15:34:29.220 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.212+0000 7f94b102f640 1 --2- 172.21.15.40:0/3439812543 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f94980353c0 0x7f9498037880 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:29.220 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.212+0000 7f94b102f640 1 --2- 172.21.15.40:0/3439812543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94ac08afa0 0x7f94ac0b8930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:29.220 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.212+0000 7f94b102f640 1 -- 172.21.15.40:0/3439812543 >> 172.21.15.40:0/3439812543 conn(0x7f94ac065df0 msgr2=0x7f94ac0c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:29.220 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.212+0000 7f94b102f640 1 -- 172.21.15.40:0/3439812543 shutdown_connections 2024-09-13T15:34:29.220 INFO:teuthology.misc.health.smithi040.stderr:2024-09-13T15:34:29.212+0000 7f94b102f640 1 -- 172.21.15.40:0/3439812543 wait complete. 2024-09-13T15:34:29.235 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-09-13T15:34:29.235 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T15:34:29.236 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T15:34:29.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T15:34:29.238 INFO:tasks.ceph.mds.a:Started 2024-09-13T15:34:29.238 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T15:34:29.238 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T15:34:29.240 INFO:tasks.ceph.mds.b:Started 2024-09-13T15:34:29.240 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T15:34:29.240 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T15:34:29.242 INFO:tasks.ceph.mds.c:Started 2024-09-13T15:34:29.242 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T15:34:29.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T15:34:29.244 INFO:tasks.ceph.mds.d:Started 2024-09-13T15:34:29.244 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-13T15:34:29.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-13T15:34:29.246 INFO:tasks.ceph.mds.e:Started 2024-09-13T15:34:29.246 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T15:34:29.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:29.324 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2024-09-13T15:34:29.329 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2024-09-13T15:34:29.330 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2024-09-13T15:34:29.330 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2024-09-13T15:34:29.345 INFO:tasks.ceph.mds.e.smithi040.stdout:starting mds.e at 2024-09-13T15:34:29.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.364+0000 7fd8527c9640 1 Processor -- start 2024-09-13T15:34:29.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.364+0000 7fd8527c9640 1 -- start start 2024-09-13T15:34:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd8527c9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd84c151380 0x7fd84c06a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd8527c9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c0b6d60 con 0x7fd84c069f20 2024-09-13T15:34:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd8527c9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84c0b7b60 con 0x7fd84c151380 2024-09-13T15:34:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd84b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd84c151380 0x7fd84c06a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd84bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd84c069f20 0x7fd84c0b62b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58902/0 (socket says 172.21.15.40:58902) 2024-09-13T15:34:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd84b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd84c151380 0x7fd84c06a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58240/0 (socket says 172.21.15.40:58240) 2024-09-13T15:34:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd84bfff640 1 -- 172.21.15.40:0/2398423037 learned_addr learned my addr 172.21.15.40:0/2398423037 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd84b7fe640 1 -- 172.21.15.40:0/2398423037 >> v1:172.21.15.40:6789/0 conn(0x7fd84c069f20 legacy=0x7fd84c0b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:29.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd84b7fe640 1 -- 172.21.15.40:0/2398423037 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c0bda80 con 0x7fd84c151380 2024-09-13T15:34:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd84b7fe640 1 --2- 172.21.15.40:0/2398423037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84c151380 0x7fd84c06a300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd840009740 tx=0x7fd84001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275ef03bf660d107 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd84affd640 1 -- 172.21.15.40:0/2398423037 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8400ab530 con 0x7fd84c151380 2024-09-13T15:34:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd84affd640 1 -- 172.21.15.40:0/2398423037 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8400a7050 con 0x7fd84c151380 2024-09-13T15:34:29.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd84affd640 1 -- 172.21.15.40:0/2398423037 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8400ab7e0 con 0x7fd84c151380 2024-09-13T15:34:29.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd8527c9640 1 -- 172.21.15.40:0/2398423037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84c151380 msgr2=0x7fd84c06a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:29.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd8527c9640 1 --2- 172.21.15.40:0/2398423037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84c151380 0x7fd84c06a300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd840009740 tx=0x7fd84001c390 comp rx=0 tx=0).stop 2024-09-13T15:34:29.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd8527c9640 1 -- 172.21.15.40:0/2398423037 shutdown_connections 2024-09-13T15:34:29.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd8527c9640 1 --2- 172.21.15.40:0/2398423037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84c151380 0x7fd84c06a300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:29.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd8527c9640 1 -- 172.21.15.40:0/2398423037 >> 172.21.15.40:0/2398423037 conn(0x7fd84c06b200 msgr2=0x7fd84c06b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:29.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd8527c9640 1 -- 172.21.15.40:0/2398423037 shutdown_connections 2024-09-13T15:34:29.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.368+0000 7fd8527c9640 1 -- 172.21.15.40:0/2398423037 wait complete. 2024-09-13T15:34:29.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd8527c9640 1 Processor -- start 2024-09-13T15:34:29.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd8527c9640 1 -- start start 2024-09-13T15:34:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd8527c9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84c069f20 0x7fd84c14b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd8527c9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c146e60 con 0x7fd84c069f20 2024-09-13T15:34:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd84bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84c069f20 0x7fd84c14b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd84bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84c069f20 0x7fd84c14b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58252/0 (socket says 172.21.15.40:58252) 2024-09-13T15:34:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd84bfff640 1 -- 172.21.15.40:0/1570050772 learned_addr learned my addr 172.21.15.40:0/1570050772 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd84bfff640 1 -- 172.21.15.40:0/1570050772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840009420 con 0x7fd84c069f20 2024-09-13T15:34:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd84bfff640 1 --2- 172.21.15.40:0/1570050772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84c069f20 0x7fd84c14b8b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00c480 tx=0x7fd83c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd848ff9640 1 -- 172.21.15.40:0/1570050772 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd83c005c20 con 0x7fd84c069f20 2024-09-13T15:34:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd848ff9640 1 -- 172.21.15.40:0/1570050772 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c005d80 con 0x7fd84c069f20 2024-09-13T15:34:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd8527c9640 1 -- 172.21.15.40:0/1570050772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84c0b9610 con 0x7fd84c069f20 2024-09-13T15:34:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd848ff9640 1 -- 172.21.15.40:0/1570050772 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd83c0071a0 con 0x7fd84c069f20 2024-09-13T15:34:29.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd8527c9640 1 -- 172.21.15.40:0/1570050772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c13e530 con 0x7fd84c069f20 2024-09-13T15:34:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd848ff9640 1 -- 172.21.15.40:0/1570050772 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 43251+0+0 (secure 0 0 0) 0x7fd83c007300 con 0x7fd84c069f20 2024-09-13T15:34:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd848ff9640 1 --2- 172.21.15.40:0/1570050772 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd838035410 0x7fd8380378d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd8527c9640 1 -- 172.21.15.40:0/1570050772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84c0b9460 con 0x7fd84c069f20 2024-09-13T15:34:29.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd848ff9640 1 -- 172.21.15.40:0/1570050772 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2587+0+0 (secure 0 0 0) 0x7fd83c046760 con 0x7fd84c069f20 2024-09-13T15:34:29.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd84b7fe640 1 --2- 172.21.15.40:0/1570050772 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd838035410 0x7fd8380378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:29.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.372+0000 7fd84b7fe640 1 --2- 172.21.15.40:0/1570050772 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd838035410 0x7fd8380378d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd8400ad000 tx=0x7fd8400a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:29.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.380+0000 7fd848ff9640 1 -- 172.21.15.40:0/1570050772 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd83c0075b0 con 0x7fd84c069f20 2024-09-13T15:34:29.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.540+0000 7fd8527c9640 1 -- 172.21.15.40:0/1570050772 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd84c06a300 con 0x7fd84c069f20 2024-09-13T15:34:29.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.540+0000 7fd848ff9640 1 -- 172.21.15.40:0/1570050772 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+6733 (secure 0 0 0) 0x7fd83c017030 con 0x7fd84c069f20 2024-09-13T15:34:29.545 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:29.545 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":12,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:27.876030+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:29.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.540+0000 7fd8527c9640 1 -- 172.21.15.40:0/1570050772 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd838035410 msgr2=0x7fd8380378d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:29.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.540+0000 7fd8527c9640 1 --2- 172.21.15.40:0/1570050772 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd838035410 0x7fd8380378d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd8400ad000 tx=0x7fd8400a6000 comp rx=0 tx=0).stop 2024-09-13T15:34:29.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.540+0000 7fd8527c9640 1 -- 172.21.15.40:0/1570050772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84c069f20 msgr2=0x7fd84c14b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:29.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.540+0000 7fd8527c9640 1 --2- 172.21.15.40:0/1570050772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84c069f20 0x7fd84c14b8b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00c480 tx=0x7fd83c00c940 comp rx=0 tx=0).stop 2024-09-13T15:34:29.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.544+0000 7fd8527c9640 1 -- 172.21.15.40:0/1570050772 shutdown_connections 2024-09-13T15:34:29.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.544+0000 7fd8527c9640 1 --2- 172.21.15.40:0/1570050772 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd838035410 0x7fd8380378d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:29.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.544+0000 7fd8527c9640 1 --2- 172.21.15.40:0/1570050772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84c069f20 0x7fd84c14b8b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:29.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.544+0000 7fd8527c9640 1 -- 172.21.15.40:0/1570050772 >> 172.21.15.40:0/1570050772 conn(0x7fd84c06b200 msgr2=0x7fd84c06b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:29.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.544+0000 7fd8527c9640 1 -- 172.21.15.40:0/1570050772 shutdown_connections 2024-09-13T15:34:29.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.544+0000 7fd8527c9640 1 -- 172.21.15.40:0/1570050772 wait complete. 2024-09-13T15:34:29.564 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:34:25.125767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:34:29.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:34:29.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd58e9c0640 1 Processor -- start 2024-09-13T15:34:29.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd58e9c0640 1 -- start start 2024-09-13T15:34:29.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd58e9c0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd5880be340 0x7fd58815a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:29.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd58e9c0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5880c1130 con 0x7fd5880b4600 2024-09-13T15:34:29.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd58e9c0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58814e780 con 0x7fd5880be340 2024-09-13T15:34:29.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd5877fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd5880be340 0x7fd58815a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:29.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd587fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd5880b4600 0x7fd58814dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58904/0 (socket says 172.21.15.40:58904) 2024-09-13T15:34:29.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd587fff640 1 -- 172.21.15.40:0/387823073 learned_addr learned my addr 172.21.15.40:0/387823073 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:29.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd5877fe640 1 -- 172.21.15.40:0/387823073 >> v1:172.21.15.40:6789/0 conn(0x7fd5880b4600 legacy=0x7fd58814dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:29.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd5877fe640 1 -- 172.21.15.40:0/387823073 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58814e450 con 0x7fd5880be340 2024-09-13T15:34:29.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd5877fe640 1 --2- 172.21.15.40:0/387823073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5880be340 0x7fd58815a750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009740 tx=0x7fd57c01c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc4de158c8eed9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:29.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd586ffd640 1 -- 172.21.15.40:0/387823073 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd57c0ab530 con 0x7fd5880be340 2024-09-13T15:34:29.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd586ffd640 1 -- 172.21.15.40:0/387823073 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57c0a7050 con 0x7fd5880be340 2024-09-13T15:34:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd586ffd640 1 -- 172.21.15.40:0/387823073 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd57c0ab7e0 con 0x7fd5880be340 2024-09-13T15:34:29.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd58e9c0640 1 -- 172.21.15.40:0/387823073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5880be340 msgr2=0x7fd58815a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd58e9c0640 1 --2- 172.21.15.40:0/387823073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5880be340 0x7fd58815a750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd57c009740 tx=0x7fd57c01c0d0 comp rx=0 tx=0).stop 2024-09-13T15:34:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd58e9c0640 1 -- 172.21.15.40:0/387823073 shutdown_connections 2024-09-13T15:34:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd58e9c0640 1 --2- 172.21.15.40:0/387823073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5880be340 0x7fd58815a750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd58e9c0640 1 -- 172.21.15.40:0/387823073 >> 172.21.15.40:0/387823073 conn(0x7fd58806a540 msgr2=0x7fd5880a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd58e9c0640 1 -- 172.21.15.40:0/387823073 shutdown_connections 2024-09-13T15:34:29.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.692+0000 7fd58e9c0640 1 -- 172.21.15.40:0/387823073 wait complete. 2024-09-13T15:34:29.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd58e9c0640 1 Processor -- start 2024-09-13T15:34:29.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd58e9c0640 1 -- start start 2024-09-13T15:34:29.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd58e9c0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5880b4600 0x7fd588147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:29.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd58e9c0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58815ed30 con 0x7fd5880b4600 2024-09-13T15:34:29.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd587fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5880b4600 0x7fd588147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:29.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd587fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5880b4600 0x7fd588147ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58264/0 (socket says 172.21.15.40:58264) 2024-09-13T15:34:29.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd587fff640 1 -- 172.21.15.40:0/1111585320 learned_addr learned my addr 172.21.15.40:0/1111585320 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:29.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd587fff640 1 -- 172.21.15.40:0/1111585320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd57c009420 con 0x7fd5880b4600 2024-09-13T15:34:29.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd587fff640 1 --2- 172.21.15.40:0/1111585320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5880b4600 0x7fd588147ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c480 tx=0x7fd57800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:29.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd584ff9640 1 -- 172.21.15.40:0/1111585320 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd578005c20 con 0x7fd5880b4600 2024-09-13T15:34:29.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd584ff9640 1 -- 172.21.15.40:0/1111585320 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd578005d80 con 0x7fd5880b4600 2024-09-13T15:34:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd58e9c0640 1 -- 172.21.15.40:0/1111585320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5881484a0 con 0x7fd5880b4600 2024-09-13T15:34:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd584ff9640 1 -- 172.21.15.40:0/1111585320 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd5780071a0 con 0x7fd5880b4600 2024-09-13T15:34:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.696+0000 7fd58e9c0640 1 -- 172.21.15.40:0/1111585320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5880bff40 con 0x7fd5880b4600 2024-09-13T15:34:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.700+0000 7fd584ff9640 1 -- 172.21.15.40:0/1111585320 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) v1 ==== 43251+0+0 (secure 0 0 0) 0x7fd578007300 con 0x7fd5880b4600 2024-09-13T15:34:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.700+0000 7fd58e9c0640 1 -- 172.21.15.40:0/1111585320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58815a750 con 0x7fd5880b4600 2024-09-13T15:34:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.700+0000 7fd584ff9640 1 --2- 172.21.15.40:0/1111585320 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd574035370 0x7fd574037830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.700+0000 7fd584ff9640 1 -- 172.21.15.40:0/1111585320 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2587+0+0 (secure 0 0 0) 0x7fd578046700 con 0x7fd5880b4600 2024-09-13T15:34:29.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.700+0000 7fd5877fe640 1 --2- 172.21.15.40:0/1111585320 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd574035370 0x7fd574037830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:29.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.700+0000 7fd5877fe640 1 --2- 172.21.15.40:0/1111585320 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd574035370 0x7fd574037830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0ad000 tx=0x7fd57c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:29.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.704+0000 7fd584ff9640 1 -- 172.21.15.40:0/1111585320 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd57801b3b0 con 0x7fd5880b4600 2024-09-13T15:34:29.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.864+0000 7fd58e9c0640 1 -- 172.21.15.40:0/1111585320 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd58814d830 con 0x7fd5880b4600 2024-09-13T15:34:29.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.868+0000 7fd584ff9640 1 -- 172.21.15.40:0/1111585320 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v12) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd578017030 con 0x7fd5880b4600 2024-09-13T15:34:29.872 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-09-13T15:34:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.868+0000 7fd58e9c0640 1 -- 172.21.15.40:0/1111585320 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd574035370 msgr2=0x7fd574037830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:29.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.868+0000 7fd58e9c0640 1 --2- 172.21.15.40:0/1111585320 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd574035370 0x7fd574037830 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0ad000 tx=0x7fd57c0a6000 comp rx=0 tx=0).stop 2024-09-13T15:34:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.868+0000 7fd58e9c0640 1 -- 172.21.15.40:0/1111585320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5880b4600 msgr2=0x7fd588147ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.868+0000 7fd58e9c0640 1 --2- 172.21.15.40:0/1111585320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5880b4600 0x7fd588147ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c480 tx=0x7fd57800c940 comp rx=0 tx=0).stop 2024-09-13T15:34:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.868+0000 7fd58e9c0640 1 -- 172.21.15.40:0/1111585320 shutdown_connections 2024-09-13T15:34:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.868+0000 7fd58e9c0640 1 --2- 172.21.15.40:0/1111585320 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd574035370 0x7fd574037830 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.868+0000 7fd58e9c0640 1 --2- 172.21.15.40:0/1111585320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5880b4600 0x7fd588147ea0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.868+0000 7fd58e9c0640 1 -- 172.21.15.40:0/1111585320 >> 172.21.15.40:0/1111585320 conn(0x7fd58806a540 msgr2=0x7fd58814a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.868+0000 7fd58e9c0640 1 -- 172.21.15.40:0/1111585320 shutdown_connections 2024-09-13T15:34:29.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:29.868+0000 7fd58e9c0640 1 -- 172.21.15.40:0/1111585320 wait complete. 2024-09-13T15:34:29.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:34:30.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.008+0000 7f26bbe39640 1 Processor -- start 2024-09-13T15:34:30.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26bbe39640 1 -- start start 2024-09-13T15:34:30.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26bbe39640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26b406f400 0x7f26b40b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:30.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26bbe39640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b40b48d0 con 0x7f26b414f3d0 2024-09-13T15:34:30.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26bbe39640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b40b5240 con 0x7f26b406f400 2024-09-13T15:34:30.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26b93d4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26b406f400 0x7f26b40b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:30.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26b93d4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26b406f400 0x7f26b40b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58268/0 (socket says 172.21.15.40:58268) 2024-09-13T15:34:30.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26b93d4640 1 -- 172.21.15.40:0/2134857354 learned_addr learned my addr 172.21.15.40:0/2134857354 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:30.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26b93d4640 1 -- 172.21.15.40:0/2134857354 >> v1:172.21.15.40:6789/0 conn(0x7f26b414f3d0 legacy=0x7f26b406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:30.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26b93d4640 1 -- 172.21.15.40:0/2134857354 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b414e7b0 con 0x7f26b406f400 2024-09-13T15:34:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26b93d4640 1 --2- 172.21.15.40:0/2134857354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b406f400 0x7f26b40b4d00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26a40097f0 tx=0x7f26a401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f00e5b38c0c862 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26b8bd3640 1 -- 172.21.15.40:0/2134857354 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26a40ab530 con 0x7f26b406f400 2024-09-13T15:34:30.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26b8bd3640 1 -- 172.21.15.40:0/2134857354 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a40a7050 con 0x7f26b406f400 2024-09-13T15:34:30.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.012+0000 7f26b8bd3640 1 -- 172.21.15.40:0/2134857354 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26a40ab7e0 con 0x7f26b406f400 2024-09-13T15:34:30.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 -- 172.21.15.40:0/2134857354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b406f400 msgr2=0x7f26b40b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:30.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 --2- 172.21.15.40:0/2134857354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b406f400 0x7f26b40b4d00 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f26a40097f0 tx=0x7f26a401c450 comp rx=0 tx=0).stop 2024-09-13T15:34:30.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 -- 172.21.15.40:0/2134857354 shutdown_connections 2024-09-13T15:34:30.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 --2- 172.21.15.40:0/2134857354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b406f400 0x7f26b40b4d00 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:30.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 -- 172.21.15.40:0/2134857354 >> 172.21.15.40:0/2134857354 conn(0x7f26b406a540 msgr2=0x7f26b40a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:30.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 -- 172.21.15.40:0/2134857354 shutdown_connections 2024-09-13T15:34:30.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 -- 172.21.15.40:0/2134857354 wait complete. 2024-09-13T15:34:30.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 Processor -- start 2024-09-13T15:34:30.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 -- start start 2024-09-13T15:34:30.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b406f400 0x7f26b40b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:30.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b4140510 con 0x7f26b406f400 2024-09-13T15:34:30.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26b9bd5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b406f400 0x7f26b40b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:30.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26b9bd5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b406f400 0x7f26b40b6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58280/0 (socket says 172.21.15.40:58280) 2024-09-13T15:34:30.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26b9bd5640 1 -- 172.21.15.40:0/2643834982 learned_addr learned my addr 172.21.15.40:0/2643834982 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26b9bd5640 1 -- 172.21.15.40:0/2643834982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a40094d0 con 0x7f26b406f400 2024-09-13T15:34:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26b9bd5640 1 --2- 172.21.15.40:0/2643834982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b406f400 0x7f26b40b6e70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26b000c7f0 tx=0x7f26b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:30.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26aa7fc640 1 -- 172.21.15.40:0/2643834982 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26b0003ab0 con 0x7f26b406f400 2024-09-13T15:34:30.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26aa7fc640 1 -- 172.21.15.40:0/2643834982 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b0003c30 con 0x7f26b406f400 2024-09-13T15:34:30.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 -- 172.21.15.40:0/2643834982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b4143550 con 0x7f26b406f400 2024-09-13T15:34:30.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26aa7fc640 1 -- 172.21.15.40:0/2643834982 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f26b000a820 con 0x7f26b406f400 2024-09-13T15:34:30.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.016+0000 7f26bbe39640 1 -- 172.21.15.40:0/2643834982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b413fff0 con 0x7f26b406f400 2024-09-13T15:34:30.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.020+0000 7f26aa7fc640 1 -- 172.21.15.40:0/2643834982 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f26b000a980 con 0x7f26b406f400 2024-09-13T15:34:30.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.020+0000 7f26bbe39640 1 -- 172.21.15.40:0/2643834982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b40b4d00 con 0x7f26b406f400 2024-09-13T15:34:30.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.020+0000 7f26aa7fc640 1 --2- 172.21.15.40:0/2643834982 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f26980354a0 0x7f2698037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:30.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.020+0000 7f26aa7fc640 1 -- 172.21.15.40:0/2643834982 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2587+0+0 (secure 0 0 0) 0x7f26b00472b0 con 0x7f26b406f400 2024-09-13T15:34:30.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.020+0000 7f26b93d4640 1 --2- 172.21.15.40:0/2643834982 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f26980354a0 0x7f2698037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:30.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.020+0000 7f26b93d4640 1 --2- 172.21.15.40:0/2643834982 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f26980354a0 0x7f2698037960 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f26a40ad000 tx=0x7f26a4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:30.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.024+0000 7f26aa7fc640 1 -- 172.21.15.40:0/2643834982 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26b000ac30 con 0x7f26b406f400 2024-09-13T15:34:30.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.220+0000 7f26bbe39640 1 -- 172.21.15.40:0/2643834982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26b4066920 con 0x7f26b406f400 2024-09-13T15:34:30.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.220+0000 7f26aa7fc640 1 -- 172.21.15.40:0/2643834982 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f26b001a360 con 0x7f26b406f400 2024-09-13T15:34:30.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:30.226 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6829/3516561034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3516561034},{"type":"v1","addr":"172.21.15.40:6829","nonce":3516561034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T15:34:30.226 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 2 2024-09-13T15:34:30.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.224+0000 7f26bbe39640 1 -- 172.21.15.40:0/2643834982 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f26980354a0 msgr2=0x7f2698037960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:30.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.224+0000 7f26bbe39640 1 --2- 172.21.15.40:0/2643834982 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f26980354a0 0x7f2698037960 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f26a40ad000 tx=0x7f26a4008040 comp rx=0 tx=0).stop 2024-09-13T15:34:30.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.224+0000 7f26bbe39640 1 -- 172.21.15.40:0/2643834982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b406f400 msgr2=0x7f26b40b6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:30.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.224+0000 7f26bbe39640 1 --2- 172.21.15.40:0/2643834982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b406f400 0x7f26b40b6e70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f26b000c7f0 tx=0x7f26b000ccb0 comp rx=0 tx=0).stop 2024-09-13T15:34:30.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.224+0000 7f26bbe39640 1 -- 172.21.15.40:0/2643834982 shutdown_connections 2024-09-13T15:34:30.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.224+0000 7f26bbe39640 1 --2- 172.21.15.40:0/2643834982 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f26980354a0 0x7f2698037960 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:30.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.224+0000 7f26bbe39640 1 --2- 172.21.15.40:0/2643834982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26b406f400 0x7f26b40b6e70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:30.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.224+0000 7f26bbe39640 1 -- 172.21.15.40:0/2643834982 >> 172.21.15.40:0/2643834982 conn(0x7f26b406a540 msgr2=0x7f26b414ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:30.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.224+0000 7f26bbe39640 1 -- 172.21.15.40:0/2643834982 shutdown_connections 2024-09-13T15:34:30.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:30.224+0000 7f26bbe39640 1 -- 172.21.15.40:0/2643834982 wait complete. 2024-09-13T15:34:32.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:34:32.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.380+0000 7fbcb3e3e640 1 Processor -- start 2024-09-13T15:34:32.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.380+0000 7fbcb3e3e640 1 -- start start 2024-09-13T15:34:32.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.384+0000 7fbcb3e3e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcac0bebb0 0x7fbcac0a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:32.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.384+0000 7fbcb3e3e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac1515b0 con 0x7fbcac0b4010 2024-09-13T15:34:32.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.384+0000 7fbcb3e3e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac14e2c0 con 0x7fbcac0bebb0 2024-09-13T15:34:32.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.384+0000 7fbcb1bda640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcac0bebb0 0x7fbcac0a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:32.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.384+0000 7fbcb1bda640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcac0bebb0 0x7fbcac0a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58286/0 (socket says 172.21.15.40:58286) 2024-09-13T15:34:32.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.384+0000 7fbcb1bda640 1 -- 172.21.15.40:0/3986390685 learned_addr learned my addr 172.21.15.40:0/3986390685 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:32.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.384+0000 7fbcb1bda640 1 -- 172.21.15.40:0/3986390685 >> v1:172.21.15.40:6789/0 conn(0x7fbcac0b4010 legacy=0x7fbcac06e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:32.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.384+0000 7fbcb1bda640 1 -- 172.21.15.40:0/3986390685 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac06f830 con 0x7fbcac0bebb0 2024-09-13T15:34:32.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.384+0000 7fbcb1bda640 1 --2- 172.21.15.40:0/3986390685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcac0bebb0 0x7fbcac0a4d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009e50 tx=0x7fbca801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c9bd403e2b1a4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:32.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.384+0000 7fbcb0bd8640 1 -- 172.21.15.40:0/3986390685 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbcac0b6bc0 con 0x7fbcac0bebb0 2024-09-13T15:34:32.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.384+0000 7fbcb0bd8640 1 -- 172.21.15.40:0/3986390685 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8009200 con 0x7fbcac0bebb0 2024-09-13T15:34:32.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.384+0000 7fbcb0bd8640 1 -- 172.21.15.40:0/3986390685 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbca80a57d0 con 0x7fbcac0bebb0 2024-09-13T15:34:32.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/3986390685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcac0bebb0 msgr2=0x7fbcac0a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:32.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 --2- 172.21.15.40:0/3986390685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcac0bebb0 0x7fbcac0a4d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbca8009e50 tx=0x7fbca801ca30 comp rx=0 tx=0).stop 2024-09-13T15:34:32.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/3986390685 shutdown_connections 2024-09-13T15:34:32.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 --2- 172.21.15.40:0/3986390685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcac0bebb0 0x7fbcac0a4d70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:32.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/3986390685 >> 172.21.15.40:0/3986390685 conn(0x7fbcac06a540 msgr2=0x7fbcac0a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:32.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/3986390685 shutdown_connections 2024-09-13T15:34:32.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/3986390685 wait complete. 2024-09-13T15:34:32.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 Processor -- start 2024-09-13T15:34:32.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 -- start start 2024-09-13T15:34:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcac0b4010 0x7fbcac0c0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0c0d70 con 0x7fbcac0b4010 2024-09-13T15:34:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb1bda640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcac0b4010 0x7fbcac0c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb1bda640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcac0b4010 0x7fbcac0c0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58292/0 (socket says 172.21.15.40:58292) 2024-09-13T15:34:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb1bda640 1 -- 172.21.15.40:0/1639999386 learned_addr learned my addr 172.21.15.40:0/1639999386 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb1bda640 1 -- 172.21.15.40:0/1639999386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca8009b30 con 0x7fbcac0b4010 2024-09-13T15:34:32.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb1bda640 1 --2- 172.21.15.40:0/1639999386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcac0b4010 0x7fbcac0c0710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbca801a660 tx=0x7fbca80197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:32.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbca27fc640 1 -- 172.21.15.40:0/1639999386 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbca80b8680 con 0x7fbcac0b4010 2024-09-13T15:34:32.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbca27fc640 1 -- 172.21.15.40:0/1639999386 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca80b87e0 con 0x7fbcac0b4010 2024-09-13T15:34:32.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/1639999386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac1491f0 con 0x7fbcac0b4010 2024-09-13T15:34:32.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbca27fc640 1 -- 172.21.15.40:0/1639999386 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbca80b8a80 con 0x7fbcac0b4010 2024-09-13T15:34:32.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/1639999386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac0c1210 con 0x7fbcac0b4010 2024-09-13T15:34:32.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbca27fc640 1 -- 172.21.15.40:0/1639999386 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fbca80b8be0 con 0x7fbcac0b4010 2024-09-13T15:34:32.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.388+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/1639999386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcac0a4d70 con 0x7fbcac0b4010 2024-09-13T15:34:32.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.392+0000 7fbca27fc640 1 --2- 172.21.15.40:0/1639999386 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbc90035450 0x7fbc90037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:32.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.392+0000 7fbca27fc640 1 -- 172.21.15.40:0/1639999386 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2587+0+0 (secure 0 0 0) 0x7fbca80e2ea0 con 0x7fbcac0b4010 2024-09-13T15:34:32.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.392+0000 7fbcb13d9640 1 --2- 172.21.15.40:0/1639999386 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbc90035450 0x7fbc90037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:32.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.392+0000 7fbcb13d9640 1 --2- 172.21.15.40:0/1639999386 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbc90035450 0x7fbc90037910 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c000f70 tx=0x7fbc9c007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:32.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.396+0000 7fbca27fc640 1 -- 172.21.15.40:0/1639999386 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbca80ad3f0 con 0x7fbcac0b4010 2024-09-13T15:34:32.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.588+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/1639999386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcac066920 con 0x7fbcac0b4010 2024-09-13T15:34:32.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.588+0000 7fbca27fc640 1 -- 172.21.15.40:0/1639999386 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+4280 (secure 0 0 0) 0x7fbca80bc030 con 0x7fbcac0b4010 2024-09-13T15:34:32.590 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:32.591 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4148,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6827/1054435232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1054435232},{"type":"v1","addr":"172.21.15.40:6827","nonce":1054435232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6829/3516561034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3516561034},{"type":"v1","addr":"172.21.15.40:6829","nonce":3516561034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6832/3545499514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6831","nonce":3545499514},{"type":"v1","addr":"172.21.15.40:6832","nonce":3545499514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4151,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3266942466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3266942466},{"type":"v1","addr":"172.21.15.40:6833","nonce":3266942466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4153,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/3668838086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3668838086},{"type":"v1","addr":"172.21.15.40:6835","nonce":3668838086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T15:34:32.591 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2024-09-13T15:34:32.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.588+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/1639999386 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbc90035450 msgr2=0x7fbc90037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.588+0000 7fbcb3e3e640 1 --2- 172.21.15.40:0/1639999386 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbc90035450 0x7fbc90037910 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c000f70 tx=0x7fbc9c007a40 comp rx=0 tx=0).stop 2024-09-13T15:34:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.588+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/1639999386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcac0b4010 msgr2=0x7fbcac0c0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.588+0000 7fbcb3e3e640 1 --2- 172.21.15.40:0/1639999386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcac0b4010 0x7fbcac0c0710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbca801a660 tx=0x7fbca80197d0 comp rx=0 tx=0).stop 2024-09-13T15:34:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.592+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/1639999386 shutdown_connections 2024-09-13T15:34:32.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.592+0000 7fbcb3e3e640 1 --2- 172.21.15.40:0/1639999386 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbc90035450 0x7fbc90037910 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.592+0000 7fbcb3e3e640 1 --2- 172.21.15.40:0/1639999386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcac0b4010 0x7fbcac0c0710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.592+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/1639999386 >> 172.21.15.40:0/1639999386 conn(0x7fbcac06a540 msgr2=0x7fbcac0bcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.592+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/1639999386 shutdown_connections 2024-09-13T15:34:32.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.592+0000 7fbcb3e3e640 1 -- 172.21.15.40:0/1639999386 wait complete. 2024-09-13T15:34:32.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:32.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.728+0000 7f96c250d640 1 Processor -- start 2024-09-13T15:34:32.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.728+0000 7f96c250d640 1 -- start start 2024-09-13T15:34:32.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.728+0000 7f96c250d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96bc0b4600 0x7f96bc14dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:32.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.728+0000 7f96c250d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc0c1130 con 0x7f96bc14e280 2024-09-13T15:34:32.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.728+0000 7f96c250d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc14e780 con 0x7f96bc0b4600 2024-09-13T15:34:32.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.728+0000 7f96bbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96bc0b4600 0x7f96bc14dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.728+0000 7f96b37fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f96bc14e280 0x7f96bc0bf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58920/0 (socket says 172.21.15.40:58920) 2024-09-13T15:34:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.728+0000 7f96bbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96bc0b4600 0x7f96bc14dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58302/0 (socket says 172.21.15.40:58302) 2024-09-13T15:34:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.728+0000 7f96b37fe640 1 -- 172.21.15.40:0/1371702418 learned_addr learned my addr 172.21.15.40:0/1371702418 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.728+0000 7f96bbfff640 1 -- 172.21.15.40:0/1371702418 >> v1:172.21.15.40:6789/0 conn(0x7f96bc14e280 legacy=0x7f96bc0bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:32.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.728+0000 7f96bbfff640 1 -- 172.21.15.40:0/1371702418 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc0b59f0 con 0x7f96bc0b4600 2024-09-13T15:34:32.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.728+0000 7f96bbfff640 1 --2- 172.21.15.40:0/1371702418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96bc0b4600 0x7f96bc14dd40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009740 tx=0x7f96ac01c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a79bd2d3331b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:32.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96bb7fe640 1 -- 172.21.15.40:0/1371702418 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96ac0ab530 con 0x7f96bc0b4600 2024-09-13T15:34:32.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96bb7fe640 1 -- 172.21.15.40:0/1371702418 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac0a7050 con 0x7f96bc0b4600 2024-09-13T15:34:32.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96bb7fe640 1 -- 172.21.15.40:0/1371702418 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96ac0ab7e0 con 0x7f96bc0b4600 2024-09-13T15:34:32.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 -- 172.21.15.40:0/1371702418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96bc0b4600 msgr2=0x7f96bc14dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:32.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 --2- 172.21.15.40:0/1371702418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96bc0b4600 0x7f96bc14dd40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009740 tx=0x7f96ac01c220 comp rx=0 tx=0).stop 2024-09-13T15:34:32.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 -- 172.21.15.40:0/1371702418 shutdown_connections 2024-09-13T15:34:32.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 --2- 172.21.15.40:0/1371702418 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96bc0b4600 0x7f96bc14dd40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:32.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 -- 172.21.15.40:0/1371702418 >> 172.21.15.40:0/1371702418 conn(0x7f96bc06a540 msgr2=0x7f96bc0a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:32.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 -- 172.21.15.40:0/1371702418 shutdown_connections 2024-09-13T15:34:32.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 -- 172.21.15.40:0/1371702418 wait complete. 2024-09-13T15:34:32.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 Processor -- start 2024-09-13T15:34:32.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 -- start start 2024-09-13T15:34:32.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96bc0b4600 0x7f96bc1435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:32.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc163970 con 0x7f96bc0b4600 2024-09-13T15:34:32.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96bc0b4600 0x7f96bc1435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:32.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96bc0b4600 0x7f96bc1435e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58306/0 (socket says 172.21.15.40:58306) 2024-09-13T15:34:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96bbfff640 1 -- 172.21.15.40:0/4289352712 learned_addr learned my addr 172.21.15.40:0/4289352712 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96bbfff640 1 -- 172.21.15.40:0/4289352712 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac009420 con 0x7f96bc0b4600 2024-09-13T15:34:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96bbfff640 1 --2- 172.21.15.40:0/4289352712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96bc0b4600 0x7f96bc1435e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f96ac019e50 tx=0x7f96ac01aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96b97fa640 1 -- 172.21.15.40:0/4289352712 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96ac0b7450 con 0x7f96bc0b4600 2024-09-13T15:34:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96b97fa640 1 -- 172.21.15.40:0/4289352712 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac0b75b0 con 0x7f96bc0b4600 2024-09-13T15:34:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 -- 172.21.15.40:0/4289352712 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc161a10 con 0x7f96bc0b4600 2024-09-13T15:34:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96b97fa640 1 -- 172.21.15.40:0/4289352712 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96ac0b7850 con 0x7f96bc0b4600 2024-09-13T15:34:32.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.732+0000 7f96c250d640 1 -- 172.21.15.40:0/4289352712 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc15dcd0 con 0x7f96bc0b4600 2024-09-13T15:34:32.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.736+0000 7f96b97fa640 1 -- 172.21.15.40:0/4289352712 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f96ac0b79b0 con 0x7f96bc0b4600 2024-09-13T15:34:32.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.736+0000 7f96c250d640 1 -- 172.21.15.40:0/4289352712 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc14dd40 con 0x7f96bc0b4600 2024-09-13T15:34:32.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.736+0000 7f96b97fa640 1 --2- 172.21.15.40:0/4289352712 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f969c035450 0x7f969c037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:32.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.736+0000 7f96b97fa640 1 -- 172.21.15.40:0/4289352712 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2587+0+0 (secure 0 0 0) 0x7f96ac0e1ef0 con 0x7f96bc0b4600 2024-09-13T15:34:32.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.736+0000 7f96b37fe640 1 --2- 172.21.15.40:0/4289352712 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f969c035450 0x7f969c037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:32.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.736+0000 7f96b37fe640 1 --2- 172.21.15.40:0/4289352712 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f969c035450 0x7f969c037910 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f96a40017b0 tx=0x7f96a4007a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:32.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.740+0000 7f96b97fa640 1 -- 172.21.15.40:0/4289352712 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f96ac0c76c0 con 0x7f96bc0b4600 2024-09-13T15:34:32.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.896+0000 7f96c250d640 1 -- 172.21.15.40:0/4289352712 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96bc0a3b40 con 0x7f96bc0b4600 2024-09-13T15:34:32.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.900+0000 7f96b97fa640 1 -- 172.21.15.40:0/4289352712 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+6733 (secure 0 0 0) 0x7f96ac0b0030 con 0x7f96bc0b4600 2024-09-13T15:34:32.900 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":12,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:27.876030+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:32.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.900+0000 7f96c250d640 1 -- 172.21.15.40:0/4289352712 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f969c035450 msgr2=0x7f969c037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.900+0000 7f96c250d640 1 --2- 172.21.15.40:0/4289352712 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f969c035450 0x7f969c037910 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f96a40017b0 tx=0x7f96a4007a30 comp rx=0 tx=0).stop 2024-09-13T15:34:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.900+0000 7f96c250d640 1 -- 172.21.15.40:0/4289352712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96bc0b4600 msgr2=0x7f96bc1435e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.900+0000 7f96c250d640 1 --2- 172.21.15.40:0/4289352712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96bc0b4600 0x7f96bc1435e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f96ac019e50 tx=0x7f96ac01aa60 comp rx=0 tx=0).stop 2024-09-13T15:34:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.900+0000 7f96c250d640 1 -- 172.21.15.40:0/4289352712 shutdown_connections 2024-09-13T15:34:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.900+0000 7f96c250d640 1 --2- 172.21.15.40:0/4289352712 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f969c035450 0x7f969c037910 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.900+0000 7f96c250d640 1 --2- 172.21.15.40:0/4289352712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96bc0b4600 0x7f96bc1435e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.900+0000 7f96c250d640 1 -- 172.21.15.40:0/4289352712 >> 172.21.15.40:0/4289352712 conn(0x7f96bc06a540 msgr2=0x7f96bc0bf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.900+0000 7f96c250d640 1 -- 172.21.15.40:0/4289352712 shutdown_connections 2024-09-13T15:34:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:32.900+0000 7f96c250d640 1 -- 172.21.15.40:0/4289352712 wait complete. 2024-09-13T15:34:32.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:34:25.125767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:34:32.919 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:34:33.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.036+0000 7ff8f8ff5640 1 Processor -- start 2024-09-13T15:34:33.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.036+0000 7ff8f8ff5640 1 -- start start 2024-09-13T15:34:33.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.036+0000 7ff8f8ff5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8f40bebb0 0x7ff8f40a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:33.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.036+0000 7ff8f8ff5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f41515b0 con 0x7ff8f40b4010 2024-09-13T15:34:33.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.036+0000 7ff8f8ff5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f414e2c0 con 0x7ff8f40bebb0 2024-09-13T15:34:33.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.036+0000 7ff8f1d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff8f40b4010 0x7ff8f406e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58926/0 (socket says 172.21.15.40:58926) 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.036+0000 7ff8f1d9b640 1 -- 172.21.15.40:0/3776108231 learned_addr learned my addr 172.21.15.40:0/3776108231 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.036+0000 7ff8f259c640 1 --2- 172.21.15.40:0/3776108231 >> v2:172.21.15.40:3300/0 conn(0x7ff8f40bebb0 0x7ff8f40a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.036+0000 7ff8f159a640 1 -- 172.21.15.40:0/3776108231 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878792421 0 0) 0x7ff8f41515b0 con 0x7ff8f40b4010 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.036+0000 7ff8f159a640 1 -- 172.21.15.40:0/3776108231 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8e0003530 con 0x7ff8f40b4010 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.036+0000 7ff8f259c640 1 -- 172.21.15.40:0/3776108231 >> v1:172.21.15.40:6789/0 conn(0x7ff8f40b4010 legacy=0x7ff8f406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.036+0000 7ff8f259c640 1 -- 172.21.15.40:0/3776108231 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f406f830 con 0x7ff8f40bebb0 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f259c640 1 --2- 172.21.15.40:0/3776108231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40bebb0 0x7ff8f40a4d70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009740 tx=0x7ff8e401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4e699844b65ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f159a640 1 -- 172.21.15.40:0/3776108231 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8f40b6bc0 con 0x7ff8f40bebb0 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f159a640 1 -- 172.21.15.40:0/3776108231 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e40a7050 con 0x7ff8f40bebb0 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f159a640 1 -- 172.21.15.40:0/3776108231 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8e40ab660 con 0x7ff8f40bebb0 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/3776108231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40bebb0 msgr2=0x7ff8f40a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f8ff5640 1 --2- 172.21.15.40:0/3776108231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40bebb0 0x7ff8f40a4d70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009740 tx=0x7ff8e401c420 comp rx=0 tx=0).stop 2024-09-13T15:34:33.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/3776108231 shutdown_connections 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f8ff5640 1 --2- 172.21.15.40:0/3776108231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40bebb0 0x7ff8f40a4d70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/3776108231 >> 172.21.15.40:0/3776108231 conn(0x7ff8f406a540 msgr2=0x7ff8f40a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/3776108231 shutdown_connections 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/3776108231 wait complete. 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f8ff5640 1 Processor -- start 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f8ff5640 1 -- start start 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f8ff5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b4010 0x7ff8f4144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f8ff5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f41463c0 con 0x7ff8f40b4010 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b4010 0x7ff8f4144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b4010 0x7ff8f4144be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58322/0 (socket says 172.21.15.40:58322) 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.040+0000 7ff8f259c640 1 -- 172.21.15.40:0/1719966098 learned_addr learned my addr 172.21.15.40:0/1719966098 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8f259c640 1 -- 172.21.15.40:0/1719966098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e4009420 con 0x7ff8f40b4010 2024-09-13T15:34:33.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8f259c640 1 --2- 172.21.15.40:0/1719966098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b4010 0x7ff8f4144be0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40ae040 tx=0x7ff8e40191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:33.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8eaffd640 1 -- 172.21.15.40:0/1719966098 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8e40b4410 con 0x7ff8f40b4010 2024-09-13T15:34:33.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8eaffd640 1 -- 172.21.15.40:0/1719966098 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e40b4570 con 0x7ff8f40b4010 2024-09-13T15:34:33.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/1719966098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f41e7880 con 0x7ff8f40b4010 2024-09-13T15:34:33.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8eaffd640 1 -- 172.21.15.40:0/1719966098 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8e40b4810 con 0x7ff8f40b4010 2024-09-13T15:34:33.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/1719966098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f41ebf00 con 0x7ff8f40b4010 2024-09-13T15:34:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8eaffd640 1 -- 172.21.15.40:0/1719966098 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7ff8e40b2040 con 0x7ff8f40b4010 2024-09-13T15:34:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/1719966098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f4146220 con 0x7ff8f40b4010 2024-09-13T15:34:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8eaffd640 1 --2- 172.21.15.40:0/1719966098 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff8d4035450 0x7ff8d4037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8eaffd640 1 -- 172.21.15.40:0/1719966098 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2587+0+0 (secure 0 0 0) 0x7ff8e40e1710 con 0x7ff8f40b4010 2024-09-13T15:34:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8f1d9b640 1 --2- 172.21.15.40:0/1719966098 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff8d4035450 0x7ff8d4037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:33.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.044+0000 7ff8f1d9b640 1 --2- 172.21.15.40:0/1719966098 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff8d4035450 0x7ff8d4037910 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc000f70 tx=0x7ff8dc0010b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:33.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.048+0000 7ff8eaffd640 1 -- 172.21.15.40:0/1719966098 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff8f4146220 con 0x7ff8f40b4010 2024-09-13T15:34:33.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.200+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/1719966098 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff8f4146220 con 0x7ff8f40b4010 2024-09-13T15:34:33.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.200+0000 7ff8eaffd640 1 -- 172.21.15.40:0/1719966098 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v12) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8f4146220 con 0x7ff8f40b4010 2024-09-13T15:34:33.202 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-09-13T15:34:33.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.204+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/1719966098 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff8d4035450 msgr2=0x7ff8d4037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:33.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.204+0000 7ff8f8ff5640 1 --2- 172.21.15.40:0/1719966098 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff8d4035450 0x7ff8d4037910 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc000f70 tx=0x7ff8dc0010b0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.204+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/1719966098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b4010 msgr2=0x7ff8f4144be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.204+0000 7ff8f8ff5640 1 --2- 172.21.15.40:0/1719966098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b4010 0x7ff8f4144be0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40ae040 tx=0x7ff8e40191c0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.204+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/1719966098 shutdown_connections 2024-09-13T15:34:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.204+0000 7ff8f8ff5640 1 --2- 172.21.15.40:0/1719966098 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff8d4035450 0x7ff8d4037910 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.204+0000 7ff8f8ff5640 1 --2- 172.21.15.40:0/1719966098 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8f40b4010 0x7ff8f4144be0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.204+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/1719966098 >> 172.21.15.40:0/1719966098 conn(0x7ff8f406a540 msgr2=0x7ff8f406fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.204+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/1719966098 shutdown_connections 2024-09-13T15:34:33.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.204+0000 7ff8f8ff5640 1 -- 172.21.15.40:0/1719966098 wait complete. 2024-09-13T15:34:33.220 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T15:34:33.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff224fa4640 1 Processor -- start 2024-09-13T15:34:33.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff224fa4640 1 -- start start 2024-09-13T15:34:33.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff224fa4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff22006f7f0 0x7ff22014fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:33.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff224fa4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2200b3ec0 con 0x7ff22006e730 2024-09-13T15:34:33.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff224fa4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff220150530 con 0x7ff22006f7f0 2024-09-13T15:34:33.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff21dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff22006f7f0 0x7ff22014fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:33.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff21dd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff22006f7f0 0x7ff22014fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58330/0 (socket says 172.21.15.40:58330) 2024-09-13T15:34:33.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff21dd9b640 1 -- 172.21.15.40:0/1563263 learned_addr learned my addr 172.21.15.40:0/1563263 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:33.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff21dd9b640 1 -- 172.21.15.40:0/1563263 >> v1:172.21.15.40:6789/0 conn(0x7ff22006e730 legacy=0x7ff22014f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:33.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff21dd9b640 1 -- 172.21.15.40:0/1563263 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2200b4330 con 0x7ff22006f7f0 2024-09-13T15:34:33.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff21d59a640 1 -- 172.21.15.40:0/1563263 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506993824 0 0) 0x7ff2200b3ec0 con 0x7ff22006e730 2024-09-13T15:34:33.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff21dd9b640 1 --2- 172.21.15.40:0/1563263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff22006f7f0 0x7ff22014fff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2100097f0 tx=0x7ff21001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9338c6629f70a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:33.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff21d59a640 1 -- 172.21.15.40:0/1563263 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2100aa590 con 0x7ff22006f7f0 2024-09-13T15:34:33.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.332+0000 7ff21d59a640 1 -- 172.21.15.40:0/1563263 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2100aa6f0 con 0x7ff22006f7f0 2024-09-13T15:34:33.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff21d59a640 1 -- 172.21.15.40:0/1563263 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2100aa9b0 con 0x7ff22006f7f0 2024-09-13T15:34:33.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 -- 172.21.15.40:0/1563263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff22006f7f0 msgr2=0x7ff22014fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:33.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 --2- 172.21.15.40:0/1563263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff22006f7f0 0x7ff22014fff0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2100097f0 tx=0x7ff21001c4e0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 -- 172.21.15.40:0/1563263 shutdown_connections 2024-09-13T15:34:33.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 --2- 172.21.15.40:0/1563263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff22006f7f0 0x7ff22014fff0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 -- 172.21.15.40:0/1563263 >> 172.21.15.40:0/1563263 conn(0x7ff22006a540 msgr2=0x7ff2200a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:33.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 -- 172.21.15.40:0/1563263 shutdown_connections 2024-09-13T15:34:33.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 -- 172.21.15.40:0/1563263 wait complete. 2024-09-13T15:34:33.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 Processor -- start 2024-09-13T15:34:33.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 -- start start 2024-09-13T15:34:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff22006e730 0x7ff2201602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff220142f40 con 0x7ff22006e730 2024-09-13T15:34:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff21e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff22006e730 0x7ff2201602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff21e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff22006e730 0x7ff2201602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58344/0 (socket says 172.21.15.40:58344) 2024-09-13T15:34:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff21e59c640 1 -- 172.21.15.40:0/2286563202 learned_addr learned my addr 172.21.15.40:0/2286563202 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff21e59c640 1 -- 172.21.15.40:0/2286563202 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100094d0 con 0x7ff22006e730 2024-09-13T15:34:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff21e59c640 1 --2- 172.21.15.40:0/2286563202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff22006e730 0x7ff2201602c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff21400c400 tx=0x7ff21400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff20effd640 1 -- 172.21.15.40:0/2286563202 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff2140054d0 con 0x7ff22006e730 2024-09-13T15:34:33.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff20effd640 1 -- 172.21.15.40:0/2286563202 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214003600 con 0x7ff22006e730 2024-09-13T15:34:33.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 -- 172.21.15.40:0/2286563202 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff220143be0 con 0x7ff22006e730 2024-09-13T15:34:33.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff20effd640 1 -- 172.21.15.40:0/2286563202 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff214003960 con 0x7ff22006e730 2024-09-13T15:34:33.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.336+0000 7ff224fa4640 1 -- 172.21.15.40:0/2286563202 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff220144ae0 con 0x7ff22006e730 2024-09-13T15:34:33.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.340+0000 7ff224fa4640 1 -- 172.21.15.40:0/2286563202 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff220142d50 con 0x7ff22006e730 2024-09-13T15:34:33.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.340+0000 7ff20effd640 1 -- 172.21.15.40:0/2286563202 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7ff214003ac0 con 0x7ff22006e730 2024-09-13T15:34:33.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.340+0000 7ff20effd640 1 --2- 172.21.15.40:0/2286563202 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff200035450 0x7ff200037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:33.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.340+0000 7ff20effd640 1 -- 172.21.15.40:0/2286563202 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2587+0+0 (secure 0 0 0) 0x7ff214046940 con 0x7ff22006e730 2024-09-13T15:34:33.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.340+0000 7ff21dd9b640 1 --2- 172.21.15.40:0/2286563202 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff200035450 0x7ff200037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:33.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.340+0000 7ff21dd9b640 1 --2- 172.21.15.40:0/2286563202 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff200035450 0x7ff200037910 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2100ae000 tx=0x7ff2100a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:33.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.344+0000 7ff20effd640 1 -- 172.21.15.40:0/2286563202 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff214019b20 con 0x7ff22006e730 2024-09-13T15:34:33.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.496+0000 7ff224fa4640 1 -- 172.21.15.40:0/2286563202 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff2200b63d0 con 0x7ff22006e730 2024-09-13T15:34:33.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.496+0000 7ff20effd640 1 -- 172.21.15.40:0/2286563202 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v12) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff214017030 con 0x7ff22006e730 2024-09-13T15:34:33.499 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2024-09-13T15:34:33.499 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-09-13T15:34:33.499 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2024-09-13T15:34:33.499 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2024-09-13T15:34:33.499 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-13T15:34:33.499 INFO:teuthology.orchestra.run.smithi040.stdout:] 2024-09-13T15:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.500+0000 7ff224fa4640 1 -- 172.21.15.40:0/2286563202 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff200035450 msgr2=0x7ff200037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.500+0000 7ff224fa4640 1 --2- 172.21.15.40:0/2286563202 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff200035450 0x7ff200037910 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff2100ae000 tx=0x7ff2100a7000 comp rx=0 tx=0).stop 2024-09-13T15:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.500+0000 7ff224fa4640 1 -- 172.21.15.40:0/2286563202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff22006e730 msgr2=0x7ff2201602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.500+0000 7ff224fa4640 1 --2- 172.21.15.40:0/2286563202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff22006e730 0x7ff2201602c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff21400c400 tx=0x7ff21400c8c0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.500+0000 7ff224fa4640 1 -- 172.21.15.40:0/2286563202 shutdown_connections 2024-09-13T15:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.500+0000 7ff224fa4640 1 --2- 172.21.15.40:0/2286563202 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff200035450 0x7ff200037910 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.500+0000 7ff224fa4640 1 --2- 172.21.15.40:0/2286563202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff22006e730 0x7ff2201602c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.500+0000 7ff224fa4640 1 -- 172.21.15.40:0/2286563202 >> 172.21.15.40:0/2286563202 conn(0x7ff22006a540 msgr2=0x7ff22014ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:33.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.500+0000 7ff224fa4640 1 -- 172.21.15.40:0/2286563202 shutdown_connections 2024-09-13T15:34:33.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.500+0000 7ff224fa4640 1 -- 172.21.15.40:0/2286563202 wait complete. 2024-09-13T15:34:33.516 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T15:34:33.516 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T15:34:33.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.628+0000 7f2ba01c3640 1 Processor -- start 2024-09-13T15:34:33.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.628+0000 7f2ba01c3640 1 -- start start 2024-09-13T15:34:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.628+0000 7f2ba01c3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b980be340 0x7f2b9815a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.628+0000 7f2ba01c3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b980c1130 con 0x7f2b980b4600 2024-09-13T15:34:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.628+0000 7f2ba01c3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b9814e780 con 0x7f2b980be340 2024-09-13T15:34:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.628+0000 7f2b9df5f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2b980b4600 0x7f2b9814dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58946/0 (socket says 172.21.15.40:58946) 2024-09-13T15:34:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.628+0000 7f2b9df5f640 1 -- 172.21.15.40:0/2906002730 learned_addr learned my addr 172.21.15.40:0/2906002730 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.628+0000 7f2b9d75e640 1 --2- 172.21.15.40:0/2906002730 >> v2:172.21.15.40:3300/0 conn(0x7f2b980be340 0x7f2b9815a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2b9cf5d640 1 -- 172.21.15.40:0/2906002730 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315602966 0 0) 0x7f2b980c1130 con 0x7f2b980b4600 2024-09-13T15:34:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2b9cf5d640 1 -- 172.21.15.40:0/2906002730 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b84003530 con 0x7f2b980b4600 2024-09-13T15:34:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2b9cf5d640 1 -- 172.21.15.40:0/2906002730 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1609827665 0 0) 0x7f2b84003530 con 0x7f2b980b4600 2024-09-13T15:34:33.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2b9d75e640 1 -- 172.21.15.40:0/2906002730 >> v1:172.21.15.40:6789/0 conn(0x7f2b980b4600 legacy=0x7f2b9814dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:33.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2b9d75e640 1 -- 172.21.15.40:0/2906002730 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9814e450 con 0x7f2b980be340 2024-09-13T15:34:33.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2b9d75e640 1 --2- 172.21.15.40:0/2906002730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980be340 0x7f2b9815a750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009740 tx=0x7f2b9401bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d4d6b06765d7a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:33.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2b9cf5d640 1 -- 172.21.15.40:0/2906002730 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b880015b0 con 0x7f2b980be340 2024-09-13T15:34:33.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2b9cf5d640 1 -- 172.21.15.40:0/2906002730 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b940a7050 con 0x7f2b980be340 2024-09-13T15:34:33.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2b9cf5d640 1 -- 172.21.15.40:0/2906002730 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b940ab530 con 0x7f2b980be340 2024-09-13T15:34:33.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2ba01c3640 1 -- 172.21.15.40:0/2906002730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980be340 msgr2=0x7f2b9815a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:33.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2ba01c3640 1 --2- 172.21.15.40:0/2906002730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980be340 0x7f2b9815a750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009740 tx=0x7f2b9401bff0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2ba01c3640 1 -- 172.21.15.40:0/2906002730 shutdown_connections 2024-09-13T15:34:33.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2ba01c3640 1 --2- 172.21.15.40:0/2906002730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980be340 0x7f2b9815a750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2ba01c3640 1 -- 172.21.15.40:0/2906002730 >> 172.21.15.40:0/2906002730 conn(0x7f2b9806a540 msgr2=0x7f2b980a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:33.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2ba01c3640 1 -- 172.21.15.40:0/2906002730 shutdown_connections 2024-09-13T15:34:33.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.632+0000 7f2ba01c3640 1 -- 172.21.15.40:0/2906002730 wait complete. 2024-09-13T15:34:33.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2ba01c3640 1 Processor -- start 2024-09-13T15:34:33.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2ba01c3640 1 -- start start 2024-09-13T15:34:33.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2ba01c3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980b4600 0x7f2b980b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:33.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2ba01c3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b980bd4f0 con 0x7f2b980b4600 2024-09-13T15:34:33.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b9df5f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980b4600 0x7f2b980b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:33.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b9df5f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980b4600 0x7f2b980b8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58368/0 (socket says 172.21.15.40:58368) 2024-09-13T15:34:33.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b9df5f640 1 -- 172.21.15.40:0/3795068150 learned_addr learned my addr 172.21.15.40:0/3795068150 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:33.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b9df5f640 1 -- 172.21.15.40:0/3795068150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b94009420 con 0x7f2b980b4600 2024-09-13T15:34:33.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b9df5f640 1 --2- 172.21.15.40:0/3795068150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980b4600 0x7f2b980b8ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c6b0 tx=0x7f2b8800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:33.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b8e7fc640 1 -- 172.21.15.40:0/3795068150 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b880058e0 con 0x7f2b980b4600 2024-09-13T15:34:33.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b8e7fc640 1 -- 172.21.15.40:0/3795068150 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b88005a40 con 0x7f2b980b4600 2024-09-13T15:34:33.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2ba01c3640 1 -- 172.21.15.40:0/3795068150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b980b91e0 con 0x7f2b980b4600 2024-09-13T15:34:33.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b8e7fc640 1 -- 172.21.15.40:0/3795068150 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2b88005ce0 con 0x7f2b980b4600 2024-09-13T15:34:33.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2ba01c3640 1 -- 172.21.15.40:0/3795068150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b980bd0c0 con 0x7f2b980b4600 2024-09-13T15:34:33.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b8e7fc640 1 -- 172.21.15.40:0/3795068150 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f2b88007070 con 0x7f2b980b4600 2024-09-13T15:34:33.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2ba01c3640 1 -- 172.21.15.40:0/3795068150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b980bd310 con 0x7f2b980b4600 2024-09-13T15:34:33.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b8e7fc640 1 --2- 172.21.15.40:0/3795068150 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2b7c035450 0x7f2b7c037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:33.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b8e7fc640 1 -- 172.21.15.40:0/3795068150 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2587+0+0 (secure 0 0 0) 0x7f2b88046ab0 con 0x7f2b980b4600 2024-09-13T15:34:33.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b9d75e640 1 --2- 172.21.15.40:0/3795068150 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2b7c035450 0x7f2b7c037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:33.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.636+0000 7f2b9d75e640 1 --2- 172.21.15.40:0/3795068150 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2b7c035450 0x7f2b7c037910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2b940ad000 tx=0x7f2b940a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:33.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.640+0000 7f2b8e7fc640 1 -- 172.21.15.40:0/3795068150 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2b88010770 con 0x7f2b980b4600 2024-09-13T15:34:33.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.792+0000 7f2ba01c3640 1 -- 172.21.15.40:0/3795068150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2b9815a750 con 0x7f2b980b4600 2024-09-13T15:34:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.900+0000 7f2b8e7fc640 1 -- 172.21.15.40:0/3795068150 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v13) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2b88017070 con 0x7f2b980b4600 2024-09-13T15:34:33.902 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2024-09-13T15:34:33.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.904+0000 7f2ba01c3640 1 -- 172.21.15.40:0/3795068150 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2b7c035450 msgr2=0x7f2b7c037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.904+0000 7f2ba01c3640 1 --2- 172.21.15.40:0/3795068150 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2b7c035450 0x7f2b7c037910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2b940ad000 tx=0x7f2b940a6000 comp rx=0 tx=0).stop 2024-09-13T15:34:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.904+0000 7f2ba01c3640 1 -- 172.21.15.40:0/3795068150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980b4600 msgr2=0x7f2b980b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.904+0000 7f2ba01c3640 1 --2- 172.21.15.40:0/3795068150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980b4600 0x7f2b980b8ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c6b0 tx=0x7f2b8800cb70 comp rx=0 tx=0).stop 2024-09-13T15:34:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.908+0000 7f2ba01c3640 1 -- 172.21.15.40:0/3795068150 shutdown_connections 2024-09-13T15:34:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.908+0000 7f2ba01c3640 1 --2- 172.21.15.40:0/3795068150 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2b7c035450 0x7f2b7c037910 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.908+0000 7f2ba01c3640 1 --2- 172.21.15.40:0/3795068150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b980b4600 0x7f2b980b8ca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:33.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.908+0000 7f2ba01c3640 1 -- 172.21.15.40:0/3795068150 >> 172.21.15.40:0/3795068150 conn(0x7f2b9806a540 msgr2=0x7f2b9806fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:33.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.908+0000 7f2ba01c3640 1 -- 172.21.15.40:0/3795068150 shutdown_connections 2024-09-13T15:34:33.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:33.908+0000 7f2ba01c3640 1 -- 172.21.15.40:0/3795068150 wait complete. 2024-09-13T15:34:33.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T15:34:34.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.056+0000 7fa4e2a37640 1 Processor -- start 2024-09-13T15:34:34.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.056+0000 7fa4e2a37640 1 -- start start 2024-09-13T15:34:34.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.056+0000 7fa4e2a37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4dc0b4010 0x7fa4dc0a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:34.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.056+0000 7fa4e2a37640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4dc1515b0 con 0x7fa4dc0bebb0 2024-09-13T15:34:34.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.056+0000 7fa4e2a37640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc14e2c0 con 0x7fa4dc0b4010 2024-09-13T15:34:34.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.056+0000 7fa4db7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4dc0b4010 0x7fa4dc0a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:34.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.056+0000 7fa4dbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa4dc0bebb0 0x7fa4dc06e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44272/0 (socket says 172.21.15.40:44272) 2024-09-13T15:34:34.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.056+0000 7fa4dbfff640 1 -- 172.21.15.40:0/2266286650 learned_addr learned my addr 172.21.15.40:0/2266286650 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:34.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.056+0000 7fa4db7fe640 1 -- 172.21.15.40:0/2266286650 >> v1:172.21.15.40:6789/0 conn(0x7fa4dc0bebb0 legacy=0x7fa4dc06e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:34.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.056+0000 7fa4db7fe640 1 -- 172.21.15.40:0/2266286650 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc06f830 con 0x7fa4dc0b4010 2024-09-13T15:34:34.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.056+0000 7fa4daffd640 1 -- 172.21.15.40:0/2266286650 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793316480 0 0) 0x7fa4dc1515b0 con 0x7fa4dc0bebb0 2024-09-13T15:34:34.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.060+0000 7fa4db7fe640 1 --2- 172.21.15.40:0/2266286650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0b4010 0x7fa4dc0a4d70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009740 tx=0x7fa4d001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f965aa6720b7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:34.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.060+0000 7fa4daffd640 1 -- 172.21.15.40:0/2266286650 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4dc0b6bc0 con 0x7fa4dc0b4010 2024-09-13T15:34:34.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.060+0000 7fa4daffd640 1 -- 172.21.15.40:0/2266286650 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d00a7050 con 0x7fa4dc0b4010 2024-09-13T15:34:34.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.060+0000 7fa4daffd640 1 -- 172.21.15.40:0/2266286650 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4d00ab680 con 0x7fa4dc0b4010 2024-09-13T15:34:34.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.060+0000 7fa4e2a37640 1 -- 172.21.15.40:0/2266286650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0b4010 msgr2=0x7fa4dc0a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:34.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.060+0000 7fa4e2a37640 1 --2- 172.21.15.40:0/2266286650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0b4010 0x7fa4dc0a4d70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009740 tx=0x7fa4d001c420 comp rx=0 tx=0).stop 2024-09-13T15:34:34.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.060+0000 7fa4e2a37640 1 -- 172.21.15.40:0/2266286650 shutdown_connections 2024-09-13T15:34:34.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.060+0000 7fa4e2a37640 1 --2- 172.21.15.40:0/2266286650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0b4010 0x7fa4dc0a4d70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:34.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.060+0000 7fa4e2a37640 1 -- 172.21.15.40:0/2266286650 >> 172.21.15.40:0/2266286650 conn(0x7fa4dc06a540 msgr2=0x7fa4dc0a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:34.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.060+0000 7fa4e2a37640 1 -- 172.21.15.40:0/2266286650 shutdown_connections 2024-09-13T15:34:34.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.060+0000 7fa4e2a37640 1 -- 172.21.15.40:0/2266286650 wait complete. 2024-09-13T15:34:34.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4e2a37640 1 Processor -- start 2024-09-13T15:34:34.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4e2a37640 1 -- start start 2024-09-13T15:34:34.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4e2a37640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0b4010 0x7fa4dc0b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:34.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4e2a37640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc1e7ff0 con 0x7fa4dc0b4010 2024-09-13T15:34:34.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0b4010 0x7fa4dc0b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:34.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0b4010 0x7fa4dc0b5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49692/0 (socket says 172.21.15.40:49692) 2024-09-13T15:34:34.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4dbfff640 1 -- 172.21.15.40:0/199150200 learned_addr learned my addr 172.21.15.40:0/199150200 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:34.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4dbfff640 1 -- 172.21.15.40:0/199150200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d0009420 con 0x7fa4dc0b4010 2024-09-13T15:34:34.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4dbfff640 1 --2- 172.21.15.40:0/199150200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0b4010 0x7fa4dc0b5470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c420 tx=0x7fa4cc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:34.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4d8ff9640 1 -- 172.21.15.40:0/199150200 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc0074d0 con 0x7fa4dc0b4010 2024-09-13T15:34:34.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4d8ff9640 1 -- 172.21.15.40:0/199150200 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc007630 con 0x7fa4dc0b4010 2024-09-13T15:34:34.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4d8ff9640 1 -- 172.21.15.40:0/199150200 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa4cc004960 con 0x7fa4dc0b4010 2024-09-13T15:34:34.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4e2a37640 1 -- 172.21.15.40:0/199150200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc15f370 con 0x7fa4dc0b4010 2024-09-13T15:34:34.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4e2a37640 1 -- 172.21.15.40:0/199150200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc1e9630 con 0x7fa4dc0b4010 2024-09-13T15:34:34.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4d8ff9640 1 -- 172.21.15.40:0/199150200 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fa4cc004ac0 con 0x7fa4dc0b4010 2024-09-13T15:34:34.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4e2a37640 1 -- 172.21.15.40:0/199150200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc0a4d70 con 0x7fa4dc0b4010 2024-09-13T15:34:34.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4d8ff9640 1 --2- 172.21.15.40:0/199150200 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fa4c8035450 0x7fa4c8037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:34.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.064+0000 7fa4d8ff9640 1 -- 172.21.15.40:0/199150200 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2957+0+0 (secure 0 0 0) 0x7fa4cc046a60 con 0x7fa4dc0b4010 2024-09-13T15:34:34.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.068+0000 7fa4db7fe640 1 --2- 172.21.15.40:0/199150200 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fa4c8035450 0x7fa4c8037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:34.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.068+0000 7fa4db7fe640 1 --2- 172.21.15.40:0/199150200 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fa4c8035450 0x7fa4c8037910 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00ad000 tx=0x7fa4d0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:34.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.072+0000 7fa4d8ff9640 1 -- 172.21.15.40:0/199150200 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa4cc01acd0 con 0x7fa4dc0b4010 2024-09-13T15:34:34.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.236+0000 7fa4e2a37640 1 -- 172.21.15.40:0/199150200 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa4dc14bfc0 con 0x7fa4dc0b4010 2024-09-13T15:34:34.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.904+0000 7fa4d8ff9640 1 -- 172.21.15.40:0/199150200 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v14) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa4cc018020 con 0x7fa4dc0b4010 2024-09-13T15:34:34.907 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2024-09-13T15:34:34.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.920+0000 7fa4e2a37640 1 -- 172.21.15.40:0/199150200 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fa4c8035450 msgr2=0x7fa4c8037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:34.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.920+0000 7fa4e2a37640 1 --2- 172.21.15.40:0/199150200 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fa4c8035450 0x7fa4c8037910 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa4d00ad000 tx=0x7fa4d0008040 comp rx=0 tx=0).stop 2024-09-13T15:34:34.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.920+0000 7fa4e2a37640 1 -- 172.21.15.40:0/199150200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0b4010 msgr2=0x7fa4dc0b5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:34.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.920+0000 7fa4e2a37640 1 --2- 172.21.15.40:0/199150200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0b4010 0x7fa4dc0b5470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c420 tx=0x7fa4cc00c8e0 comp rx=0 tx=0).stop 2024-09-13T15:34:34.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.920+0000 7fa4e2a37640 1 -- 172.21.15.40:0/199150200 shutdown_connections 2024-09-13T15:34:34.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.920+0000 7fa4e2a37640 1 --2- 172.21.15.40:0/199150200 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fa4c8035450 0x7fa4c8037910 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:34.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.920+0000 7fa4e2a37640 1 --2- 172.21.15.40:0/199150200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4dc0b4010 0x7fa4dc0b5470 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:34.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.920+0000 7fa4e2a37640 1 -- 172.21.15.40:0/199150200 >> 172.21.15.40:0/199150200 conn(0x7fa4dc06a540 msgr2=0x7fa4dc06fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:34.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.924+0000 7fa4e2a37640 1 -- 172.21.15.40:0/199150200 shutdown_connections 2024-09-13T15:34:34.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:34.924+0000 7fa4e2a37640 1 -- 172.21.15.40:0/199150200 wait complete. 2024-09-13T15:34:34.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T15:34:35.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.080+0000 7f83c4008640 1 Processor -- start 2024-09-13T15:34:35.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.080+0000 7f83c4008640 1 -- start start 2024-09-13T15:34:35.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.080+0000 7f83c4008640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83bc153f60 0x7f83bc0c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:35.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.080+0000 7f83c4008640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc0a7850 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.080+0000 7f83c4008640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc08c4f0 con 0x7f83bc153f60 2024-09-13T15:34:35.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.080+0000 7f83c1da4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83bc153f60 0x7f83bc0c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:35.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.080+0000 7f83c1da4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83bc153f60 0x7f83bc0c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49706/0 (socket says 172.21.15.40:49706) 2024-09-13T15:34:35.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.080+0000 7f83c1da4640 1 -- 172.21.15.40:0/2868980977 learned_addr learned my addr 172.21.15.40:0/2868980977 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:35.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.080+0000 7f83c1da4640 1 -- 172.21.15.40:0/2868980977 >> v1:172.21.15.40:6789/0 conn(0x7f83bc0b7bd0 legacy=0x7f83bc0c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:35.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.080+0000 7f83c0da2640 1 -- 172.21.15.40:0/2868980977 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196274738 0 0) 0x7f83bc0a7850 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.080+0000 7f83c1da4640 1 -- 172.21.15.40:0/2868980977 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc08bdb0 con 0x7f83bc153f60 2024-09-13T15:34:35.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c1da4640 1 --2- 172.21.15.40:0/2868980977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc153f60 0x7f83bc0c4b90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009820 tx=0x7f83b801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cb51058b3df565 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:35.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c0da2640 1 -- 172.21.15.40:0/2868980977 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b80a8050 con 0x7f83bc153f60 2024-09-13T15:34:35.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c0da2640 1 -- 172.21.15.40:0/2868980977 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b80ac520 con 0x7f83bc153f60 2024-09-13T15:34:35.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c0da2640 1 -- 172.21.15.40:0/2868980977 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b80ac7e0 con 0x7f83bc153f60 2024-09-13T15:34:35.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c4008640 1 -- 172.21.15.40:0/2868980977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc153f60 msgr2=0x7f83bc0c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:35.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c4008640 1 --2- 172.21.15.40:0/2868980977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc153f60 0x7f83bc0c4b90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009820 tx=0x7f83b801c4c0 comp rx=0 tx=0).stop 2024-09-13T15:34:35.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c4008640 1 -- 172.21.15.40:0/2868980977 shutdown_connections 2024-09-13T15:34:35.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c4008640 1 --2- 172.21.15.40:0/2868980977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc153f60 0x7f83bc0c4b90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:35.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c4008640 1 -- 172.21.15.40:0/2868980977 >> 172.21.15.40:0/2868980977 conn(0x7f83bc0a8640 msgr2=0x7f83bc065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:35.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c4008640 1 -- 172.21.15.40:0/2868980977 shutdown_connections 2024-09-13T15:34:35.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c4008640 1 -- 172.21.15.40:0/2868980977 wait complete. 2024-09-13T15:34:35.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c4008640 1 Processor -- start 2024-09-13T15:34:35.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.084+0000 7f83c4008640 1 -- start start 2024-09-13T15:34:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83c4008640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc0b7bd0 0x7f83bc14e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83c4008640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc15c720 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83c1da4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc0b7bd0 0x7f83bc14e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83c1da4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc0b7bd0 0x7f83bc14e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49714/0 (socket says 172.21.15.40:49714) 2024-09-13T15:34:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83c1da4640 1 -- 172.21.15.40:0/3464469911 learned_addr learned my addr 172.21.15.40:0/3464469911 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83c1da4640 1 -- 172.21.15.40:0/3464469911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b80094d0 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83c1da4640 1 --2- 172.21.15.40:0/3464469911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc0b7bd0 0x7f83bc14e870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f83b801a0f0 tx=0x7f83b801ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83b27fc640 1 -- 172.21.15.40:0/3464469911 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b8004020 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83b27fc640 1 -- 172.21.15.40:0/3464469911 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b8004180 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83b27fc640 1 -- 172.21.15.40:0/3464469911 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b8004460 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83c4008640 1 -- 172.21.15.40:0/3464469911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc14eee0 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83c4008640 1 -- 172.21.15.40:0/3464469911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc1548e0 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83c4008640 1 -- 172.21.15.40:0/3464469911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc067510 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83b27fc640 1 -- 172.21.15.40:0/3464469911 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f83b80b3040 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83b27fc640 1 --2- 172.21.15.40:0/3464469911 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f83a0035400 0x7f83a00378c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:35.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83b27fc640 1 -- 172.21.15.40:0/3464469911 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3339+0+0 (secure 0 0 0) 0x7f83b80e15b0 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83c15a3640 1 --2- 172.21.15.40:0/3464469911 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f83a0035400 0x7f83a00378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:35.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.088+0000 7f83c15a3640 1 --2- 172.21.15.40:0/3464469911 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f83a0035400 0x7f83a00378c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f83ac000f70 tx=0x7f83ac007910 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:35.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.092+0000 7f83b27fc640 1 -- 172.21.15.40:0/3464469911 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83b80c78f0 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.288+0000 7f83c4008640 1 -- 172.21.15.40:0/3464469911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f83bc15c570 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.300+0000 7f83b27fc640 1 -- 172.21.15.40:0/3464469911 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f83b80b1030 con 0x7f83bc0b7bd0 2024-09-13T15:34:35.306 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T15:34:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.304+0000 7f83c4008640 1 -- 172.21.15.40:0/3464469911 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f83a0035400 msgr2=0x7f83a00378c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.304+0000 7f83c4008640 1 --2- 172.21.15.40:0/3464469911 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f83a0035400 0x7f83a00378c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f83ac000f70 tx=0x7f83ac007910 comp rx=0 tx=0).stop 2024-09-13T15:34:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.304+0000 7f83c4008640 1 -- 172.21.15.40:0/3464469911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc0b7bd0 msgr2=0x7f83bc14e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.304+0000 7f83c4008640 1 --2- 172.21.15.40:0/3464469911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc0b7bd0 0x7f83bc14e870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f83b801a0f0 tx=0x7f83b801ad00 comp rx=0 tx=0).stop 2024-09-13T15:34:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.304+0000 7f83c4008640 1 -- 172.21.15.40:0/3464469911 shutdown_connections 2024-09-13T15:34:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.304+0000 7f83c4008640 1 --2- 172.21.15.40:0/3464469911 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f83a0035400 0x7f83a00378c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.304+0000 7f83c4008640 1 --2- 172.21.15.40:0/3464469911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83bc0b7bd0 0x7f83bc14e870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:35.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.304+0000 7f83c4008640 1 -- 172.21.15.40:0/3464469911 >> 172.21.15.40:0/3464469911 conn(0x7f83bc0a8640 msgr2=0x7f83bc0a7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:35.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.316+0000 7f83c4008640 1 -- 172.21.15.40:0/3464469911 shutdown_connections 2024-09-13T15:34:35.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.316+0000 7f83c4008640 1 -- 172.21.15.40:0/3464469911 wait complete. 2024-09-13T15:34:35.350 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:35.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.464+0000 7f8571e14640 1 Processor -- start 2024-09-13T15:34:35.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.464+0000 7f8571e14640 1 -- start start 2024-09-13T15:34:35.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.464+0000 7f8571e14640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f856c153f60 0x7f856c0c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:35.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.464+0000 7f8571e14640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c0a7850 con 0x7f856c0b7bd0 2024-09-13T15:34:35.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.464+0000 7f8571e14640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c08c4f0 con 0x7f856c153f60 2024-09-13T15:34:35.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.464+0000 7f856b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f856c153f60 0x7f856c0c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:35.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.464+0000 7f856b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f856c153f60 0x7f856c0c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49726/0 (socket says 172.21.15.40:49726) 2024-09-13T15:34:35.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.464+0000 7f856b7fe640 1 -- 172.21.15.40:0/2690830069 learned_addr learned my addr 172.21.15.40:0/2690830069 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:35.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.464+0000 7f856affd640 1 --1- 172.21.15.40:0/2690830069 >> v1:172.21.15.40:6789/0 conn(0x7f856c0b7bd0 0x7f856c0c06e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44276/0 (socket says 172.21.15.40:44276) 2024-09-13T15:34:35.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.464+0000 7f856b7fe640 1 -- 172.21.15.40:0/2690830069 >> v1:172.21.15.40:6789/0 conn(0x7f856c0b7bd0 legacy=0x7f856c0c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:35.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.464+0000 7f856b7fe640 1 -- 172.21.15.40:0/2690830069 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c08bdb0 con 0x7f856c153f60 2024-09-13T15:34:35.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.464+0000 7f856b7fe640 1 --2- 172.21.15.40:0/2690830069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c153f60 0x7f856c0c4b90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f855c009e80 tx=0x7f855c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edfc072ac293e09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:35.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f856a7fc640 1 -- 172.21.15.40:0/2690830069 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f855c009200 con 0x7f856c153f60 2024-09-13T15:34:35.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f856a7fc640 1 -- 172.21.15.40:0/2690830069 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c0a5730 con 0x7f856c153f60 2024-09-13T15:34:35.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f856a7fc640 1 -- 172.21.15.40:0/2690830069 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f855c0a59f0 con 0x7f856c153f60 2024-09-13T15:34:35.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 -- 172.21.15.40:0/2690830069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c153f60 msgr2=0x7f856c0c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 --2- 172.21.15.40:0/2690830069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c153f60 0x7f856c0c4b90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f855c009e80 tx=0x7f855c01ca10 comp rx=0 tx=0).stop 2024-09-13T15:34:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 -- 172.21.15.40:0/2690830069 shutdown_connections 2024-09-13T15:34:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 --2- 172.21.15.40:0/2690830069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c153f60 0x7f856c0c4b90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 -- 172.21.15.40:0/2690830069 >> 172.21.15.40:0/2690830069 conn(0x7f856c0a8640 msgr2=0x7f856c065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 -- 172.21.15.40:0/2690830069 shutdown_connections 2024-09-13T15:34:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 -- 172.21.15.40:0/2690830069 wait complete. 2024-09-13T15:34:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 Processor -- start 2024-09-13T15:34:35.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 -- start start 2024-09-13T15:34:35.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c0b7bd0 0x7f856c15c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:35.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c14cc80 con 0x7f856c0b7bd0 2024-09-13T15:34:35.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c0b7bd0 0x7f856c15c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:35.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f856b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c0b7bd0 0x7f856c15c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49728/0 (socket says 172.21.15.40:49728) 2024-09-13T15:34:35.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f856b7fe640 1 -- 172.21.15.40:0/2169223187 learned_addr learned my addr 172.21.15.40:0/2169223187 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:35.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f856b7fe640 1 -- 172.21.15.40:0/2169223187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c009b30 con 0x7f856c0b7bd0 2024-09-13T15:34:35.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f856b7fe640 1 --2- 172.21.15.40:0/2169223187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c0b7bd0 0x7f856c15c480 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f855c01a640 tx=0x7f855c0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:35.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8553fff640 1 -- 172.21.15.40:0/2169223187 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f855c0b8470 con 0x7f856c0b7bd0 2024-09-13T15:34:35.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8553fff640 1 -- 172.21.15.40:0/2169223187 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c0b85d0 con 0x7f856c0b7bd0 2024-09-13T15:34:35.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 -- 172.21.15.40:0/2169223187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c154a30 con 0x7f856c0b7bd0 2024-09-13T15:34:35.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8553fff640 1 -- 172.21.15.40:0/2169223187 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f855c0b8870 con 0x7f856c0b7bd0 2024-09-13T15:34:35.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.468+0000 7f8571e14640 1 -- 172.21.15.40:0/2169223187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c154760 con 0x7f856c0b7bd0 2024-09-13T15:34:35.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.472+0000 7f8553fff640 1 -- 172.21.15.40:0/2169223187 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f855c0b89d0 con 0x7f856c0b7bd0 2024-09-13T15:34:35.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.472+0000 7f8571e14640 1 -- 172.21.15.40:0/2169223187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c067510 con 0x7f856c0b7bd0 2024-09-13T15:34:35.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.472+0000 7f8553fff640 1 --2- 172.21.15.40:0/2169223187 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8558035450 0x7f8558037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:35.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.472+0000 7f8553fff640 1 -- 172.21.15.40:0/2169223187 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f855c0e3020 con 0x7f856c0b7bd0 2024-09-13T15:34:35.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.472+0000 7f856affd640 1 --2- 172.21.15.40:0/2169223187 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8558035450 0x7f8558037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:35.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.472+0000 7f856affd640 1 --2- 172.21.15.40:0/2169223187 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8558035450 0x7f8558037910 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8560001600 tx=0x7f8560007a50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:35.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.476+0000 7f8553fff640 1 -- 172.21.15.40:0/2169223187 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f855c0c03b0 con 0x7f856c0b7bd0 2024-09-13T15:34:35.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.640+0000 7f8571e14640 1 -- 172.21.15.40:0/2169223187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f856c0c2920 con 0x7f856c0b7bd0 2024-09-13T15:34:35.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.640+0000 7f8553fff640 1 -- 172.21.15.40:0/2169223187 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10516 (secure 0 0 0) 0x7f855c0bc070 con 0x7f856c0b7bd0 2024-09-13T15:34:35.642 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:35.642 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":15,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:35.291670+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:35.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.644+0000 7f8571e14640 1 -- 172.21.15.40:0/2169223187 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8558035450 msgr2=0x7f8558037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:35.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.644+0000 7f8571e14640 1 --2- 172.21.15.40:0/2169223187 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8558035450 0x7f8558037910 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8560001600 tx=0x7f8560007a50 comp rx=0 tx=0).stop 2024-09-13T15:34:35.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.644+0000 7f8571e14640 1 -- 172.21.15.40:0/2169223187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c0b7bd0 msgr2=0x7f856c15c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:35.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.644+0000 7f8571e14640 1 --2- 172.21.15.40:0/2169223187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c0b7bd0 0x7f856c15c480 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f855c01a640 tx=0x7f855c0197b0 comp rx=0 tx=0).stop 2024-09-13T15:34:35.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.644+0000 7f8571e14640 1 -- 172.21.15.40:0/2169223187 shutdown_connections 2024-09-13T15:34:35.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.644+0000 7f8571e14640 1 --2- 172.21.15.40:0/2169223187 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8558035450 0x7f8558037910 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:35.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.644+0000 7f8571e14640 1 --2- 172.21.15.40:0/2169223187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f856c0b7bd0 0x7f856c15c480 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:35.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.644+0000 7f8571e14640 1 -- 172.21.15.40:0/2169223187 >> 172.21.15.40:0/2169223187 conn(0x7f856c0a8640 msgr2=0x7f856c0c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:35.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.644+0000 7f8571e14640 1 -- 172.21.15.40:0/2169223187 shutdown_connections 2024-09-13T15:34:35.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.644+0000 7f8571e14640 1 -- 172.21.15.40:0/2169223187 wait complete. 2024-09-13T15:34:35.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:35.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.788+0000 7f11fadd3640 1 Processor -- start 2024-09-13T15:34:35.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.788+0000 7f11fadd3640 1 -- start start 2024-09-13T15:34:35.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.788+0000 7f11fadd3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11f4153f60 0x7f11f40c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:35.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.788+0000 7f11fadd3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f40a7850 con 0x7f11f40b7bd0 2024-09-13T15:34:35.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.788+0000 7f11fadd3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f408c4f0 con 0x7f11f4153f60 2024-09-13T15:34:35.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.788+0000 7f11f8b6f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11f4153f60 0x7f11f40c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:35.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.788+0000 7f11f3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f11f40b7bd0 0x7f11f40c06e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44278/0 (socket says 172.21.15.40:44278) 2024-09-13T15:34:35.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.788+0000 7f11f3fff640 1 -- 172.21.15.40:0/4070839466 learned_addr learned my addr 172.21.15.40:0/4070839466 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:35.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.788+0000 7f11f37fe640 1 -- 172.21.15.40:0/4070839466 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607763601 0 0) 0x7f11f40a7850 con 0x7f11f40b7bd0 2024-09-13T15:34:35.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.788+0000 7f11f37fe640 1 -- 172.21.15.40:0/4070839466 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11dc003530 con 0x7f11f40b7bd0 2024-09-13T15:34:35.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.788+0000 7f11f8b6f640 1 -- 172.21.15.40:0/4070839466 >> v1:172.21.15.40:6789/0 conn(0x7f11f40b7bd0 legacy=0x7f11f40c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:35.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.788+0000 7f11f8b6f640 1 -- 172.21.15.40:0/4070839466 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f408bdb0 con 0x7f11f4153f60 2024-09-13T15:34:35.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11f8b6f640 1 --2- 172.21.15.40:0/4070839466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11f4153f60 0x7f11f40c4b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009770 tx=0x7f11e801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75689e527943bc06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:35.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11f37fe640 1 -- 172.21.15.40:0/4070839466 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e80ab530 con 0x7f11f4153f60 2024-09-13T15:34:35.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11f37fe640 1 -- 172.21.15.40:0/4070839466 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e80a7050 con 0x7f11f4153f60 2024-09-13T15:34:35.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11f37fe640 1 -- 172.21.15.40:0/4070839466 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e80ab7e0 con 0x7f11f4153f60 2024-09-13T15:34:35.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11fadd3640 1 -- 172.21.15.40:0/4070839466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11f4153f60 msgr2=0x7f11f40c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:35.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11fadd3640 1 --2- 172.21.15.40:0/4070839466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11f4153f60 0x7f11f40c4b90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009770 tx=0x7f11e801c420 comp rx=0 tx=0).stop 2024-09-13T15:34:35.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11fadd3640 1 -- 172.21.15.40:0/4070839466 shutdown_connections 2024-09-13T15:34:35.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11fadd3640 1 --2- 172.21.15.40:0/4070839466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11f4153f60 0x7f11f40c4b90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:35.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11fadd3640 1 -- 172.21.15.40:0/4070839466 >> 172.21.15.40:0/4070839466 conn(0x7f11f40a8640 msgr2=0x7f11f4065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:35.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11fadd3640 1 -- 172.21.15.40:0/4070839466 shutdown_connections 2024-09-13T15:34:35.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11fadd3640 1 -- 172.21.15.40:0/4070839466 wait complete. 2024-09-13T15:34:35.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11fadd3640 1 Processor -- start 2024-09-13T15:34:35.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11fadd3640 1 -- start start 2024-09-13T15:34:35.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11fadd3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11f40b7bd0 0x7f11f4155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:35.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11fadd3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f415c8f0 con 0x7f11f40b7bd0 2024-09-13T15:34:35.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11f8b6f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11f40b7bd0 0x7f11f4155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:35.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11f8b6f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11f40b7bd0 0x7f11f4155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49744/0 (socket says 172.21.15.40:49744) 2024-09-13T15:34:35.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11f8b6f640 1 -- 172.21.15.40:0/571970316 learned_addr learned my addr 172.21.15.40:0/571970316 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:35.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.792+0000 7f11f8b6f640 1 -- 172.21.15.40:0/571970316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e8009420 con 0x7f11f40b7bd0 2024-09-13T15:34:35.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.796+0000 7f11f8b6f640 1 --2- 172.21.15.40:0/571970316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11f40b7bd0 0x7f11f4155290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f11e801a050 tx=0x7f11e801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:35.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.796+0000 7f11f17fa640 1 -- 172.21.15.40:0/571970316 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e80abe10 con 0x7f11f40b7bd0 2024-09-13T15:34:35.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.796+0000 7f11f17fa640 1 -- 172.21.15.40:0/571970316 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e80b7450 con 0x7f11f40b7bd0 2024-09-13T15:34:35.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.796+0000 7f11f17fa640 1 -- 172.21.15.40:0/571970316 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11e80b76f0 con 0x7f11f40b7bd0 2024-09-13T15:34:35.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.796+0000 7f11fadd3640 1 -- 172.21.15.40:0/571970316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f4155880 con 0x7f11f40b7bd0 2024-09-13T15:34:35.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.796+0000 7f11fadd3640 1 -- 172.21.15.40:0/571970316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f415f7b0 con 0x7f11f40b7bd0 2024-09-13T15:34:35.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.796+0000 7f11f17fa640 1 -- 172.21.15.40:0/571970316 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f11e80b7850 con 0x7f11f40b7bd0 2024-09-13T15:34:35.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.796+0000 7f11fadd3640 1 -- 172.21.15.40:0/571970316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f4067510 con 0x7f11f40b7bd0 2024-09-13T15:34:35.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.796+0000 7f11f17fa640 1 --2- 172.21.15.40:0/571970316 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f11e0035450 0x7f11e0037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:35.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.796+0000 7f11f17fa640 1 -- 172.21.15.40:0/571970316 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f11e80e1fd0 con 0x7f11f40b7bd0 2024-09-13T15:34:35.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.796+0000 7f11f3fff640 1 --2- 172.21.15.40:0/571970316 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f11e0035450 0x7f11e0037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:35.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.796+0000 7f11f3fff640 1 --2- 172.21.15.40:0/571970316 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f11e0035450 0x7f11e0037910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f11e4007fd0 tx=0x7f11e4007980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:35.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.800+0000 7f11f17fa640 1 -- 172.21.15.40:0/571970316 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f11e80c74e0 con 0x7f11f40b7bd0 2024-09-13T15:34:35.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.960+0000 7f11fadd3640 1 -- 172.21.15.40:0/571970316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11f40720a0 con 0x7f11f40b7bd0 2024-09-13T15:34:35.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.964+0000 7f11f17fa640 1 -- 172.21.15.40:0/571970316 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10516 (secure 0 0 0) 0x7f11e80bb020 con 0x7f11f40b7bd0 2024-09-13T15:34:35.965 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:35.965 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":15,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:35.291670+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.964+0000 7f11fadd3640 1 -- 172.21.15.40:0/571970316 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f11e0035450 msgr2=0x7f11e0037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.964+0000 7f11fadd3640 1 --2- 172.21.15.40:0/571970316 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f11e0035450 0x7f11e0037910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f11e4007fd0 tx=0x7f11e4007980 comp rx=0 tx=0).stop 2024-09-13T15:34:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.964+0000 7f11fadd3640 1 -- 172.21.15.40:0/571970316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11f40b7bd0 msgr2=0x7f11f4155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.964+0000 7f11fadd3640 1 --2- 172.21.15.40:0/571970316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11f40b7bd0 0x7f11f4155290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f11e801a050 tx=0x7f11e801ac60 comp rx=0 tx=0).stop 2024-09-13T15:34:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.964+0000 7f11fadd3640 1 -- 172.21.15.40:0/571970316 shutdown_connections 2024-09-13T15:34:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.964+0000 7f11fadd3640 1 --2- 172.21.15.40:0/571970316 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f11e0035450 0x7f11e0037910 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.964+0000 7f11fadd3640 1 --2- 172.21.15.40:0/571970316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11f40b7bd0 0x7f11f4155290 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.964+0000 7f11fadd3640 1 -- 172.21.15.40:0/571970316 >> 172.21.15.40:0/571970316 conn(0x7f11f40a8640 msgr2=0x7f11f4153540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.964+0000 7f11fadd3640 1 -- 172.21.15.40:0/571970316 shutdown_connections 2024-09-13T15:34:35.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:35.964+0000 7f11fadd3640 1 -- 172.21.15.40:0/571970316 wait complete. 2024-09-13T15:34:35.984 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T15:34:36.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.112+0000 7fd31068c640 1 Processor -- start 2024-09-13T15:34:36.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.112+0000 7fd31068c640 1 -- start start 2024-09-13T15:34:36.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.112+0000 7fd31068c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd30806c660 0x7fd30806b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:36.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.112+0000 7fd31068c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3080b5d60 con 0x7fd30806c280 2024-09-13T15:34:36.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.112+0000 7fd31068c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30814ece0 con 0x7fd30806c660 2024-09-13T15:34:36.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.112+0000 7fd30dc27640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd30806c660 0x7fd30806b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:36.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.112+0000 7fd30e428640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd30806c280 0x7fd3080b6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44280/0 (socket says 172.21.15.40:44280) 2024-09-13T15:34:36.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.112+0000 7fd30e428640 1 -- 172.21.15.40:0/897615689 learned_addr learned my addr 172.21.15.40:0/897615689 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:36.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.112+0000 7fd30dc27640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd30806c660 0x7fd30806b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49760/0 (socket says 172.21.15.40:49760) 2024-09-13T15:34:36.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.112+0000 7fd30dc27640 1 -- 172.21.15.40:0/897615689 >> v1:172.21.15.40:6789/0 conn(0x7fd30806c280 legacy=0x7fd3080b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:36.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.112+0000 7fd30dc27640 1 -- 172.21.15.40:0/897615689 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308150970 con 0x7fd30806c660 2024-09-13T15:34:36.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd30dc27640 1 --2- 172.21.15.40:0/897615689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd30806c660 0x7fd30806b780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009740 tx=0x7fd2fc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7a361811033dee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:36.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd30d426640 1 -- 172.21.15.40:0/897615689 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc0ab530 con 0x7fd30806c660 2024-09-13T15:34:36.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd30d426640 1 -- 172.21.15.40:0/897615689 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc0a7050 con 0x7fd30806c660 2024-09-13T15:34:36.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd30d426640 1 -- 172.21.15.40:0/897615689 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2fc0ab7e0 con 0x7fd30806c660 2024-09-13T15:34:36.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd31068c640 1 -- 172.21.15.40:0/897615689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd30806c660 msgr2=0x7fd30806b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd31068c640 1 --2- 172.21.15.40:0/897615689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd30806c660 0x7fd30806b780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc009740 tx=0x7fd2fc01c390 comp rx=0 tx=0).stop 2024-09-13T15:34:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd31068c640 1 -- 172.21.15.40:0/897615689 shutdown_connections 2024-09-13T15:34:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd31068c640 1 --2- 172.21.15.40:0/897615689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd30806c660 0x7fd30806b780 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd31068c640 1 -- 172.21.15.40:0/897615689 >> 172.21.15.40:0/897615689 conn(0x7fd3080a5440 msgr2=0x7fd30806b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd31068c640 1 -- 172.21.15.40:0/897615689 shutdown_connections 2024-09-13T15:34:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd31068c640 1 -- 172.21.15.40:0/897615689 wait complete. 2024-09-13T15:34:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd31068c640 1 Processor -- start 2024-09-13T15:34:36.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd31068c640 1 -- start start 2024-09-13T15:34:36.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd31068c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd30806c280 0x7fd308156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:36.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd31068c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd308151970 con 0x7fd30806c280 2024-09-13T15:34:36.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.116+0000 7fd30e428640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd30806c280 0x7fd308156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:36.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd30e428640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd30806c280 0x7fd308156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49768/0 (socket says 172.21.15.40:49768) 2024-09-13T15:34:36.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd30e428640 1 -- 172.21.15.40:0/3350250400 learned_addr learned my addr 172.21.15.40:0/3350250400 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:36.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd30e428640 1 -- 172.21.15.40:0/3350250400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc009420 con 0x7fd30806c280 2024-09-13T15:34:36.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd30e428640 1 --2- 172.21.15.40:0/3350250400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd30806c280 0x7fd308156c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd30400c480 tx=0x7fd30400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:36.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd2faffd640 1 -- 172.21.15.40:0/3350250400 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd304005c20 con 0x7fd30806c280 2024-09-13T15:34:36.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd2faffd640 1 -- 172.21.15.40:0/3350250400 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd304005d80 con 0x7fd30806c280 2024-09-13T15:34:36.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd31068c640 1 -- 172.21.15.40:0/3350250400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd308159590 con 0x7fd30806c280 2024-09-13T15:34:36.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd2faffd640 1 -- 172.21.15.40:0/3350250400 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3040071a0 con 0x7fd30806c280 2024-09-13T15:34:36.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd31068c640 1 -- 172.21.15.40:0/3350250400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30813fef0 con 0x7fd30806c280 2024-09-13T15:34:36.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd2faffd640 1 -- 172.21.15.40:0/3350250400 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fd304007300 con 0x7fd30806c280 2024-09-13T15:34:36.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd31068c640 1 -- 172.21.15.40:0/3350250400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30806b780 con 0x7fd30806c280 2024-09-13T15:34:36.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd2faffd640 1 --2- 172.21.15.40:0/3350250400 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd2ec035450 0x7fd2ec037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:36.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd2faffd640 1 -- 172.21.15.40:0/3350250400 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3439+0+0 (secure 0 0 0) 0x7fd304046b00 con 0x7fd30806c280 2024-09-13T15:34:36.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd30dc27640 1 --2- 172.21.15.40:0/3350250400 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd2ec035450 0x7fd2ec037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:36.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.120+0000 7fd30dc27640 1 --2- 172.21.15.40:0/3350250400 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd2ec035450 0x7fd2ec037910 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0ad000 tx=0x7fd2fc0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:36.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.124+0000 7fd2faffd640 1 -- 172.21.15.40:0/3350250400 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd3040075b0 con 0x7fd30806c280 2024-09-13T15:34:36.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:36.324+0000 7fd31068c640 1 -- 172.21.15.40:0/3350250400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd30815a660 con 0x7fd30806c280 2024-09-13T15:34:37.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.299+0000 7fd2faffd640 1 -- 172.21.15.40:0/3350250400 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd304017030 con 0x7fd30806c280 2024-09-13T15:34:37.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.303+0000 7fd31068c640 1 -- 172.21.15.40:0/3350250400 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd2ec035450 msgr2=0x7fd2ec037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:37.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.303+0000 7fd31068c640 1 --2- 172.21.15.40:0/3350250400 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd2ec035450 0x7fd2ec037910 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0ad000 tx=0x7fd2fc0a6000 comp rx=0 tx=0).stop 2024-09-13T15:34:37.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.303+0000 7fd31068c640 1 -- 172.21.15.40:0/3350250400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd30806c280 msgr2=0x7fd308156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:37.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.303+0000 7fd31068c640 1 --2- 172.21.15.40:0/3350250400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd30806c280 0x7fd308156c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd30400c480 tx=0x7fd30400c940 comp rx=0 tx=0).stop 2024-09-13T15:34:37.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.303+0000 7fd31068c640 1 -- 172.21.15.40:0/3350250400 shutdown_connections 2024-09-13T15:34:37.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.303+0000 7fd31068c640 1 --2- 172.21.15.40:0/3350250400 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fd2ec035450 0x7fd2ec037910 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:37.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.303+0000 7fd31068c640 1 --2- 172.21.15.40:0/3350250400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd30806c280 0x7fd308156c90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:37.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.303+0000 7fd31068c640 1 -- 172.21.15.40:0/3350250400 >> 172.21.15.40:0/3350250400 conn(0x7fd3080a5440 msgr2=0x7fd308072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:37.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.303+0000 7fd31068c640 1 -- 172.21.15.40:0/3350250400 shutdown_connections 2024-09-13T15:34:37.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.303+0000 7fd31068c640 1 -- 172.21.15.40:0/3350250400 wait complete. 2024-09-13T15:34:37.328 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T15:34:37.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T15:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.455+0000 7f668d1d7640 1 Processor -- start 2024-09-13T15:34:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.455+0000 7f668d1d7640 1 -- start start 2024-09-13T15:34:37.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.455+0000 7f668d1d7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66880bedb0 0x7f66880b8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:37.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.455+0000 7f668d1d7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6688065fb0 con 0x7f66880be9d0 2024-09-13T15:34:37.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.455+0000 7f668d1d7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6688066450 con 0x7f66880bedb0 2024-09-13T15:34:37.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.455+0000 7f668659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f66880bedb0 0x7f66880b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:37.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.455+0000 7f6686d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f66880be9d0 0x7f668806bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44296/0 (socket says 172.21.15.40:44296) 2024-09-13T15:34:37.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.455+0000 7f6686d9d640 1 -- 172.21.15.40:0/2398296013 learned_addr learned my addr 172.21.15.40:0/2398296013 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:37.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.455+0000 7f668659c640 1 -- 172.21.15.40:0/2398296013 >> v1:172.21.15.40:6789/0 conn(0x7f66880be9d0 legacy=0x7f668806bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:37.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.455+0000 7f6685d9b640 1 -- 172.21.15.40:0/2398296013 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224022889 0 0) 0x7f6688065fb0 con 0x7f66880be9d0 2024-09-13T15:34:37.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.455+0000 7f668659c640 1 -- 172.21.15.40:0/2398296013 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880b94a0 con 0x7f66880bedb0 2024-09-13T15:34:37.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.455+0000 7f668659c640 1 --2- 172.21.15.40:0/2398296013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66880bedb0 0x7f66880b8580 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f667c009d90 tx=0x7f667c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933c268ed720b4e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:37.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f6685d9b640 1 -- 172.21.15.40:0/2398296013 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f667c0a5840 con 0x7f66880bedb0 2024-09-13T15:34:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f6685d9b640 1 -- 172.21.15.40:0/2398296013 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c0a59a0 con 0x7f66880bedb0 2024-09-13T15:34:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f6685d9b640 1 -- 172.21.15.40:0/2398296013 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f667c0a5c60 con 0x7f66880bedb0 2024-09-13T15:34:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 -- 172.21.15.40:0/2398296013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66880bedb0 msgr2=0x7f66880b8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 --2- 172.21.15.40:0/2398296013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66880bedb0 0x7f66880b8580 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f667c009d90 tx=0x7f667c01c8b0 comp rx=0 tx=0).stop 2024-09-13T15:34:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 -- 172.21.15.40:0/2398296013 shutdown_connections 2024-09-13T15:34:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 --2- 172.21.15.40:0/2398296013 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66880bedb0 0x7f66880b8580 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 -- 172.21.15.40:0/2398296013 >> 172.21.15.40:0/2398296013 conn(0x7f6688070c80 msgr2=0x7f6688071090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 -- 172.21.15.40:0/2398296013 shutdown_connections 2024-09-13T15:34:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 -- 172.21.15.40:0/2398296013 wait complete. 2024-09-13T15:34:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 Processor -- start 2024-09-13T15:34:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 -- start start 2024-09-13T15:34:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66880be9d0 0x7f66881f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66881f3370 con 0x7f66880be9d0 2024-09-13T15:34:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f6686d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66880be9d0 0x7f66881f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f6686d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66880be9d0 0x7f66881f2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49794/0 (socket says 172.21.15.40:49794) 2024-09-13T15:34:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f6686d9d640 1 -- 172.21.15.40:0/32121011 learned_addr learned my addr 172.21.15.40:0/32121011 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f6686d9d640 1 -- 172.21.15.40:0/32121011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c009a70 con 0x7f66880be9d0 2024-09-13T15:34:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f6686d9d640 1 --2- 172.21.15.40:0/32121011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66880be9d0 0x7f66881f2e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f667800c420 tx=0x7f667800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:37.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f666f7fe640 1 -- 172.21.15.40:0/32121011 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66780074d0 con 0x7f66880be9d0 2024-09-13T15:34:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f666f7fe640 1 -- 172.21.15.40:0/32121011 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678007630 con 0x7f66880be9d0 2024-09-13T15:34:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 -- 172.21.15.40:0/32121011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668815ed00 con 0x7f66880be9d0 2024-09-13T15:34:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f666f7fe640 1 -- 172.21.15.40:0/32121011 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6678004960 con 0x7f66880be9d0 2024-09-13T15:34:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.459+0000 7f668d1d7640 1 -- 172.21.15.40:0/32121011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668813ea30 con 0x7f66880be9d0 2024-09-13T15:34:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.463+0000 7f666f7fe640 1 -- 172.21.15.40:0/32121011 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f6678004ac0 con 0x7f66880be9d0 2024-09-13T15:34:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.463+0000 7f668d1d7640 1 -- 172.21.15.40:0/32121011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668815eb60 con 0x7f66880be9d0 2024-09-13T15:34:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.463+0000 7f666f7fe640 1 --2- 172.21.15.40:0/32121011 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6674035450 0x7f6674037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.463+0000 7f666f7fe640 1 -- 172.21.15.40:0/32121011 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f6678046c40 con 0x7f66880be9d0 2024-09-13T15:34:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.463+0000 7f668659c640 1 --2- 172.21.15.40:0/32121011 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6674035450 0x7f6674037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:37.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.463+0000 7f668659c640 1 --2- 172.21.15.40:0/32121011 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6674035450 0x7f6674037910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f667c009d90 tx=0x7f667c0a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.467+0000 7f666f7fe640 1 -- 172.21.15.40:0/32121011 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f668815eb60 con 0x7f66880be9d0 2024-09-13T15:34:37.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:37.663+0000 7f668d1d7640 1 -- 172.21.15.40:0/32121011 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f668815eb60 con 0x7f66880be9d0 2024-09-13T15:34:38.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.303+0000 7f666f7fe640 1 -- 172.21.15.40:0/32121011 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f668815eb60 con 0x7f66880be9d0 2024-09-13T15:34:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.307+0000 7f668d1d7640 1 -- 172.21.15.40:0/32121011 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6674035450 msgr2=0x7f6674037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.307+0000 7f668d1d7640 1 --2- 172.21.15.40:0/32121011 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6674035450 0x7f6674037910 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f667c009d90 tx=0x7f667c0a7070 comp rx=0 tx=0).stop 2024-09-13T15:34:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.307+0000 7f668d1d7640 1 -- 172.21.15.40:0/32121011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66880be9d0 msgr2=0x7f66881f2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.307+0000 7f668d1d7640 1 --2- 172.21.15.40:0/32121011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66880be9d0 0x7f66881f2e30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f667800c420 tx=0x7f667800c8e0 comp rx=0 tx=0).stop 2024-09-13T15:34:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.307+0000 7f668d1d7640 1 -- 172.21.15.40:0/32121011 shutdown_connections 2024-09-13T15:34:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.307+0000 7f668d1d7640 1 --2- 172.21.15.40:0/32121011 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6674035450 0x7f6674037910 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.307+0000 7f668d1d7640 1 --2- 172.21.15.40:0/32121011 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f66880be9d0 0x7f66881f2e30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:38.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.307+0000 7f668d1d7640 1 -- 172.21.15.40:0/32121011 >> 172.21.15.40:0/32121011 conn(0x7f6688070c80 msgr2=0x7f668806b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.307+0000 7f668d1d7640 1 -- 172.21.15.40:0/32121011 shutdown_connections 2024-09-13T15:34:38.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.307+0000 7f668d1d7640 1 -- 172.21.15.40:0/32121011 wait complete. 2024-09-13T15:34:38.330 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T15:34:38.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:34:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.459+0000 7f5287051640 1 Processor -- start 2024-09-13T15:34:38.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.459+0000 7f5287051640 1 -- start start 2024-09-13T15:34:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.459+0000 7f5287051640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52800bebb0 0x7f52800a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.459+0000 7f5287051640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52801515b0 con 0x7f52800b4010 2024-09-13T15:34:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.459+0000 7f5287051640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528014e2c0 con 0x7f52800bebb0 2024-09-13T15:34:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.459+0000 7f527ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f52800b4010 0x7f528006e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44298/0 (socket says 172.21.15.40:44298) 2024-09-13T15:34:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.459+0000 7f5284ded640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52800bebb0 0x7f52800a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:38.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.459+0000 7f527ffff640 1 -- 172.21.15.40:0/1737247559 learned_addr learned my addr 172.21.15.40:0/1737247559 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.459+0000 7f5284ded640 1 -- 172.21.15.40:0/1737247559 >> v1:172.21.15.40:6789/0 conn(0x7f52800b4010 legacy=0x7f528006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:38.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.459+0000 7f5284ded640 1 -- 172.21.15.40:0/1737247559 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528006f830 con 0x7f52800bebb0 2024-09-13T15:34:38.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5284ded640 1 --2- 172.21.15.40:0/1737247559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52800bebb0 0x7f52800a4d70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5274009740 tx=0x7f527401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85afd0cb9ce4b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:38.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f527f7fe640 1 -- 172.21.15.40:0/1737247559 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52800b6bc0 con 0x7f52800bebb0 2024-09-13T15:34:38.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f527f7fe640 1 -- 172.21.15.40:0/1737247559 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52740a7050 con 0x7f52800bebb0 2024-09-13T15:34:38.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f527f7fe640 1 -- 172.21.15.40:0/1737247559 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52740ab680 con 0x7f52800bebb0 2024-09-13T15:34:38.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5287051640 1 -- 172.21.15.40:0/1737247559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52800bebb0 msgr2=0x7f52800a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:38.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5287051640 1 --2- 172.21.15.40:0/1737247559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52800bebb0 0x7f52800a4d70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5274009740 tx=0x7f527401c420 comp rx=0 tx=0).stop 2024-09-13T15:34:38.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5287051640 1 -- 172.21.15.40:0/1737247559 shutdown_connections 2024-09-13T15:34:38.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5287051640 1 --2- 172.21.15.40:0/1737247559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52800bebb0 0x7f52800a4d70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:38.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5287051640 1 -- 172.21.15.40:0/1737247559 >> 172.21.15.40:0/1737247559 conn(0x7f528006a540 msgr2=0x7f52800a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:38.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5287051640 1 -- 172.21.15.40:0/1737247559 shutdown_connections 2024-09-13T15:34:38.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5287051640 1 -- 172.21.15.40:0/1737247559 wait complete. 2024-09-13T15:34:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5287051640 1 Processor -- start 2024-09-13T15:34:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5287051640 1 -- start start 2024-09-13T15:34:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5287051640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52800b4010 0x7f52800b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5287051640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280142370 con 0x7f52800b4010 2024-09-13T15:34:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5284ded640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52800b4010 0x7f52800b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5284ded640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52800b4010 0x7f52800b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49818/0 (socket says 172.21.15.40:49818) 2024-09-13T15:34:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5284ded640 1 -- 172.21.15.40:0/609700749 learned_addr learned my addr 172.21.15.40:0/609700749 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:38.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5284ded640 1 -- 172.21.15.40:0/609700749 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5274009420 con 0x7f52800b4010 2024-09-13T15:34:38.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f5284ded640 1 --2- 172.21.15.40:0/609700749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52800b4010 0x7f52800b5520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f52740ae040 tx=0x7f52740191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.463+0000 7f527d7fa640 1 -- 172.21.15.40:0/609700749 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52740b4540 con 0x7f52800b4010 2024-09-13T15:34:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.467+0000 7f527d7fa640 1 -- 172.21.15.40:0/609700749 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52740b46a0 con 0x7f52800b4010 2024-09-13T15:34:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.467+0000 7f5287051640 1 -- 172.21.15.40:0/609700749 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5280144c20 con 0x7f52800b4010 2024-09-13T15:34:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.467+0000 7f527d7fa640 1 -- 172.21.15.40:0/609700749 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52740b4980 con 0x7f52800b4010 2024-09-13T15:34:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.467+0000 7f5287051640 1 -- 172.21.15.40:0/609700749 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52800b5a60 con 0x7f52800b4010 2024-09-13T15:34:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.467+0000 7f527d7fa640 1 -- 172.21.15.40:0/609700749 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f52740b2040 con 0x7f52800b4010 2024-09-13T15:34:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.467+0000 7f5287051640 1 -- 172.21.15.40:0/609700749 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52800a4d70 con 0x7f52800b4010 2024-09-13T15:34:38.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.467+0000 7f527d7fa640 1 --2- 172.21.15.40:0/609700749 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5264035450 0x7f5264037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:38.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.467+0000 7f527d7fa640 1 -- 172.21.15.40:0/609700749 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f52740e1b00 con 0x7f52800b4010 2024-09-13T15:34:38.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.467+0000 7f527ffff640 1 --2- 172.21.15.40:0/609700749 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5264035450 0x7f5264037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:38.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.467+0000 7f527ffff640 1 --2- 172.21.15.40:0/609700749 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5264035450 0x7f5264037910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f526c001610 tx=0x7f526c007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:38.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.471+0000 7f527d7fa640 1 -- 172.21.15.40:0/609700749 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f52740b4e60 con 0x7f52800b4010 2024-09-13T15:34:38.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.663+0000 7f5287051640 1 -- 172.21.15.40:0/609700749 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5280066920 con 0x7f52800b4010 2024-09-13T15:34:38.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.663+0000 7f527d7fa640 1 -- 172.21.15.40:0/609700749 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5484 (secure 0 0 0) 0x7f52740b0030 con 0x7f52800b4010 2024-09-13T15:34:38.667 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:38.667 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4148,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6827/1054435232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1054435232},{"type":"v1","addr":"172.21.15.40:6827","nonce":1054435232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6829/3516561034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3516561034},{"type":"v1","addr":"172.21.15.40:6829","nonce":3516561034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6832/3545499514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6831","nonce":3545499514},{"type":"v1","addr":"172.21.15.40:6832","nonce":3545499514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4151,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3266942466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3266942466},{"type":"v1","addr":"172.21.15.40:6833","nonce":3266942466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:34:35.292383+0000","modified":"2024-09-13T15:34:38.300209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4153":{"gid":4153,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3668838086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3668838086},{"type":"v1","addr":"172.21.15.40:6835","nonce":3668838086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:34:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-13T15:34:38.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.667+0000 7f5287051640 1 -- 172.21.15.40:0/609700749 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5264035450 msgr2=0x7f5264037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.667+0000 7f5287051640 1 --2- 172.21.15.40:0/609700749 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5264035450 0x7f5264037910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f526c001610 tx=0x7f526c007ad0 comp rx=0 tx=0).stop 2024-09-13T15:34:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.667+0000 7f5287051640 1 -- 172.21.15.40:0/609700749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52800b4010 msgr2=0x7f52800b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.667+0000 7f5287051640 1 --2- 172.21.15.40:0/609700749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52800b4010 0x7f52800b5520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f52740ae040 tx=0x7f52740191c0 comp rx=0 tx=0).stop 2024-09-13T15:34:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.667+0000 7f5287051640 1 -- 172.21.15.40:0/609700749 shutdown_connections 2024-09-13T15:34:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.667+0000 7f5287051640 1 --2- 172.21.15.40:0/609700749 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5264035450 0x7f5264037910 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.667+0000 7f5287051640 1 --2- 172.21.15.40:0/609700749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52800b4010 0x7f52800b5520 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.667+0000 7f5287051640 1 -- 172.21.15.40:0/609700749 >> 172.21.15.40:0/609700749 conn(0x7f528006a540 msgr2=0x7f528006e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.667+0000 7f5287051640 1 -- 172.21.15.40:0/609700749 shutdown_connections 2024-09-13T15:34:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.667+0000 7f5287051640 1 -- 172.21.15.40:0/609700749 wait complete. 2024-09-13T15:34:38.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:38.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.807+0000 7f3825d5e640 1 Processor -- start 2024-09-13T15:34:38.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.807+0000 7f3825d5e640 1 -- start start 2024-09-13T15:34:38.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.807+0000 7f3825d5e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38200bebb0 0x7f38200a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:38.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.807+0000 7f3825d5e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38201515b0 con 0x7f38200b4010 2024-09-13T15:34:38.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.807+0000 7f3825d5e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382014e2c0 con 0x7f38200bebb0 2024-09-13T15:34:38.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.807+0000 7f381f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38200bebb0 0x7f38200a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:38.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.807+0000 7f381f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38200bebb0 0x7f38200a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49834/0 (socket says 172.21.15.40:49834) 2024-09-13T15:34:38.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.807+0000 7f381f7fe640 1 -- 172.21.15.40:0/3822620589 learned_addr learned my addr 172.21.15.40:0/3822620589 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:38.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.807+0000 7f381f7fe640 1 -- 172.21.15.40:0/3822620589 >> v1:172.21.15.40:6789/0 conn(0x7f38200b4010 legacy=0x7f382006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:38.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.807+0000 7f381f7fe640 1 -- 172.21.15.40:0/3822620589 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382006f830 con 0x7f38200bebb0 2024-09-13T15:34:38.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.807+0000 7f381f7fe640 1 --2- 172.21.15.40:0/3822620589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38200bebb0 0x7f38200a4d70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f38100097f0 tx=0x7f381001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4e056d8754f6c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:38.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f381e7fc640 1 -- 172.21.15.40:0/3822620589 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38200b6bc0 con 0x7f38200bebb0 2024-09-13T15:34:38.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f381e7fc640 1 -- 172.21.15.40:0/3822620589 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38100a7050 con 0x7f38200bebb0 2024-09-13T15:34:38.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f381e7fc640 1 -- 172.21.15.40:0/3822620589 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38100ab680 con 0x7f38200bebb0 2024-09-13T15:34:38.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f3825d5e640 1 -- 172.21.15.40:0/3822620589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38200bebb0 msgr2=0x7f38200a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:38.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f3825d5e640 1 --2- 172.21.15.40:0/3822620589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38200bebb0 0x7f38200a4d70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f38100097f0 tx=0x7f381001c4e0 comp rx=0 tx=0).stop 2024-09-13T15:34:38.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f3825d5e640 1 -- 172.21.15.40:0/3822620589 shutdown_connections 2024-09-13T15:34:38.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f3825d5e640 1 --2- 172.21.15.40:0/3822620589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38200bebb0 0x7f38200a4d70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:38.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f3825d5e640 1 -- 172.21.15.40:0/3822620589 >> 172.21.15.40:0/3822620589 conn(0x7f382006a540 msgr2=0x7f38200a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:38.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f3825d5e640 1 -- 172.21.15.40:0/3822620589 shutdown_connections 2024-09-13T15:34:38.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f3825d5e640 1 -- 172.21.15.40:0/3822620589 wait complete. 2024-09-13T15:34:38.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f3825d5e640 1 Processor -- start 2024-09-13T15:34:38.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f3825d5e640 1 -- start start 2024-09-13T15:34:38.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f3825d5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38200b4010 0x7f38200b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:38.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f3825d5e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3820142370 con 0x7f38200b4010 2024-09-13T15:34:38.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f381f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38200b4010 0x7f38200b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:38.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f381f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38200b4010 0x7f38200b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49850/0 (socket says 172.21.15.40:49850) 2024-09-13T15:34:38.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.811+0000 7f381f7fe640 1 -- 172.21.15.40:0/1007286109 learned_addr learned my addr 172.21.15.40:0/1007286109 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:38.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f381f7fe640 1 -- 172.21.15.40:0/1007286109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38100094d0 con 0x7f38200b4010 2024-09-13T15:34:38.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f381f7fe640 1 --2- 172.21.15.40:0/1007286109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38200b4010 0x7f38200b5520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f381001a110 tx=0x7f3810019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:38.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f3807fff640 1 -- 172.21.15.40:0/1007286109 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38100b4570 con 0x7f38200b4010 2024-09-13T15:34:38.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f3807fff640 1 -- 172.21.15.40:0/1007286109 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38100b46d0 con 0x7f38200b4010 2024-09-13T15:34:38.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f3825d5e640 1 -- 172.21.15.40:0/1007286109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3820144c20 con 0x7f38200b4010 2024-09-13T15:34:38.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f3807fff640 1 -- 172.21.15.40:0/1007286109 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38100b49b0 con 0x7f38200b4010 2024-09-13T15:34:38.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f3825d5e640 1 -- 172.21.15.40:0/1007286109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38200b5a60 con 0x7f38200b4010 2024-09-13T15:34:38.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f3825d5e640 1 -- 172.21.15.40:0/1007286109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38200a4d70 con 0x7f38200b4010 2024-09-13T15:34:38.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f3807fff640 1 -- 172.21.15.40:0/1007286109 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f38100b2070 con 0x7f38200b4010 2024-09-13T15:34:38.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f3807fff640 1 --2- 172.21.15.40:0/1007286109 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f380c035450 0x7f380c037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:38.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f3807fff640 1 -- 172.21.15.40:0/1007286109 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f38100e1cc0 con 0x7f38200b4010 2024-09-13T15:34:38.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f381effd640 1 --2- 172.21.15.40:0/1007286109 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f380c035450 0x7f380c037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:38.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.815+0000 7f381effd640 1 --2- 172.21.15.40:0/1007286109 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f380c035450 0x7f380c037910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3814000f70 tx=0x7f3814007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:38.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.819+0000 7f3807fff640 1 -- 172.21.15.40:0/1007286109 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f38100c5750 con 0x7f38200b4010 2024-09-13T15:34:38.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.979+0000 7f3825d5e640 1 -- 172.21.15.40:0/1007286109 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3820066920 con 0x7f38200b4010 2024-09-13T15:34:38.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.979+0000 7f3807fff640 1 -- 172.21.15.40:0/1007286109 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+10503 (secure 0 0 0) 0x7f38100b8020 con 0x7f38200b4010 2024-09-13T15:34:38.982 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:38.983 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:36.294490+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:38.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.983+0000 7f3825d5e640 1 -- 172.21.15.40:0/1007286109 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f380c035450 msgr2=0x7f380c037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:38.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.983+0000 7f3825d5e640 1 --2- 172.21.15.40:0/1007286109 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f380c035450 0x7f380c037910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3814000f70 tx=0x7f3814007a40 comp rx=0 tx=0).stop 2024-09-13T15:34:38.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.983+0000 7f3825d5e640 1 -- 172.21.15.40:0/1007286109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38200b4010 msgr2=0x7f38200b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:38.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.983+0000 7f3825d5e640 1 --2- 172.21.15.40:0/1007286109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38200b4010 0x7f38200b5520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f381001a110 tx=0x7f3810019280 comp rx=0 tx=0).stop 2024-09-13T15:34:38.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.983+0000 7f3825d5e640 1 -- 172.21.15.40:0/1007286109 shutdown_connections 2024-09-13T15:34:38.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.983+0000 7f3825d5e640 1 --2- 172.21.15.40:0/1007286109 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f380c035450 0x7f380c037910 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:38.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.983+0000 7f3825d5e640 1 --2- 172.21.15.40:0/1007286109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38200b4010 0x7f38200b5520 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:38.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.983+0000 7f3825d5e640 1 -- 172.21.15.40:0/1007286109 >> 172.21.15.40:0/1007286109 conn(0x7f382006a540 msgr2=0x7f382006e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:38.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.983+0000 7f3825d5e640 1 -- 172.21.15.40:0/1007286109 shutdown_connections 2024-09-13T15:34:38.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:38.983+0000 7f3825d5e640 1 -- 172.21.15.40:0/1007286109 wait complete. 2024-09-13T15:34:39.000 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T15:34:39.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:34:39.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbcaeee3640 1 Processor -- start 2024-09-13T15:34:39.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbcaeee3640 1 -- start start 2024-09-13T15:34:39.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbcaeee3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbca80c0030 0x7fbca80b91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:39.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbcaeee3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca80bea00 con 0x7fbca80bfc50 2024-09-13T15:34:39.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbcaeee3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca806a960 con 0x7fbca80c0030 2024-09-13T15:34:39.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbcacc7f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbca80bfc50 0x7fbca8069f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44322/0 (socket says 172.21.15.40:44322) 2024-09-13T15:34:39.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbcacc7f640 1 -- 172.21.15.40:0/3595435322 learned_addr learned my addr 172.21.15.40:0/3595435322 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:39.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbca7fff640 1 --2- 172.21.15.40:0/3595435322 >> v2:172.21.15.40:3300/0 conn(0x7fbca80c0030 0x7fbca80b91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:39.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbca77fe640 1 -- 172.21.15.40:0/3595435322 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980198615 0 0) 0x7fbca80bea00 con 0x7fbca80bfc50 2024-09-13T15:34:39.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbca77fe640 1 -- 172.21.15.40:0/3595435322 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc90003530 con 0x7fbca80bfc50 2024-09-13T15:34:39.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbca7fff640 1 -- 172.21.15.40:0/3595435322 >> v1:172.21.15.40:6789/0 conn(0x7fbca80bfc50 legacy=0x7fbca8069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:39.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbca7fff640 1 -- 172.21.15.40:0/3595435322 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca80be560 con 0x7fbca80c0030 2024-09-13T15:34:39.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbca7fff640 1 --2- 172.21.15.40:0/3595435322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbca80c0030 0x7fbca80b91e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009740 tx=0x7fbc9c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783214625eea0f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:39.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.111+0000 7fbca77fe640 1 -- 172.21.15.40:0/3595435322 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc9c0ac550 con 0x7fbca80c0030 2024-09-13T15:34:39.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbca77fe640 1 -- 172.21.15.40:0/3595435322 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c0ac6b0 con 0x7fbca80c0030 2024-09-13T15:34:39.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbca77fe640 1 -- 172.21.15.40:0/3595435322 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc9c0ac950 con 0x7fbca80c0030 2024-09-13T15:34:39.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3595435322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbca80c0030 msgr2=0x7fbca80b91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:39.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 --2- 172.21.15.40:0/3595435322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbca80c0030 0x7fbca80b91e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009740 tx=0x7fbc9c01c420 comp rx=0 tx=0).stop 2024-09-13T15:34:39.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3595435322 shutdown_connections 2024-09-13T15:34:39.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 --2- 172.21.15.40:0/3595435322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbca80c0030 0x7fbca80b91e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:39.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3595435322 >> 172.21.15.40:0/3595435322 conn(0x7fbca80a5440 msgr2=0x7fbca806b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:39.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3595435322 shutdown_connections 2024-09-13T15:34:39.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3595435322 wait complete. 2024-09-13T15:34:39.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 Processor -- start 2024-09-13T15:34:39.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 -- start start 2024-09-13T15:34:39.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbca80bfc50 0x7fbca81f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:39.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca815bbc0 con 0x7fbca80bfc50 2024-09-13T15:34:39.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcacc7f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbca80bfc50 0x7fbca81f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:39.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcacc7f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbca80bfc50 0x7fbca81f55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49866/0 (socket says 172.21.15.40:49866) 2024-09-13T15:34:39.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcacc7f640 1 -- 172.21.15.40:0/3153366532 learned_addr learned my addr 172.21.15.40:0/3153366532 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:39.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcacc7f640 1 -- 172.21.15.40:0/3153366532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c009420 con 0x7fbca80bfc50 2024-09-13T15:34:39.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcacc7f640 1 --2- 172.21.15.40:0/3153366532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbca80bfc50 0x7fbca81f55b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800c3d0 tx=0x7fbc9800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:39.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbca57fa640 1 -- 172.21.15.40:0/3153366532 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc98005ce0 con 0x7fbca80bfc50 2024-09-13T15:34:39.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbca57fa640 1 -- 172.21.15.40:0/3153366532 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc98005e40 con 0x7fbca80bfc50 2024-09-13T15:34:39.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3153366532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca80bca90 con 0x7fbca80bfc50 2024-09-13T15:34:39.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbca57fa640 1 -- 172.21.15.40:0/3153366532 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc98007220 con 0x7fbca80bfc50 2024-09-13T15:34:39.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3153366532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca814e030 con 0x7fbca80bfc50 2024-09-13T15:34:39.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbca57fa640 1 -- 172.21.15.40:0/3153366532 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fbc98007440 con 0x7fbca80bfc50 2024-09-13T15:34:39.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.115+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3153366532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca815a5c0 con 0x7fbca80bfc50 2024-09-13T15:34:39.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.119+0000 7fbca57fa640 1 --2- 172.21.15.40:0/3153366532 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbc94035400 0x7fbc940378c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:39.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.119+0000 7fbca57fa640 1 -- 172.21.15.40:0/3153366532 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7fbc98046d50 con 0x7fbca80bfc50 2024-09-13T15:34:39.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.119+0000 7fbca7fff640 1 --2- 172.21.15.40:0/3153366532 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbc94035400 0x7fbc940378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:39.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.119+0000 7fbca7fff640 1 --2- 172.21.15.40:0/3153366532 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbc94035400 0x7fbc940378c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0ae000 tx=0x7fbc9c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:39.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.123+0000 7fbca57fa640 1 -- 172.21.15.40:0/3153366532 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbc98019b40 con 0x7fbca80bfc50 2024-09-13T15:34:39.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.275+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3153366532 --> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbca80bcc20 con 0x7fbc94035400 2024-09-13T15:34:39.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.291+0000 7fbca57fa640 1 -- 172.21.15.40:0/3153366532 <== mgr.4099 v2:172.21.15.40:6824/3185150828 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237813 (secure 0 0 0) 0x7fbca80bcc20 con 0x7fbc94035400 2024-09-13T15:34:39.297 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:39.299 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:34:39.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.295+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3153366532 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbc94035400 msgr2=0x7fbc940378c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.295+0000 7fbcaeee3640 1 --2- 172.21.15.40:0/3153366532 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbc94035400 0x7fbc940378c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0ae000 tx=0x7fbc9c0a7000 comp rx=0 tx=0).stop 2024-09-13T15:34:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.295+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3153366532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbca80bfc50 msgr2=0x7fbca81f55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.299+0000 7fbcaeee3640 1 --2- 172.21.15.40:0/3153366532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbca80bfc50 0x7fbca81f55b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800c3d0 tx=0x7fbc9800c890 comp rx=0 tx=0).stop 2024-09-13T15:34:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.299+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3153366532 shutdown_connections 2024-09-13T15:34:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.299+0000 7fbcaeee3640 1 --2- 172.21.15.40:0/3153366532 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbc94035400 0x7fbc940378c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.299+0000 7fbcaeee3640 1 --2- 172.21.15.40:0/3153366532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbca80bfc50 0x7fbca81f55b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.299+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3153366532 >> 172.21.15.40:0/3153366532 conn(0x7fbca80a5440 msgr2=0x7fbca806f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.299+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3153366532 shutdown_connections 2024-09-13T15:34:39.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.299+0000 7fbcaeee3640 1 -- 172.21.15.40:0/3153366532 wait complete. 2024-09-13T15:34:39.315 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T15:34:39.057578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82540,"kb_used_data":1480,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032980,"statfs":{"total":289910292480,"available":289825771520,"internally_reserved":0,"allocated":1515520,"data_stored":1264464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.159410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.907241+0000","last_change":"2024-09-13T15:34:33.907241+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.907241+0000","last_undegraded":"2024-09-13T15:34:33.907241+0000","last_fullsized":"2024-09-13T15:34:33.907241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909196+0000","last_change":"2024-09-13T15:34:33.909196+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909196+0000","last_undegraded":"2024-09-13T15:34:33.909196+0000","last_fullsized":"2024-09-13T15:34:33.909196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.911411+0000","last_change":"2024-09-13T15:34:33.911411+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.911411+0000","last_undegraded":"2024-09-13T15:34:33.911411+0000","last_fullsized":"2024-09-13T15:34:33.911411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910463+0000","last_change":"2024-09-13T15:34:33.910463+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910463+0000","last_undegraded":"2024-09-13T15:34:33.910463+0000","last_fullsized":"2024-09-13T15:34:33.910463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.906764+0000","last_change":"2024-09-13T15:34:33.906764+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.906764+0000","last_undegraded":"2024-09-13T15:34:33.906764+0000","last_fullsized":"2024-09-13T15:34:33.906764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909659+0000","last_change":"2024-09-13T15:34:33.909659+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909659+0000","last_undegraded":"2024-09-13T15:34:33.909659+0000","last_fullsized":"2024-09-13T15:34:33.909659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908766+0000","last_change":"2024-09-13T15:34:33.908766+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908766+0000","last_undegraded":"2024-09-13T15:34:33.908766+0000","last_fullsized":"2024-09-13T15:34:33.908766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908399+0000","last_change":"2024-09-13T15:34:33.908399+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908399+0000","last_undegraded":"2024-09-13T15:34:33.908399+0000","last_fullsized":"2024-09-13T15:34:33.908399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910778+0000","last_change":"2024-09-13T15:34:33.910778+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910778+0000","last_undegraded":"2024-09-13T15:34:33.910778+0000","last_fullsized":"2024-09-13T15:34:33.910778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908669+0000","last_change":"2024-09-13T15:34:33.908669+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908669+0000","last_undegraded":"2024-09-13T15:34:33.908669+0000","last_fullsized":"2024-09-13T15:34:33.908669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910017+0000","last_change":"2024-09-13T15:34:33.910017+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910017+0000","last_undegraded":"2024-09-13T15:34:33.910017+0000","last_fullsized":"2024-09-13T15:34:33.910017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.907602+0000","last_change":"2024-09-13T15:34:33.907602+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.907602+0000","last_undegraded":"2024-09-13T15:34:33.907602+0000","last_fullsized":"2024-09-13T15:34:33.907602+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:31.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908875+0000","last_change":"2024-09-13T15:34:33.908875+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908875+0000","last_undegraded":"2024-09-13T15:34:33.908875+0000","last_fullsized":"2024-09-13T15:34:33.908875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909627+0000","last_change":"2024-09-13T15:34:33.909627+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909627+0000","last_undegraded":"2024-09-13T15:34:33.909627+0000","last_fullsized":"2024-09-13T15:34:33.909627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.906256+0000","last_change":"2024-09-13T15:34:33.906256+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.906256+0000","last_undegraded":"2024-09-13T15:34:33.906256+0000","last_fullsized":"2024-09-13T15:34:33.906256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.907702+0000","last_change":"2024-09-13T15:34:33.907702+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.907702+0000","last_undegraded":"2024-09-13T15:34:33.907702+0000","last_fullsized":"2024-09-13T15:34:33.907702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":138,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-09-13T15:34:30.222393+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:34:30.222393+0000","last_peered":"2024-09-13T15:34:30.222393+0000","last_clean":"2024-09-13T15:34:30.222393+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:34:30.222393+0000","last_undegraded":"2024-09-13T15:34:30.222393+0000","last_fullsized":"2024-09-13T15:34:30.222393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:42.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.903600+0000","last_change":"2024-09-13T15:34:33.903600+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.903600+0000","last_undegraded":"2024-09-13T15:34:33.903600+0000","last_fullsized":"2024-09-13T15:34:33.903600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.906492+0000","last_change":"2024-09-13T15:34:33.906492+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.906492+0000","last_undegraded":"2024-09-13T15:34:33.906492+0000","last_fullsized":"2024-09-13T15:34:33.906492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:47.211308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908292+0000","last_change":"2024-09-13T15:34:33.908292+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908292+0000","last_undegraded":"2024-09-13T15:34:33.908292+0000","last_fullsized":"2024-09-13T15:34:33.908292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:37.814369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909954+0000","last_change":"2024-09-13T15:34:33.909954+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909954+0000","last_undegraded":"2024-09-13T15:34:33.909954+0000","last_fullsized":"2024-09-13T15:34:33.909954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.904077+0000","last_change":"2024-09-13T15:34:33.904077+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.904077+0000","last_undegraded":"2024-09-13T15:34:33.904077+0000","last_fullsized":"2024-09-13T15:34:33.904077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.904960+0000","last_change":"2024-09-13T15:34:33.904960+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.904960+0000","last_undegraded":"2024-09-13T15:34:33.904960+0000","last_fullsized":"2024-09-13T15:34:33.904960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.905087+0000","last_change":"2024-09-13T15:34:33.905087+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.905087+0000","last_undegraded":"2024-09-13T15:34:33.905087+0000","last_fullsized":"2024-09-13T15:34:33.905087+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.905482+0000","last_change":"2024-09-13T15:34:33.905482+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.905482+0000","last_undegraded":"2024-09-13T15:34:33.905482+0000","last_fullsized":"2024-09-13T15:34:33.905482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908677+0000","last_change":"2024-09-13T15:34:33.908677+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908677+0000","last_undegraded":"2024-09-13T15:34:33.908677+0000","last_fullsized":"2024-09-13T15:34:33.908677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.903408+0000","last_change":"2024-09-13T15:34:33.903408+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.903408+0000","last_undegraded":"2024-09-13T15:34:33.903408+0000","last_fullsized":"2024-09-13T15:34:33.903408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.904350+0000","last_change":"2024-09-13T15:34:33.904350+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.904350+0000","last_undegraded":"2024-09-13T15:34:33.904350+0000","last_fullsized":"2024-09-13T15:34:33.904350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908749+0000","last_change":"2024-09-13T15:34:33.908749+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908749+0000","last_undegraded":"2024-09-13T15:34:33.908749+0000","last_fullsized":"2024-09-13T15:34:33.908749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909925+0000","last_change":"2024-09-13T15:34:33.909925+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909925+0000","last_undegraded":"2024-09-13T15:34:33.909925+0000","last_fullsized":"2024-09-13T15:34:33.909925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909766+0000","last_change":"2024-09-13T15:34:33.909766+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909766+0000","last_undegraded":"2024-09-13T15:34:33.909766+0000","last_fullsized":"2024-09-13T15:34:33.909766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910525+0000","last_change":"2024-09-13T15:34:33.910525+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910525+0000","last_undegraded":"2024-09-13T15:34:33.910525+0000","last_fullsized":"2024-09-13T15:34:33.910525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.911539+0000","last_change":"2024-09-13T15:34:33.911539+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.911539+0000","last_undegraded":"2024-09-13T15:34:33.911539+0000","last_fullsized":"2024-09-13T15:34:33.911539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27132,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":114688,"data_stored":30274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":617095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":617095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:34:39.320 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:34:39.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.479+0000 7f8bda91c640 1 Processor -- start 2024-09-13T15:34:39.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.479+0000 7f8bda91c640 1 -- start start 2024-09-13T15:34:39.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.479+0000 7f8bda91c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8bd406dbb0 0x7f8bd40b8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:39.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.479+0000 7f8bda91c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd40b6870 con 0x7f8bd406d7d0 2024-09-13T15:34:39.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.479+0000 7f8bda91c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd40c0e00 con 0x7f8bd406dbb0 2024-09-13T15:34:39.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.479+0000 7f8bd3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8bd406d7d0 0x7f8bd4070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44338/0 (socket says 172.21.15.40:44338) 2024-09-13T15:34:39.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.479+0000 7f8bd3fff640 1 -- 172.21.15.40:0/2993472667 learned_addr learned my addr 172.21.15.40:0/2993472667 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:39.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.479+0000 7f8bd37fe640 1 --2- 172.21.15.40:0/2993472667 >> v2:172.21.15.40:3300/0 conn(0x7f8bd406dbb0 0x7f8bd40b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:39.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.479+0000 7f8bd37fe640 1 -- 172.21.15.40:0/2993472667 >> v1:172.21.15.40:6789/0 conn(0x7f8bd406d7d0 legacy=0x7f8bd4070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:39.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.479+0000 7f8bd37fe640 1 -- 172.21.15.40:0/2993472667 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd40b8bb0 con 0x7f8bd406dbb0 2024-09-13T15:34:39.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bd37fe640 1 --2- 172.21.15.40:0/2993472667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bd406dbb0 0x7f8bd40b8000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009740 tx=0x7f8bc801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5449f3f6355fbec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:39.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bd2ffd640 1 -- 172.21.15.40:0/2993472667 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bc80ab530 con 0x7f8bd406dbb0 2024-09-13T15:34:39.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bd2ffd640 1 -- 172.21.15.40:0/2993472667 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc80a7050 con 0x7f8bd406dbb0 2024-09-13T15:34:39.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bd2ffd640 1 -- 172.21.15.40:0/2993472667 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bc80ab7e0 con 0x7f8bd406dbb0 2024-09-13T15:34:39.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bda91c640 1 -- 172.21.15.40:0/2993472667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bd406dbb0 msgr2=0x7f8bd40b8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:39.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bda91c640 1 --2- 172.21.15.40:0/2993472667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bd406dbb0 0x7f8bd40b8000 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009740 tx=0x7f8bc801c390 comp rx=0 tx=0).stop 2024-09-13T15:34:39.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bda91c640 1 -- 172.21.15.40:0/2993472667 shutdown_connections 2024-09-13T15:34:39.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bda91c640 1 --2- 172.21.15.40:0/2993472667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bd406dbb0 0x7f8bd40b8000 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:39.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bda91c640 1 -- 172.21.15.40:0/2993472667 >> 172.21.15.40:0/2993472667 conn(0x7f8bd40a64c0 msgr2=0x7f8bd40a68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:39.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bda91c640 1 -- 172.21.15.40:0/2993472667 shutdown_connections 2024-09-13T15:34:39.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bda91c640 1 -- 172.21.15.40:0/2993472667 wait complete. 2024-09-13T15:34:39.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bda91c640 1 Processor -- start 2024-09-13T15:34:39.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.483+0000 7f8bda91c640 1 -- start start 2024-09-13T15:34:39.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bda91c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bd406d7d0 0x7f8bd4147b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:39.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bda91c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd415e210 con 0x7f8bd406d7d0 2024-09-13T15:34:39.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bd406d7d0 0x7f8bd4147b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:39.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bd406d7d0 0x7f8bd4147b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49892/0 (socket says 172.21.15.40:49892) 2024-09-13T15:34:39.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd3fff640 1 -- 172.21.15.40:0/3691313656 learned_addr learned my addr 172.21.15.40:0/3691313656 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:39.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd3fff640 1 -- 172.21.15.40:0/3691313656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc8009420 con 0x7f8bd406d7d0 2024-09-13T15:34:39.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd3fff640 1 --2- 172.21.15.40:0/3691313656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bd406d7d0 0x7f8bd4147b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400c3a0 tx=0x7f8bc400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:39.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd0ff9640 1 -- 172.21.15.40:0/3691313656 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bc4005c20 con 0x7f8bd406d7d0 2024-09-13T15:34:39.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd0ff9640 1 -- 172.21.15.40:0/3691313656 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc4005d80 con 0x7f8bd406d7d0 2024-09-13T15:34:39.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bda91c640 1 -- 172.21.15.40:0/3691313656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd415d260 con 0x7f8bd406d7d0 2024-09-13T15:34:39.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd0ff9640 1 -- 172.21.15.40:0/3691313656 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8bc4007200 con 0x7f8bd406d7d0 2024-09-13T15:34:39.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bda91c640 1 -- 172.21.15.40:0/3691313656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd4148070 con 0x7f8bd406d7d0 2024-09-13T15:34:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bda91c640 1 -- 172.21.15.40:0/3691313656 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd4067510 con 0x7f8bd406d7d0 2024-09-13T15:34:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd0ff9640 1 -- 172.21.15.40:0/3691313656 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f8bc4007360 con 0x7f8bd406d7d0 2024-09-13T15:34:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd0ff9640 1 --2- 172.21.15.40:0/3691313656 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8bc0035450 0x7f8bc0037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd0ff9640 1 -- 172.21.15.40:0/3691313656 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f8bc4046b60 con 0x7f8bd406d7d0 2024-09-13T15:34:39.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd37fe640 1 --2- 172.21.15.40:0/3691313656 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8bc0035450 0x7f8bc0037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:39.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.487+0000 7f8bd37fe640 1 --2- 172.21.15.40:0/3691313656 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8bc0035450 0x7f8bc0037910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80ad000 tx=0x7f8bc80a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:39.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.491+0000 7f8bd0ff9640 1 -- 172.21.15.40:0/3691313656 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8bc4012400 con 0x7f8bd406d7d0 2024-09-13T15:34:39.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.647+0000 7f8bda91c640 1 -- 172.21.15.40:0/3691313656 --> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8bd40b8000 con 0x7f8bc0035450 2024-09-13T15:34:39.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.663+0000 7f8bd0ff9640 1 -- 172.21.15.40:0/3691313656 <== mgr.4099 v2:172.21.15.40:6824/3185150828 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237813 (secure 0 0 0) 0x7f8bd40b8000 con 0x7f8bc0035450 2024-09-13T15:34:39.669 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:39.670 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:34:39.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.667+0000 7f8bda91c640 1 -- 172.21.15.40:0/3691313656 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8bc0035450 msgr2=0x7f8bc0037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:39.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.667+0000 7f8bda91c640 1 --2- 172.21.15.40:0/3691313656 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8bc0035450 0x7f8bc0037910 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8bc80ad000 tx=0x7f8bc80a6000 comp rx=0 tx=0).stop 2024-09-13T15:34:39.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.667+0000 7f8bda91c640 1 -- 172.21.15.40:0/3691313656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bd406d7d0 msgr2=0x7f8bd4147b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:39.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.667+0000 7f8bda91c640 1 --2- 172.21.15.40:0/3691313656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bd406d7d0 0x7f8bd4147b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400c3a0 tx=0x7f8bc400c860 comp rx=0 tx=0).stop 2024-09-13T15:34:39.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.667+0000 7f8bda91c640 1 -- 172.21.15.40:0/3691313656 shutdown_connections 2024-09-13T15:34:39.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.667+0000 7f8bda91c640 1 --2- 172.21.15.40:0/3691313656 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8bc0035450 0x7f8bc0037910 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:39.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.667+0000 7f8bda91c640 1 --2- 172.21.15.40:0/3691313656 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bd406d7d0 0x7f8bd4147b30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:39.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.667+0000 7f8bda91c640 1 -- 172.21.15.40:0/3691313656 >> 172.21.15.40:0/3691313656 conn(0x7f8bd40a64c0 msgr2=0x7f8bd40b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:39.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.667+0000 7f8bda91c640 1 -- 172.21.15.40:0/3691313656 shutdown_connections 2024-09-13T15:34:39.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.667+0000 7f8bda91c640 1 -- 172.21.15.40:0/3691313656 wait complete. 2024-09-13T15:34:39.686 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T15:34:39.057578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82540,"kb_used_data":1480,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032980,"statfs":{"total":289910292480,"available":289825771520,"internally_reserved":0,"allocated":1515520,"data_stored":1264464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.159410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.907241+0000","last_change":"2024-09-13T15:34:33.907241+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.907241+0000","last_undegraded":"2024-09-13T15:34:33.907241+0000","last_fullsized":"2024-09-13T15:34:33.907241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909196+0000","last_change":"2024-09-13T15:34:33.909196+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909196+0000","last_undegraded":"2024-09-13T15:34:33.909196+0000","last_fullsized":"2024-09-13T15:34:33.909196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.911411+0000","last_change":"2024-09-13T15:34:33.911411+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.911411+0000","last_undegraded":"2024-09-13T15:34:33.911411+0000","last_fullsized":"2024-09-13T15:34:33.911411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910463+0000","last_change":"2024-09-13T15:34:33.910463+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910463+0000","last_undegraded":"2024-09-13T15:34:33.910463+0000","last_fullsized":"2024-09-13T15:34:33.910463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.906764+0000","last_change":"2024-09-13T15:34:33.906764+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.906764+0000","last_undegraded":"2024-09-13T15:34:33.906764+0000","last_fullsized":"2024-09-13T15:34:33.906764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909659+0000","last_change":"2024-09-13T15:34:33.909659+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909659+0000","last_undegraded":"2024-09-13T15:34:33.909659+0000","last_fullsized":"2024-09-13T15:34:33.909659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908766+0000","last_change":"2024-09-13T15:34:33.908766+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908766+0000","last_undegraded":"2024-09-13T15:34:33.908766+0000","last_fullsized":"2024-09-13T15:34:33.908766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908399+0000","last_change":"2024-09-13T15:34:33.908399+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908399+0000","last_undegraded":"2024-09-13T15:34:33.908399+0000","last_fullsized":"2024-09-13T15:34:33.908399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910778+0000","last_change":"2024-09-13T15:34:33.910778+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910778+0000","last_undegraded":"2024-09-13T15:34:33.910778+0000","last_fullsized":"2024-09-13T15:34:33.910778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908669+0000","last_change":"2024-09-13T15:34:33.908669+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908669+0000","last_undegraded":"2024-09-13T15:34:33.908669+0000","last_fullsized":"2024-09-13T15:34:33.908669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910017+0000","last_change":"2024-09-13T15:34:33.910017+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910017+0000","last_undegraded":"2024-09-13T15:34:33.910017+0000","last_fullsized":"2024-09-13T15:34:33.910017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.907602+0000","last_change":"2024-09-13T15:34:33.907602+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.907602+0000","last_undegraded":"2024-09-13T15:34:33.907602+0000","last_fullsized":"2024-09-13T15:34:33.907602+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:31.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908875+0000","last_change":"2024-09-13T15:34:33.908875+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908875+0000","last_undegraded":"2024-09-13T15:34:33.908875+0000","last_fullsized":"2024-09-13T15:34:33.908875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909627+0000","last_change":"2024-09-13T15:34:33.909627+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909627+0000","last_undegraded":"2024-09-13T15:34:33.909627+0000","last_fullsized":"2024-09-13T15:34:33.909627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.906256+0000","last_change":"2024-09-13T15:34:33.906256+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.906256+0000","last_undegraded":"2024-09-13T15:34:33.906256+0000","last_fullsized":"2024-09-13T15:34:33.906256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.907702+0000","last_change":"2024-09-13T15:34:33.907702+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.907702+0000","last_undegraded":"2024-09-13T15:34:33.907702+0000","last_fullsized":"2024-09-13T15:34:33.907702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":138,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-09-13T15:34:30.222393+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:34:30.222393+0000","last_peered":"2024-09-13T15:34:30.222393+0000","last_clean":"2024-09-13T15:34:30.222393+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:34:30.222393+0000","last_undegraded":"2024-09-13T15:34:30.222393+0000","last_fullsized":"2024-09-13T15:34:30.222393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:42.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.903600+0000","last_change":"2024-09-13T15:34:33.903600+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.903600+0000","last_undegraded":"2024-09-13T15:34:33.903600+0000","last_fullsized":"2024-09-13T15:34:33.903600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.906492+0000","last_change":"2024-09-13T15:34:33.906492+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.906492+0000","last_undegraded":"2024-09-13T15:34:33.906492+0000","last_fullsized":"2024-09-13T15:34:33.906492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:47.211308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908292+0000","last_change":"2024-09-13T15:34:33.908292+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908292+0000","last_undegraded":"2024-09-13T15:34:33.908292+0000","last_fullsized":"2024-09-13T15:34:33.908292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:37.814369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909954+0000","last_change":"2024-09-13T15:34:33.909954+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909954+0000","last_undegraded":"2024-09-13T15:34:33.909954+0000","last_fullsized":"2024-09-13T15:34:33.909954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.904077+0000","last_change":"2024-09-13T15:34:33.904077+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.904077+0000","last_undegraded":"2024-09-13T15:34:33.904077+0000","last_fullsized":"2024-09-13T15:34:33.904077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.904960+0000","last_change":"2024-09-13T15:34:33.904960+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.904960+0000","last_undegraded":"2024-09-13T15:34:33.904960+0000","last_fullsized":"2024-09-13T15:34:33.904960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.905087+0000","last_change":"2024-09-13T15:34:33.905087+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.905087+0000","last_undegraded":"2024-09-13T15:34:33.905087+0000","last_fullsized":"2024-09-13T15:34:33.905087+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.905482+0000","last_change":"2024-09-13T15:34:33.905482+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.905482+0000","last_undegraded":"2024-09-13T15:34:33.905482+0000","last_fullsized":"2024-09-13T15:34:33.905482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908677+0000","last_change":"2024-09-13T15:34:33.908677+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908677+0000","last_undegraded":"2024-09-13T15:34:33.908677+0000","last_fullsized":"2024-09-13T15:34:33.908677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.903408+0000","last_change":"2024-09-13T15:34:33.903408+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.903408+0000","last_undegraded":"2024-09-13T15:34:33.903408+0000","last_fullsized":"2024-09-13T15:34:33.903408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.904350+0000","last_change":"2024-09-13T15:34:33.904350+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.904350+0000","last_undegraded":"2024-09-13T15:34:33.904350+0000","last_fullsized":"2024-09-13T15:34:33.904350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908749+0000","last_change":"2024-09-13T15:34:33.908749+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908749+0000","last_undegraded":"2024-09-13T15:34:33.908749+0000","last_fullsized":"2024-09-13T15:34:33.908749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909925+0000","last_change":"2024-09-13T15:34:33.909925+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909925+0000","last_undegraded":"2024-09-13T15:34:33.909925+0000","last_fullsized":"2024-09-13T15:34:33.909925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909766+0000","last_change":"2024-09-13T15:34:33.909766+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909766+0000","last_undegraded":"2024-09-13T15:34:33.909766+0000","last_fullsized":"2024-09-13T15:34:33.909766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910525+0000","last_change":"2024-09-13T15:34:33.910525+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910525+0000","last_undegraded":"2024-09-13T15:34:33.910525+0000","last_fullsized":"2024-09-13T15:34:33.910525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.911539+0000","last_change":"2024-09-13T15:34:33.911539+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.911539+0000","last_undegraded":"2024-09-13T15:34:33.911539+0000","last_fullsized":"2024-09-13T15:34:33.911539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27132,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":114688,"data_stored":30274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":617095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":617095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:34:39.690 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:34:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.851+0000 7feaf2755640 1 Processor -- start 2024-09-13T15:34:39.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.851+0000 7feaf2755640 1 -- start start 2024-09-13T15:34:39.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.851+0000 7feaf2755640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feaec0706b0 0x7feaec0b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.851+0000 7feaf2755640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaec0b6470 con 0x7feaec070a90 2024-09-13T15:34:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.851+0000 7feaf2755640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaec151710 con 0x7feaec0706b0 2024-09-13T15:34:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.851+0000 7feaebfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feaec0706b0 0x7feaec0b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.851+0000 7feae3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7feaec070a90 0x7feaec0713b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44340/0 (socket says 172.21.15.40:44340) 2024-09-13T15:34:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.851+0000 7feae3fff640 1 -- 172.21.15.40:0/3359057478 learned_addr learned my addr 172.21.15.40:0/3359057478 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.851+0000 7feaebfff640 1 -- 172.21.15.40:0/3359057478 >> v1:172.21.15.40:6789/0 conn(0x7feaec070a90 legacy=0x7feaec0713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.851+0000 7feaebfff640 1 -- 172.21.15.40:0/3359057478 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec150400 con 0x7feaec0706b0 2024-09-13T15:34:39.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.851+0000 7feaeb7fe640 1 -- 172.21.15.40:0/3359057478 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175849930 0 0) 0x7feaec0b6470 con 0x7feaec070a90 2024-09-13T15:34:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaebfff640 1 --2- 172.21.15.40:0/3359057478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaec0706b0 0x7feaec0b87e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fead4009740 tx=0x7fead401ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d07a68dae71e303 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaeb7fe640 1 -- 172.21.15.40:0/3359057478 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fead40a8840 con 0x7feaec0706b0 2024-09-13T15:34:39.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaeb7fe640 1 -- 172.21.15.40:0/3359057478 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead40a89a0 con 0x7feaec0706b0 2024-09-13T15:34:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaeb7fe640 1 -- 172.21.15.40:0/3359057478 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fead40a8c60 con 0x7feaec0706b0 2024-09-13T15:34:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 -- 172.21.15.40:0/3359057478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaec0706b0 msgr2=0x7feaec0b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 --2- 172.21.15.40:0/3359057478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaec0706b0 0x7feaec0b87e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fead4009740 tx=0x7fead401ec10 comp rx=0 tx=0).stop 2024-09-13T15:34:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 -- 172.21.15.40:0/3359057478 shutdown_connections 2024-09-13T15:34:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 --2- 172.21.15.40:0/3359057478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaec0706b0 0x7feaec0b87e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 -- 172.21.15.40:0/3359057478 >> 172.21.15.40:0/3359057478 conn(0x7feaec065d40 msgr2=0x7feaec066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 -- 172.21.15.40:0/3359057478 shutdown_connections 2024-09-13T15:34:39.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 -- 172.21.15.40:0/3359057478 wait complete. 2024-09-13T15:34:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 Processor -- start 2024-09-13T15:34:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 -- start start 2024-09-13T15:34:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaec0706b0 0x7feaec148830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:39.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec1e4f20 con 0x7feaec0706b0 2024-09-13T15:34:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaebfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaec0706b0 0x7feaec148830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaebfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaec0706b0 0x7feaec148830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49910/0 (socket says 172.21.15.40:49910) 2024-09-13T15:34:39.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaebfff640 1 -- 172.21.15.40:0/1961521129 learned_addr learned my addr 172.21.15.40:0/1961521129 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaebfff640 1 -- 172.21.15.40:0/1961521129 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4009420 con 0x7feaec0706b0 2024-09-13T15:34:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaebfff640 1 --2- 172.21.15.40:0/1961521129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaec0706b0 0x7feaec148830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fead401c840 tx=0x7fead401b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feae97fa640 1 -- 172.21.15.40:0/1961521129 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fead40b0800 con 0x7feaec0706b0 2024-09-13T15:34:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feae97fa640 1 -- 172.21.15.40:0/1961521129 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead40b0960 con 0x7feaec0706b0 2024-09-13T15:34:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 -- 172.21.15.40:0/1961521129 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaec071b50 con 0x7feaec0706b0 2024-09-13T15:34:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feae97fa640 1 -- 172.21.15.40:0/1961521129 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fead40b0c00 con 0x7feaec0706b0 2024-09-13T15:34:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.855+0000 7feaf2755640 1 -- 172.21.15.40:0/1961521129 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaec148d70 con 0x7feaec0706b0 2024-09-13T15:34:39.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.859+0000 7feaf2755640 1 -- 172.21.15.40:0/1961521129 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaec0b87e0 con 0x7feaec0706b0 2024-09-13T15:34:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.859+0000 7feae97fa640 1 -- 172.21.15.40:0/1961521129 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fead40b7040 con 0x7feaec0706b0 2024-09-13T15:34:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.859+0000 7feae97fa640 1 --2- 172.21.15.40:0/1961521129 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fead0035450 0x7fead0037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.859+0000 7feae97fa640 1 -- 172.21.15.40:0/1961521129 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7fead40e59c0 con 0x7feaec0706b0 2024-09-13T15:34:39.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.859+0000 7feae3fff640 1 --2- 172.21.15.40:0/1961521129 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fead0035450 0x7fead0037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:39.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.859+0000 7feae3fff640 1 --2- 172.21.15.40:0/1961521129 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fead0035450 0x7fead0037910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feadc007fd0 tx=0x7feadc007940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:39.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:39.863+0000 7feae97fa640 1 -- 172.21.15.40:0/1961521129 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fead40afe00 con 0x7feaec0706b0 2024-09-13T15:34:40.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.019+0000 7feaf2755640 1 -- 172.21.15.40:0/1961521129 --> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feaec066910 con 0x7fead0035450 2024-09-13T15:34:40.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.027+0000 7feae97fa640 1 -- 172.21.15.40:0/1961521129 <== mgr.4099 v2:172.21.15.40:6824/3185150828 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237813 (secure 0 0 0) 0x7feadc0070d0 con 0x7fead0035450 2024-09-13T15:34:40.030 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:40.032 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:34:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.027+0000 7feaf2755640 1 -- 172.21.15.40:0/1961521129 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fead0035450 msgr2=0x7fead0037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.027+0000 7feaf2755640 1 --2- 172.21.15.40:0/1961521129 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fead0035450 0x7fead0037910 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feadc007fd0 tx=0x7feadc007940 comp rx=0 tx=0).stop 2024-09-13T15:34:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.027+0000 7feaf2755640 1 -- 172.21.15.40:0/1961521129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaec0706b0 msgr2=0x7feaec148830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.027+0000 7feaf2755640 1 --2- 172.21.15.40:0/1961521129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaec0706b0 0x7feaec148830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fead401c840 tx=0x7fead401b9b0 comp rx=0 tx=0).stop 2024-09-13T15:34:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.027+0000 7feaf2755640 1 -- 172.21.15.40:0/1961521129 shutdown_connections 2024-09-13T15:34:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.027+0000 7feaf2755640 1 --2- 172.21.15.40:0/1961521129 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fead0035450 0x7fead0037910 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.027+0000 7feaf2755640 1 --2- 172.21.15.40:0/1961521129 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaec0706b0 0x7feaec148830 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:40.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.027+0000 7feaf2755640 1 -- 172.21.15.40:0/1961521129 >> 172.21.15.40:0/1961521129 conn(0x7feaec065d40 msgr2=0x7feaec14bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.027+0000 7feaf2755640 1 -- 172.21.15.40:0/1961521129 shutdown_connections 2024-09-13T15:34:40.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.031+0000 7feaf2755640 1 -- 172.21.15.40:0/1961521129 wait complete. 2024-09-13T15:34:40.048 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T15:34:39.057578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82540,"kb_used_data":1480,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032980,"statfs":{"total":289910292480,"available":289825771520,"internally_reserved":0,"allocated":1515520,"data_stored":1264464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.159410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.907241+0000","last_change":"2024-09-13T15:34:33.907241+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.907241+0000","last_undegraded":"2024-09-13T15:34:33.907241+0000","last_fullsized":"2024-09-13T15:34:33.907241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909196+0000","last_change":"2024-09-13T15:34:33.909196+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909196+0000","last_undegraded":"2024-09-13T15:34:33.909196+0000","last_fullsized":"2024-09-13T15:34:33.909196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.911411+0000","last_change":"2024-09-13T15:34:33.911411+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.911411+0000","last_undegraded":"2024-09-13T15:34:33.911411+0000","last_fullsized":"2024-09-13T15:34:33.911411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910463+0000","last_change":"2024-09-13T15:34:33.910463+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910463+0000","last_undegraded":"2024-09-13T15:34:33.910463+0000","last_fullsized":"2024-09-13T15:34:33.910463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.906764+0000","last_change":"2024-09-13T15:34:33.906764+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.906764+0000","last_undegraded":"2024-09-13T15:34:33.906764+0000","last_fullsized":"2024-09-13T15:34:33.906764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909659+0000","last_change":"2024-09-13T15:34:33.909659+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909659+0000","last_undegraded":"2024-09-13T15:34:33.909659+0000","last_fullsized":"2024-09-13T15:34:33.909659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908766+0000","last_change":"2024-09-13T15:34:33.908766+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908766+0000","last_undegraded":"2024-09-13T15:34:33.908766+0000","last_fullsized":"2024-09-13T15:34:33.908766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908399+0000","last_change":"2024-09-13T15:34:33.908399+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908399+0000","last_undegraded":"2024-09-13T15:34:33.908399+0000","last_fullsized":"2024-09-13T15:34:33.908399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910778+0000","last_change":"2024-09-13T15:34:33.910778+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910778+0000","last_undegraded":"2024-09-13T15:34:33.910778+0000","last_fullsized":"2024-09-13T15:34:33.910778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908669+0000","last_change":"2024-09-13T15:34:33.908669+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908669+0000","last_undegraded":"2024-09-13T15:34:33.908669+0000","last_fullsized":"2024-09-13T15:34:33.908669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910017+0000","last_change":"2024-09-13T15:34:33.910017+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910017+0000","last_undegraded":"2024-09-13T15:34:33.910017+0000","last_fullsized":"2024-09-13T15:34:33.910017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.907602+0000","last_change":"2024-09-13T15:34:33.907602+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.907602+0000","last_undegraded":"2024-09-13T15:34:33.907602+0000","last_fullsized":"2024-09-13T15:34:33.907602+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:31.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908875+0000","last_change":"2024-09-13T15:34:33.908875+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908875+0000","last_undegraded":"2024-09-13T15:34:33.908875+0000","last_fullsized":"2024-09-13T15:34:33.908875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909627+0000","last_change":"2024-09-13T15:34:33.909627+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909627+0000","last_undegraded":"2024-09-13T15:34:33.909627+0000","last_fullsized":"2024-09-13T15:34:33.909627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.906256+0000","last_change":"2024-09-13T15:34:33.906256+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.906256+0000","last_undegraded":"2024-09-13T15:34:33.906256+0000","last_fullsized":"2024-09-13T15:34:33.906256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.907702+0000","last_change":"2024-09-13T15:34:33.907702+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.907702+0000","last_undegraded":"2024-09-13T15:34:33.907702+0000","last_fullsized":"2024-09-13T15:34:33.907702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":138,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-09-13T15:34:30.222393+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:34:30.222393+0000","last_peered":"2024-09-13T15:34:30.222393+0000","last_clean":"2024-09-13T15:34:30.222393+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:34:30.222393+0000","last_undegraded":"2024-09-13T15:34:30.222393+0000","last_fullsized":"2024-09-13T15:34:30.222393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:42.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.903600+0000","last_change":"2024-09-13T15:34:33.903600+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.903600+0000","last_undegraded":"2024-09-13T15:34:33.903600+0000","last_fullsized":"2024-09-13T15:34:33.903600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.906492+0000","last_change":"2024-09-13T15:34:33.906492+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.906492+0000","last_undegraded":"2024-09-13T15:34:33.906492+0000","last_fullsized":"2024-09-13T15:34:33.906492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:47.211308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908292+0000","last_change":"2024-09-13T15:34:33.908292+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908292+0000","last_undegraded":"2024-09-13T15:34:33.908292+0000","last_fullsized":"2024-09-13T15:34:33.908292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:37.814369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909954+0000","last_change":"2024-09-13T15:34:33.909954+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909954+0000","last_undegraded":"2024-09-13T15:34:33.909954+0000","last_fullsized":"2024-09-13T15:34:33.909954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.904077+0000","last_change":"2024-09-13T15:34:33.904077+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.904077+0000","last_undegraded":"2024-09-13T15:34:33.904077+0000","last_fullsized":"2024-09-13T15:34:33.904077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.904960+0000","last_change":"2024-09-13T15:34:33.904960+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.904960+0000","last_undegraded":"2024-09-13T15:34:33.904960+0000","last_fullsized":"2024-09-13T15:34:33.904960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.905087+0000","last_change":"2024-09-13T15:34:33.905087+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.905087+0000","last_undegraded":"2024-09-13T15:34:33.905087+0000","last_fullsized":"2024-09-13T15:34:33.905087+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.905482+0000","last_change":"2024-09-13T15:34:33.905482+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.905482+0000","last_undegraded":"2024-09-13T15:34:33.905482+0000","last_fullsized":"2024-09-13T15:34:33.905482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908677+0000","last_change":"2024-09-13T15:34:33.908677+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908677+0000","last_undegraded":"2024-09-13T15:34:33.908677+0000","last_fullsized":"2024-09-13T15:34:33.908677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.903408+0000","last_change":"2024-09-13T15:34:33.903408+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.903408+0000","last_undegraded":"2024-09-13T15:34:33.903408+0000","last_fullsized":"2024-09-13T15:34:33.903408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.904350+0000","last_change":"2024-09-13T15:34:33.904350+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.904350+0000","last_undegraded":"2024-09-13T15:34:33.904350+0000","last_fullsized":"2024-09-13T15:34:33.904350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908749+0000","last_change":"2024-09-13T15:34:33.908749+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908749+0000","last_undegraded":"2024-09-13T15:34:33.908749+0000","last_fullsized":"2024-09-13T15:34:33.908749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909925+0000","last_change":"2024-09-13T15:34:33.909925+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909925+0000","last_undegraded":"2024-09-13T15:34:33.909925+0000","last_fullsized":"2024-09-13T15:34:33.909925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909766+0000","last_change":"2024-09-13T15:34:33.909766+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909766+0000","last_undegraded":"2024-09-13T15:34:33.909766+0000","last_fullsized":"2024-09-13T15:34:33.909766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910525+0000","last_change":"2024-09-13T15:34:33.910525+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910525+0000","last_undegraded":"2024-09-13T15:34:33.910525+0000","last_fullsized":"2024-09-13T15:34:33.910525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.911539+0000","last_change":"2024-09-13T15:34:33.911539+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.911539+0000","last_undegraded":"2024-09-13T15:34:33.911539+0000","last_fullsized":"2024-09-13T15:34:33.911539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27132,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":114688,"data_stored":30274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":617095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":617095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:34:40.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2024-09-13T15:34:40.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-09-13T15:34:40.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-09-13T15:34:40.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2024-09-13T15:34:40.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2024-09-13T15:34:40.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2024-09-13T15:34:40.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2024-09-13T15:34:40.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-09-13T15:34:40.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2024-09-13T15:34:40.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2024-09-13T15:34:40.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2024-09-13T15:34:40.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2024-09-13T15:34:40.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2024-09-13T15:34:40.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-09-13T15:34:40.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-09-13T15:34:40.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2024-09-13T15:34:40.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2024-09-13T15:34:40.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2024-09-13T15:34:40.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2024-09-13T15:34:40.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2024-09-13T15:34:40.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-09-13T15:34:40.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2024-09-13T15:34:40.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-09-13T15:34:40.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2024-09-13T15:34:40.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-09-13T15:34:40.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2024-09-13T15:34:40.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2024-09-13T15:34:40.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2024-09-13T15:34:40.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-09-13T15:34:40.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2024-09-13T15:34:40.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2024-09-13T15:34:40.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2024-09-13T15:34:40.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2024-09-13T15:34:40.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-09-13T15:34:40.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.907241+0000', 'last_change': '2024-09-13T15:34:33.907241+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.907241+0000', 'last_undegraded': '2024-09-13T15:34:33.907241+0000', 'last_fullsized': '2024-09-13T15:34:33.907241+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T15:34:40.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-09-13T15:34:40.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2024-09-13T15:34:40.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.909196+0000', 'last_change': '2024-09-13T15:34:33.909196+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.909196+0000', 'last_undegraded': '2024-09-13T15:34:33.909196+0000', 'last_fullsized': '2024-09-13T15:34:33.909196+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T15:34:40.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2024-09-13T15:34:40.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.911411+0000', 'last_change': '2024-09-13T15:34:33.911411+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.911411+0000', 'last_undegraded': '2024-09-13T15:34:33.911411+0000', 'last_fullsized': '2024-09-13T15:34:33.911411+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T15:34:40.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-09-13T15:34:40.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2024-09-13T15:34:40.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.910463+0000', 'last_change': '2024-09-13T15:34:33.910463+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.910463+0000', 'last_undegraded': '2024-09-13T15:34:33.910463+0000', 'last_fullsized': '2024-09-13T15:34:33.910463+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T15:34:40.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-09-13T15:34:40.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2024-09-13T15:34:40.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.906764+0000', 'last_change': '2024-09-13T15:34:33.906764+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.906764+0000', 'last_undegraded': '2024-09-13T15:34:33.906764+0000', 'last_fullsized': '2024-09-13T15:34:33.906764+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T15:34:40.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2024-09-13T15:34:40.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2024-09-13T15:34:40.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.909659+0000', 'last_change': '2024-09-13T15:34:33.909659+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.909659+0000', 'last_undegraded': '2024-09-13T15:34:33.909659+0000', 'last_fullsized': '2024-09-13T15:34:33.909659+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T15:34:40.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-09-13T15:34:40.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2024-09-13T15:34:40.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.908766+0000', 'last_change': '2024-09-13T15:34:33.908766+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.908766+0000', 'last_undegraded': '2024-09-13T15:34:33.908766+0000', 'last_fullsized': '2024-09-13T15:34:33.908766+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T15:34:40.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2024-09-13T15:34:40.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2024-09-13T15:34:40.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.908399+0000', 'last_change': '2024-09-13T15:34:33.908399+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.908399+0000', 'last_undegraded': '2024-09-13T15:34:33.908399+0000', 'last_fullsized': '2024-09-13T15:34:33.908399+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T15:34:40.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2024-09-13T15:34:40.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2024-09-13T15:34:40.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.910778+0000', 'last_change': '2024-09-13T15:34:33.910778+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.910778+0000', 'last_undegraded': '2024-09-13T15:34:33.910778+0000', 'last_fullsized': '2024-09-13T15:34:33.910778+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T15:34:40.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-09-13T15:34:40.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2024-09-13T15:34:40.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.908669+0000', 'last_change': '2024-09-13T15:34:33.908669+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.908669+0000', 'last_undegraded': '2024-09-13T15:34:33.908669+0000', 'last_fullsized': '2024-09-13T15:34:33.908669+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T15:34:40.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2024-09-13T15:34:40.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2024-09-13T15:34:40.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.910017+0000', 'last_change': '2024-09-13T15:34:33.910017+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.910017+0000', 'last_undegraded': '2024-09-13T15:34:33.910017+0000', 'last_fullsized': '2024-09-13T15:34:33.910017+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T15:34:40.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2024-09-13T15:34:40.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2024-09-13T15:34:40.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.907602+0000', 'last_change': '2024-09-13T15:34:33.907602+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.907602+0000', 'last_undegraded': '2024-09-13T15:34:33.907602+0000', 'last_fullsized': '2024-09-13T15:34:33.907602+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:23:31.743728+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T15:34:40.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2024-09-13T15:34:40.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2024-09-13T15:34:40.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.908875+0000', 'last_change': '2024-09-13T15:34:33.908875+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.908875+0000', 'last_undegraded': '2024-09-13T15:34:33.908875+0000', 'last_fullsized': '2024-09-13T15:34:33.908875+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T15:34:40.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2024-09-13T15:34:40.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2024-09-13T15:34:40.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.909627+0000', 'last_change': '2024-09-13T15:34:33.909627+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.909627+0000', 'last_undegraded': '2024-09-13T15:34:33.909627+0000', 'last_fullsized': '2024-09-13T15:34:33.909627+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T15:34:40.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2024-09-13T15:34:40.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-09-13T15:34:40.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.906256+0000', 'last_change': '2024-09-13T15:34:33.906256+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.906256+0000', 'last_undegraded': '2024-09-13T15:34:33.906256+0000', 'last_fullsized': '2024-09-13T15:34:33.906256+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T15:34:40.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2024-09-13T15:34:40.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2024-09-13T15:34:40.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.907702+0000', 'last_change': '2024-09-13T15:34:33.907702+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.907702+0000', 'last_undegraded': '2024-09-13T15:34:33.907702+0000', 'last_fullsized': '2024-09-13T15:34:33.907702+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T15:34:40.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2024-09-13T15:34:40.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2024-09-13T15:34:40.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.903600+0000', 'last_change': '2024-09-13T15:34:33.903600+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.903600+0000', 'last_undegraded': '2024-09-13T15:34:33.903600+0000', 'last_fullsized': '2024-09-13T15:34:33.903600+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T15:34:40.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-09-13T15:34:40.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2024-09-13T15:34:40.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.906492+0000', 'last_change': '2024-09-13T15:34:33.906492+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.906492+0000', 'last_undegraded': '2024-09-13T15:34:33.906492+0000', 'last_fullsized': '2024-09-13T15:34:33.906492+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:02:47.211308+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T15:34:40.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-09-13T15:34:40.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2024-09-13T15:34:40.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.908292+0000', 'last_change': '2024-09-13T15:34:33.908292+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.908292+0000', 'last_undegraded': '2024-09-13T15:34:33.908292+0000', 'last_fullsized': '2024-09-13T15:34:33.908292+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T17:27:37.814369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T15:34:40.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-09-13T15:34:40.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2024-09-13T15:34:40.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.909954+0000', 'last_change': '2024-09-13T15:34:33.909954+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.909954+0000', 'last_undegraded': '2024-09-13T15:34:33.909954+0000', 'last_fullsized': '2024-09-13T15:34:33.909954+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T15:34:40.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2024-09-13T15:34:40.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-09-13T15:34:40.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.904077+0000', 'last_change': '2024-09-13T15:34:33.904077+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.904077+0000', 'last_undegraded': '2024-09-13T15:34:33.904077+0000', 'last_fullsized': '2024-09-13T15:34:33.904077+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T15:34:40.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2024-09-13T15:34:40.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2024-09-13T15:34:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.904960+0000', 'last_change': '2024-09-13T15:34:33.904960+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.904960+0000', 'last_undegraded': '2024-09-13T15:34:33.904960+0000', 'last_fullsized': '2024-09-13T15:34:33.904960+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T15:34:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-09-13T15:34:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2024-09-13T15:34:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.905087+0000', 'last_change': '2024-09-13T15:34:33.905087+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.905087+0000', 'last_undegraded': '2024-09-13T15:34:33.905087+0000', 'last_fullsized': '2024-09-13T15:34:33.905087+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T15:34:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-09-13T15:34:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2024-09-13T15:34:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.905482+0000', 'last_change': '2024-09-13T15:34:33.905482+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.905482+0000', 'last_undegraded': '2024-09-13T15:34:33.905482+0000', 'last_fullsized': '2024-09-13T15:34:33.905482+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T15:34:40.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-09-13T15:34:40.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2024-09-13T15:34:40.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.908677+0000', 'last_change': '2024-09-13T15:34:33.908677+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.908677+0000', 'last_undegraded': '2024-09-13T15:34:33.908677+0000', 'last_fullsized': '2024-09-13T15:34:33.908677+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T15:34:40.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2024-09-13T15:34:40.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2024-09-13T15:34:40.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.903408+0000', 'last_change': '2024-09-13T15:34:33.903408+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.903408+0000', 'last_undegraded': '2024-09-13T15:34:33.903408+0000', 'last_fullsized': '2024-09-13T15:34:33.903408+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T15:34:40.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2024-09-13T15:34:40.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2024-09-13T15:34:40.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.904350+0000', 'last_change': '2024-09-13T15:34:33.904350+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.904350+0000', 'last_undegraded': '2024-09-13T15:34:33.904350+0000', 'last_fullsized': '2024-09-13T15:34:33.904350+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-13T15:34:40.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-09-13T15:34:40.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2024-09-13T15:34:40.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.908749+0000', 'last_change': '2024-09-13T15:34:33.908749+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.908749+0000', 'last_undegraded': '2024-09-13T15:34:33.908749+0000', 'last_fullsized': '2024-09-13T15:34:33.908749+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T15:34:40.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2024-09-13T15:34:40.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2024-09-13T15:34:40.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2024-09-13T15:34:40.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.909925+0000', 'last_change': '2024-09-13T15:34:33.909925+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.909925+0000', 'last_undegraded': '2024-09-13T15:34:33.909925+0000', 'last_fullsized': '2024-09-13T15:34:33.909925+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T15:34:40.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2024-09-13T15:34:40.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2024-09-13T15:34:40.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.909766+0000', 'last_change': '2024-09-13T15:34:33.909766+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.909766+0000', 'last_undegraded': '2024-09-13T15:34:33.909766+0000', 'last_fullsized': '2024-09-13T15:34:33.909766+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T15:34:40.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-09-13T15:34:40.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-09-13T15:34:40.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.910525+0000', 'last_change': '2024-09-13T15:34:33.910525+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.910525+0000', 'last_undegraded': '2024-09-13T15:34:33.910525+0000', 'last_fullsized': '2024-09-13T15:34:33.910525+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-13T15:34:40.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-09-13T15:34:40.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T15:34:34.897425+0000', 'last_change': '2024-09-13T15:34:34.897425+0000', 'last_active': '2024-09-13T15:34:34.897425+0000', 'last_peered': '2024-09-13T15:34:34.897425+0000', 'last_clean': '2024-09-13T15:34:34.897425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:34.897425+0000', 'last_undegraded': '2024-09-13T15:34:34.897425+0000', 'last_fullsized': '2024-09-13T15:34:34.897425+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:34.897425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T15:34:40.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2024-09-13T15:34:40.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 13, 'state': 'creating+peering', 'last_fresh': '2024-09-13T15:34:33.911539+0000', 'last_change': '2024-09-13T15:34:33.911539+0000', 'last_active': '2024-09-13T15:34:33.891919+0000', 'last_peered': '2024-09-13T15:34:33.891919+0000', 'last_clean': '2024-09-13T15:34:33.891919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T15:34:33.911539+0000', 'last_undegraded': '2024-09-13T15:34:33.911539+0000', 'last_fullsized': '2024-09-13T15:34:33.911539+0000', 'mapping_epoch': 13, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 13, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'last_clean_scrub_stamp': '2024-09-13T15:34:33.891919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-13T15:34:40.073 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T15:34:40.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.211+0000 7f6f43aa9640 1 Processor -- start 2024-09-13T15:34:40.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.211+0000 7f6f43aa9640 1 -- start start 2024-09-13T15:34:40.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f43aa9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f3c06f360 0x7f6f3c0bbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:40.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f43aa9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c0bcc70 con 0x7f6f3c06ef80 2024-09-13T15:34:40.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f43aa9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c0bc240 con 0x7f6f3c06f360 2024-09-13T15:34:40.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f41845640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6f3c06ef80 0x7f6f3c069f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44354/0 (socket says 172.21.15.40:44354) 2024-09-13T15:34:40.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f41845640 1 -- 172.21.15.40:0/1557011030 learned_addr learned my addr 172.21.15.40:0/1557011030 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:40.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f41044640 1 --2- 172.21.15.40:0/1557011030 >> v2:172.21.15.40:3300/0 conn(0x7f6f3c06f360 0x7f6f3c0bbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:40.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f40843640 1 -- 172.21.15.40:0/1557011030 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959011054 0 0) 0x7f6f3c0bcc70 con 0x7f6f3c06ef80 2024-09-13T15:34:40.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f40843640 1 -- 172.21.15.40:0/1557011030 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f28003530 con 0x7f6f3c06ef80 2024-09-13T15:34:40.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f41044640 1 -- 172.21.15.40:0/1557011030 >> v1:172.21.15.40:6789/0 conn(0x7f6f3c06ef80 legacy=0x7f6f3c069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:40.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f41044640 1 -- 172.21.15.40:0/1557011030 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c1536f0 con 0x7f6f3c06f360 2024-09-13T15:34:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f41044640 1 --2- 172.21.15.40:0/1557011030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c06f360 0x7f6f3c0bbd00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009740 tx=0x7f6f3801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b5e660e57c0a3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f40843640 1 -- 172.21.15.40:0/1557011030 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f380ab530 con 0x7f6f3c06f360 2024-09-13T15:34:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f40843640 1 -- 172.21.15.40:0/1557011030 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f380a7050 con 0x7f6f3c06f360 2024-09-13T15:34:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.215+0000 7f6f40843640 1 -- 172.21.15.40:0/1557011030 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f380ab7e0 con 0x7f6f3c06f360 2024-09-13T15:34:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f43aa9640 1 -- 172.21.15.40:0/1557011030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c06f360 msgr2=0x7f6f3c0bbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f43aa9640 1 --2- 172.21.15.40:0/1557011030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c06f360 0x7f6f3c0bbd00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009740 tx=0x7f6f3801c390 comp rx=0 tx=0).stop 2024-09-13T15:34:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f43aa9640 1 -- 172.21.15.40:0/1557011030 shutdown_connections 2024-09-13T15:34:40.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f43aa9640 1 --2- 172.21.15.40:0/1557011030 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c06f360 0x7f6f3c0bbd00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:40.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f43aa9640 1 -- 172.21.15.40:0/1557011030 >> 172.21.15.40:0/1557011030 conn(0x7f6f3c070a80 msgr2=0x7f6f3c070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:40.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f43aa9640 1 -- 172.21.15.40:0/1557011030 shutdown_connections 2024-09-13T15:34:40.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f43aa9640 1 -- 172.21.15.40:0/1557011030 wait complete. 2024-09-13T15:34:40.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f43aa9640 1 Processor -- start 2024-09-13T15:34:40.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f43aa9640 1 -- start start 2024-09-13T15:34:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f43aa9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c06ef80 0x7f6f3c145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f43aa9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c154740 con 0x7f6f3c06ef80 2024-09-13T15:34:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f41845640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c06ef80 0x7f6f3c145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f41845640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c06ef80 0x7f6f3c145f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49932/0 (socket says 172.21.15.40:49932) 2024-09-13T15:34:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f41845640 1 -- 172.21.15.40:0/967953802 learned_addr learned my addr 172.21.15.40:0/967953802 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f41845640 1 -- 172.21.15.40:0/967953802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f38009420 con 0x7f6f3c06ef80 2024-09-13T15:34:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.219+0000 7f6f41845640 1 --2- 172.21.15.40:0/967953802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c06ef80 0x7f6f3c145f10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00c450 tx=0x7f6f2c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.223+0000 7f6f327fc640 1 -- 172.21.15.40:0/967953802 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f2c005c20 con 0x7f6f3c06ef80 2024-09-13T15:34:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.223+0000 7f6f327fc640 1 -- 172.21.15.40:0/967953802 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c005d80 con 0x7f6f3c06ef80 2024-09-13T15:34:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.223+0000 7f6f43aa9640 1 -- 172.21.15.40:0/967953802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c156ee0 con 0x7f6f3c06ef80 2024-09-13T15:34:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.223+0000 7f6f327fc640 1 -- 172.21.15.40:0/967953802 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f2c0071a0 con 0x7f6f3c06ef80 2024-09-13T15:34:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.223+0000 7f6f43aa9640 1 -- 172.21.15.40:0/967953802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c162540 con 0x7f6f3c06ef80 2024-09-13T15:34:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.223+0000 7f6f327fc640 1 -- 172.21.15.40:0/967953802 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f6f2c007300 con 0x7f6f3c06ef80 2024-09-13T15:34:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.223+0000 7f6f43aa9640 1 -- 172.21.15.40:0/967953802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c0bbd00 con 0x7f6f3c06ef80 2024-09-13T15:34:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.223+0000 7f6f327fc640 1 --2- 172.21.15.40:0/967953802 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6f20035450 0x7f6f20037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.223+0000 7f6f327fc640 1 -- 172.21.15.40:0/967953802 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f6f2c046b30 con 0x7f6f3c06ef80 2024-09-13T15:34:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.223+0000 7f6f41044640 1 --2- 172.21.15.40:0/967953802 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6f20035450 0x7f6f20037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:40.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.223+0000 7f6f41044640 1 --2- 172.21.15.40:0/967953802 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6f20035450 0x7f6f20037910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f380ad000 tx=0x7f6f38008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:40.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.227+0000 7f6f327fc640 1 -- 172.21.15.40:0/967953802 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6f2c010b80 con 0x7f6f3c06ef80 2024-09-13T15:34:40.346 INFO:tasks.ceph.mds.e.smithi040.stderr:2024-09-13T15:34:40.343+0000 7f8d3ec34640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:34:40.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.439+0000 7f6f43aa9640 1 -- 172.21.15.40:0/967953802 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6f3c0bf8f0 con 0x7f6f3c06ef80 2024-09-13T15:34:40.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.439+0000 7f6f327fc640 1 -- 172.21.15.40:0/967953802 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1093 (secure 0 0 0) 0x7f6f2c017070 con 0x7f6f3c06ef80 2024-09-13T15:34:40.443 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:40.443 INFO:teuthology.orchestra.run.smithi040.stdout:{"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":26,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":1},"osdmap":{"epoch":16,"num_osds":3,"num_up_osds":3,"osd_up_since":1726241663,"num_in_osds":3,"osd_in_since":1726241655,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":84520960,"bytes_avail":289825771520,"bytes_total":289910292480,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"e","status":"up:active","gid":4153}],"up:standby":4},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-13T15:34:14.134500+0000","services":{}},"progress_events":{}} 2024-09-13T15:34:40.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.443+0000 7f6f43aa9640 1 -- 172.21.15.40:0/967953802 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6f20035450 msgr2=0x7f6f20037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:40.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.443+0000 7f6f43aa9640 1 --2- 172.21.15.40:0/967953802 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6f20035450 0x7f6f20037910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f380ad000 tx=0x7f6f38008040 comp rx=0 tx=0).stop 2024-09-13T15:34:40.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.443+0000 7f6f43aa9640 1 -- 172.21.15.40:0/967953802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c06ef80 msgr2=0x7f6f3c145f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:40.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.443+0000 7f6f43aa9640 1 --2- 172.21.15.40:0/967953802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c06ef80 0x7f6f3c145f10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c00c450 tx=0x7f6f2c00c910 comp rx=0 tx=0).stop 2024-09-13T15:34:40.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.443+0000 7f6f43aa9640 1 -- 172.21.15.40:0/967953802 shutdown_connections 2024-09-13T15:34:40.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.443+0000 7f6f43aa9640 1 --2- 172.21.15.40:0/967953802 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6f20035450 0x7f6f20037910 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:40.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.443+0000 7f6f43aa9640 1 --2- 172.21.15.40:0/967953802 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f3c06ef80 0x7f6f3c145f10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:40.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.443+0000 7f6f43aa9640 1 -- 172.21.15.40:0/967953802 >> 172.21.15.40:0/967953802 conn(0x7f6f3c070a80 msgr2=0x7f6f3c14de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:40.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.443+0000 7f6f43aa9640 1 -- 172.21.15.40:0/967953802 shutdown_connections 2024-09-13T15:34:40.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.443+0000 7f6f43aa9640 1 -- 172.21.15.40:0/967953802 wait complete. 2024-09-13T15:34:40.460 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T15:34:40.460 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:34:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f3599396640 1 Processor -- start 2024-09-13T15:34:40.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f3599396640 1 -- start start 2024-09-13T15:34:40.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f3599396640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35940bebb0 0x7f35940a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:40.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f3599396640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35941515b0 con 0x7f35940b4010 2024-09-13T15:34:40.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f3599396640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359414e2c0 con 0x7f35940bebb0 2024-09-13T15:34:40.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f3592ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35940bebb0 0x7f35940a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:40.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f35927fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f35940b4010 0x7f359406e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44368/0 (socket says 172.21.15.40:44368) 2024-09-13T15:34:40.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f35927fc640 1 -- 172.21.15.40:0/3369525877 learned_addr learned my addr 172.21.15.40:0/3369525877 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:40.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f3592ffd640 1 -- 172.21.15.40:0/3369525877 >> v1:172.21.15.40:6789/0 conn(0x7f35940b4010 legacy=0x7f359406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:40.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f3592ffd640 1 -- 172.21.15.40:0/3369525877 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359406f830 con 0x7f35940bebb0 2024-09-13T15:34:40.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f3591ffb640 1 -- 172.21.15.40:0/3369525877 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059083352 0 0) 0x7f35941515b0 con 0x7f35940b4010 2024-09-13T15:34:40.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f3592ffd640 1 --2- 172.21.15.40:0/3369525877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35940bebb0 0x7f35940a4d70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3584009740 tx=0x7f358401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2a8ceea06e7b63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:40.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.579+0000 7f3591ffb640 1 -- 172.21.15.40:0/3369525877 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35940b6bc0 con 0x7f35940bebb0 2024-09-13T15:34:40.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3591ffb640 1 -- 172.21.15.40:0/3369525877 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35840a7050 con 0x7f35940bebb0 2024-09-13T15:34:40.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3591ffb640 1 -- 172.21.15.40:0/3369525877 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35840ab680 con 0x7f35940bebb0 2024-09-13T15:34:40.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 -- 172.21.15.40:0/3369525877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35940bebb0 msgr2=0x7f35940a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:40.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 --2- 172.21.15.40:0/3369525877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35940bebb0 0x7f35940a4d70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3584009740 tx=0x7f358401c420 comp rx=0 tx=0).stop 2024-09-13T15:34:40.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 -- 172.21.15.40:0/3369525877 shutdown_connections 2024-09-13T15:34:40.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 --2- 172.21.15.40:0/3369525877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35940bebb0 0x7f35940a4d70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:40.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 -- 172.21.15.40:0/3369525877 >> 172.21.15.40:0/3369525877 conn(0x7f359406a540 msgr2=0x7f35940a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:40.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 -- 172.21.15.40:0/3369525877 shutdown_connections 2024-09-13T15:34:40.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 -- 172.21.15.40:0/3369525877 wait complete. 2024-09-13T15:34:40.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 Processor -- start 2024-09-13T15:34:40.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 -- start start 2024-09-13T15:34:40.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35940b4010 0x7f359415f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:40.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3594099ab0 con 0x7f35940b4010 2024-09-13T15:34:40.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3592ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35940b4010 0x7f359415f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:40.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3592ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35940b4010 0x7f359415f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49950/0 (socket says 172.21.15.40:49950) 2024-09-13T15:34:40.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3592ffd640 1 -- 172.21.15.40:0/5530932 learned_addr learned my addr 172.21.15.40:0/5530932 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:40.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3592ffd640 1 -- 172.21.15.40:0/5530932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3584009420 con 0x7f35940b4010 2024-09-13T15:34:40.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3592ffd640 1 --2- 172.21.15.40:0/5530932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35940b4010 0x7f359415f560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f358401a050 tx=0x7f358401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:40.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f357b7fe640 1 -- 172.21.15.40:0/5530932 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3584004150 con 0x7f35940b4010 2024-09-13T15:34:40.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f357b7fe640 1 -- 172.21.15.40:0/5530932 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35840042b0 con 0x7f35940b4010 2024-09-13T15:34:40.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 -- 172.21.15.40:0/5530932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35941e8370 con 0x7f35940b4010 2024-09-13T15:34:40.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f357b7fe640 1 -- 172.21.15.40:0/5530932 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3584003620 con 0x7f35940b4010 2024-09-13T15:34:40.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.583+0000 7f3599396640 1 -- 172.21.15.40:0/5530932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35941e9de0 con 0x7f35940b4010 2024-09-13T15:34:40.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.587+0000 7f357b7fe640 1 -- 172.21.15.40:0/5530932 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f35840b2050 con 0x7f35940b4010 2024-09-13T15:34:40.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.587+0000 7f3599396640 1 -- 172.21.15.40:0/5530932 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35940a4d70 con 0x7f35940b4010 2024-09-13T15:34:40.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.587+0000 7f357b7fe640 1 --2- 172.21.15.40:0/5530932 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3580035450 0x7f3580037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:40.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.587+0000 7f357b7fe640 1 -- 172.21.15.40:0/5530932 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f35840e1d90 con 0x7f35940b4010 2024-09-13T15:34:40.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.587+0000 7f35927fc640 1 --2- 172.21.15.40:0/5530932 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3580035450 0x7f3580037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:40.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.587+0000 7f35927fc640 1 --2- 172.21.15.40:0/5530932 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3580035450 0x7f3580037910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3588007fd0 tx=0x7f3588007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:40.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.591+0000 7f357b7fe640 1 -- 172.21.15.40:0/5530932 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f35840b28f0 con 0x7f35940b4010 2024-09-13T15:34:40.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.747+0000 7f3599396640 1 -- 172.21.15.40:0/5530932 --> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3594099c50 con 0x7f3580035450 2024-09-13T15:34:40.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.763+0000 7f357b7fe640 1 -- 172.21.15.40:0/5530932 <== mgr.4099 v2:172.21.15.40:6824/3185150828 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+237813 (secure 0 0 0) 0x7f3594099c50 con 0x7f3580035450 2024-09-13T15:34:40.769 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:40.771 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:34:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.767+0000 7f3599396640 1 -- 172.21.15.40:0/5530932 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3580035450 msgr2=0x7f3580037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.767+0000 7f3599396640 1 --2- 172.21.15.40:0/5530932 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3580035450 0x7f3580037910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3588007fd0 tx=0x7f3588007920 comp rx=0 tx=0).stop 2024-09-13T15:34:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.767+0000 7f3599396640 1 -- 172.21.15.40:0/5530932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35940b4010 msgr2=0x7f359415f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.767+0000 7f3599396640 1 --2- 172.21.15.40:0/5530932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35940b4010 0x7f359415f560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f358401a050 tx=0x7f358401ac60 comp rx=0 tx=0).stop 2024-09-13T15:34:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.767+0000 7f3599396640 1 -- 172.21.15.40:0/5530932 shutdown_connections 2024-09-13T15:34:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.767+0000 7f3599396640 1 --2- 172.21.15.40:0/5530932 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3580035450 0x7f3580037910 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.767+0000 7f3599396640 1 --2- 172.21.15.40:0/5530932 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35940b4010 0x7f359415f560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.767+0000 7f3599396640 1 -- 172.21.15.40:0/5530932 >> 172.21.15.40:0/5530932 conn(0x7f359406a540 msgr2=0x7f35940be070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.767+0000 7f3599396640 1 -- 172.21.15.40:0/5530932 shutdown_connections 2024-09-13T15:34:40.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:40.767+0000 7f3599396640 1 -- 172.21.15.40:0/5530932 wait complete. 2024-09-13T15:34:40.788 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-13T15:34:39.057578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82540,"kb_used_data":1480,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032980,"statfs":{"total":289910292480,"available":289825771520,"internally_reserved":0,"allocated":1515520,"data_stored":1264464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.159410"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.907241+0000","last_change":"2024-09-13T15:34:33.907241+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.907241+0000","last_undegraded":"2024-09-13T15:34:33.907241+0000","last_fullsized":"2024-09-13T15:34:33.907241+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909196+0000","last_change":"2024-09-13T15:34:33.909196+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909196+0000","last_undegraded":"2024-09-13T15:34:33.909196+0000","last_fullsized":"2024-09-13T15:34:33.909196+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.911411+0000","last_change":"2024-09-13T15:34:33.911411+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.911411+0000","last_undegraded":"2024-09-13T15:34:33.911411+0000","last_fullsized":"2024-09-13T15:34:33.911411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910463+0000","last_change":"2024-09-13T15:34:33.910463+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910463+0000","last_undegraded":"2024-09-13T15:34:33.910463+0000","last_fullsized":"2024-09-13T15:34:33.910463+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.906764+0000","last_change":"2024-09-13T15:34:33.906764+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.906764+0000","last_undegraded":"2024-09-13T15:34:33.906764+0000","last_fullsized":"2024-09-13T15:34:33.906764+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909659+0000","last_change":"2024-09-13T15:34:33.909659+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909659+0000","last_undegraded":"2024-09-13T15:34:33.909659+0000","last_fullsized":"2024-09-13T15:34:33.909659+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908766+0000","last_change":"2024-09-13T15:34:33.908766+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908766+0000","last_undegraded":"2024-09-13T15:34:33.908766+0000","last_fullsized":"2024-09-13T15:34:33.908766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908399+0000","last_change":"2024-09-13T15:34:33.908399+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908399+0000","last_undegraded":"2024-09-13T15:34:33.908399+0000","last_fullsized":"2024-09-13T15:34:33.908399+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910778+0000","last_change":"2024-09-13T15:34:33.910778+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910778+0000","last_undegraded":"2024-09-13T15:34:33.910778+0000","last_fullsized":"2024-09-13T15:34:33.910778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908669+0000","last_change":"2024-09-13T15:34:33.908669+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908669+0000","last_undegraded":"2024-09-13T15:34:33.908669+0000","last_fullsized":"2024-09-13T15:34:33.908669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910017+0000","last_change":"2024-09-13T15:34:33.910017+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910017+0000","last_undegraded":"2024-09-13T15:34:33.910017+0000","last_fullsized":"2024-09-13T15:34:33.910017+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.907602+0000","last_change":"2024-09-13T15:34:33.907602+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.907602+0000","last_undegraded":"2024-09-13T15:34:33.907602+0000","last_fullsized":"2024-09-13T15:34:33.907602+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:31.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908875+0000","last_change":"2024-09-13T15:34:33.908875+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908875+0000","last_undegraded":"2024-09-13T15:34:33.908875+0000","last_fullsized":"2024-09-13T15:34:33.908875+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909627+0000","last_change":"2024-09-13T15:34:33.909627+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909627+0000","last_undegraded":"2024-09-13T15:34:33.909627+0000","last_fullsized":"2024-09-13T15:34:33.909627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.906256+0000","last_change":"2024-09-13T15:34:33.906256+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.906256+0000","last_undegraded":"2024-09-13T15:34:33.906256+0000","last_fullsized":"2024-09-13T15:34:33.906256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.907702+0000","last_change":"2024-09-13T15:34:33.907702+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.907702+0000","last_undegraded":"2024-09-13T15:34:33.907702+0000","last_fullsized":"2024-09-13T15:34:33.907702+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":138,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-09-13T15:34:30.222393+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:34:30.222393+0000","last_peered":"2024-09-13T15:34:30.222393+0000","last_clean":"2024-09-13T15:34:30.222393+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:34:30.222393+0000","last_undegraded":"2024-09-13T15:34:30.222393+0000","last_fullsized":"2024-09-13T15:34:30.222393+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:42.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.903600+0000","last_change":"2024-09-13T15:34:33.903600+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.903600+0000","last_undegraded":"2024-09-13T15:34:33.903600+0000","last_fullsized":"2024-09-13T15:34:33.903600+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.906492+0000","last_change":"2024-09-13T15:34:33.906492+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.906492+0000","last_undegraded":"2024-09-13T15:34:33.906492+0000","last_fullsized":"2024-09-13T15:34:33.906492+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:47.211308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908292+0000","last_change":"2024-09-13T15:34:33.908292+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908292+0000","last_undegraded":"2024-09-13T15:34:33.908292+0000","last_fullsized":"2024-09-13T15:34:33.908292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:37.814369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909954+0000","last_change":"2024-09-13T15:34:33.909954+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909954+0000","last_undegraded":"2024-09-13T15:34:33.909954+0000","last_fullsized":"2024-09-13T15:34:33.909954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.904077+0000","last_change":"2024-09-13T15:34:33.904077+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.904077+0000","last_undegraded":"2024-09-13T15:34:33.904077+0000","last_fullsized":"2024-09-13T15:34:33.904077+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.904960+0000","last_change":"2024-09-13T15:34:33.904960+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.904960+0000","last_undegraded":"2024-09-13T15:34:33.904960+0000","last_fullsized":"2024-09-13T15:34:33.904960+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.905087+0000","last_change":"2024-09-13T15:34:33.905087+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.905087+0000","last_undegraded":"2024-09-13T15:34:33.905087+0000","last_fullsized":"2024-09-13T15:34:33.905087+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.905482+0000","last_change":"2024-09-13T15:34:33.905482+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.905482+0000","last_undegraded":"2024-09-13T15:34:33.905482+0000","last_fullsized":"2024-09-13T15:34:33.905482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908677+0000","last_change":"2024-09-13T15:34:33.908677+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908677+0000","last_undegraded":"2024-09-13T15:34:33.908677+0000","last_fullsized":"2024-09-13T15:34:33.908677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.903408+0000","last_change":"2024-09-13T15:34:33.903408+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.903408+0000","last_undegraded":"2024-09-13T15:34:33.903408+0000","last_fullsized":"2024-09-13T15:34:33.903408+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.904350+0000","last_change":"2024-09-13T15:34:33.904350+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.904350+0000","last_undegraded":"2024-09-13T15:34:33.904350+0000","last_fullsized":"2024-09-13T15:34:33.904350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.908749+0000","last_change":"2024-09-13T15:34:33.908749+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.908749+0000","last_undegraded":"2024-09-13T15:34:33.908749+0000","last_fullsized":"2024-09-13T15:34:33.908749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909925+0000","last_change":"2024-09-13T15:34:33.909925+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909925+0000","last_undegraded":"2024-09-13T15:34:33.909925+0000","last_fullsized":"2024-09-13T15:34:33.909925+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.909766+0000","last_change":"2024-09-13T15:34:33.909766+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.909766+0000","last_undegraded":"2024-09-13T15:34:33.909766+0000","last_fullsized":"2024-09-13T15:34:33.909766+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.910525+0000","last_change":"2024-09-13T15:34:33.910525+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.910525+0000","last_undegraded":"2024-09-13T15:34:33.910525+0000","last_fullsized":"2024-09-13T15:34:33.910525+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T15:34:34.897425+0000","last_change":"2024-09-13T15:34:34.897425+0000","last_active":"2024-09-13T15:34:34.897425+0000","last_peered":"2024-09-13T15:34:34.897425+0000","last_clean":"2024-09-13T15:34:34.897425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:34.897425+0000","last_undegraded":"2024-09-13T15:34:34.897425+0000","last_fullsized":"2024-09-13T15:34:34.897425+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":13,"state":"creating+peering","last_fresh":"2024-09-13T15:34:33.911539+0000","last_change":"2024-09-13T15:34:33.911539+0000","last_active":"2024-09-13T15:34:33.891919+0000","last_peered":"2024-09-13T15:34:33.891919+0000","last_clean":"2024-09-13T15:34:33.891919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T15:34:33.911539+0000","last_undegraded":"2024-09-13T15:34:33.911539+0000","last_fullsized":"2024-09-13T15:34:33.911539+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27132,"kb_used_data":112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344708,"statfs":{"total":96636764160,"available":96608980992,"internally_reserved":0,"allocated":114688,"data_stored":30274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":617095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":700416,"data_stored":617095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:34:43.793 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:34:43.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.923+0000 7fda4b565640 1 Processor -- start 2024-09-13T15:34:43.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda4b565640 1 -- start start 2024-09-13T15:34:43.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda4b565640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda440bebb0 0x7fda440a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:43.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda4b565640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda441515b0 con 0x7fda440b4010 2024-09-13T15:34:43.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda4b565640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4414e2c0 con 0x7fda440bebb0 2024-09-13T15:34:43.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda49301640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda440bebb0 0x7fda440a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:43.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda49301640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fda440bebb0 0x7fda440a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47214/0 (socket says 172.21.15.40:47214) 2024-09-13T15:34:43.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda48b00640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fda440b4010 0x7fda4406e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38614/0 (socket says 172.21.15.40:38614) 2024-09-13T15:34:43.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda49301640 1 -- 172.21.15.40:0/657822706 learned_addr learned my addr 172.21.15.40:0/657822706 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:43.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda49301640 1 -- 172.21.15.40:0/657822706 >> v1:172.21.15.40:6789/0 conn(0x7fda440b4010 legacy=0x7fda4406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:43.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda49301640 1 -- 172.21.15.40:0/657822706 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4406f830 con 0x7fda440bebb0 2024-09-13T15:34:43.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda49301640 1 --2- 172.21.15.40:0/657822706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda440bebb0 0x7fda440a4d70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009e50 tx=0x7fda3c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1797a20b69f5640 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:43.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda43fff640 1 -- 172.21.15.40:0/657822706 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda440b6bc0 con 0x7fda440bebb0 2024-09-13T15:34:43.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda43fff640 1 -- 172.21.15.40:0/657822706 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c009200 con 0x7fda440bebb0 2024-09-13T15:34:43.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.927+0000 7fda43fff640 1 -- 172.21.15.40:0/657822706 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda3c0a57d0 con 0x7fda440bebb0 2024-09-13T15:34:43.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda4b565640 1 -- 172.21.15.40:0/657822706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda440bebb0 msgr2=0x7fda440a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:43.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda4b565640 1 --2- 172.21.15.40:0/657822706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda440bebb0 0x7fda440a4d70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009e50 tx=0x7fda3c01ca30 comp rx=0 tx=0).stop 2024-09-13T15:34:43.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda4b565640 1 -- 172.21.15.40:0/657822706 shutdown_connections 2024-09-13T15:34:43.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda4b565640 1 --2- 172.21.15.40:0/657822706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda440bebb0 0x7fda440a4d70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:43.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda4b565640 1 -- 172.21.15.40:0/657822706 >> 172.21.15.40:0/657822706 conn(0x7fda4406a540 msgr2=0x7fda440a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:43.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda4b565640 1 -- 172.21.15.40:0/657822706 shutdown_connections 2024-09-13T15:34:43.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda4b565640 1 -- 172.21.15.40:0/657822706 wait complete. 2024-09-13T15:34:43.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda4b565640 1 Processor -- start 2024-09-13T15:34:43.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda4b565640 1 -- start start 2024-09-13T15:34:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda4b565640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda440b4010 0x7fda440c0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda4b565640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda440c0d70 con 0x7fda440b4010 2024-09-13T15:34:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda49301640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda440b4010 0x7fda440c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda49301640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda440b4010 0x7fda440c0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47226/0 (socket says 172.21.15.40:47226) 2024-09-13T15:34:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda49301640 1 -- 172.21.15.40:0/395815355 learned_addr learned my addr 172.21.15.40:0/395815355 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:43.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.931+0000 7fda49301640 1 -- 172.21.15.40:0/395815355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c009b30 con 0x7fda440b4010 2024-09-13T15:34:43.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.935+0000 7fda49301640 1 --2- 172.21.15.40:0/395815355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda440b4010 0x7fda440c0710 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda3c019640 tx=0x7fda3c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:43.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.935+0000 7fda41ffb640 1 -- 172.21.15.40:0/395815355 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda3c0b87b0 con 0x7fda440b4010 2024-09-13T15:34:43.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.935+0000 7fda41ffb640 1 -- 172.21.15.40:0/395815355 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c0b8930 con 0x7fda440b4010 2024-09-13T15:34:43.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.935+0000 7fda4b565640 1 -- 172.21.15.40:0/395815355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda441491f0 con 0x7fda440b4010 2024-09-13T15:34:43.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.935+0000 7fda41ffb640 1 -- 172.21.15.40:0/395815355 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda3c0b8c10 con 0x7fda440b4010 2024-09-13T15:34:43.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.935+0000 7fda4b565640 1 -- 172.21.15.40:0/395815355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda440c1210 con 0x7fda440b4010 2024-09-13T15:34:43.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.935+0000 7fda41ffb640 1 -- 172.21.15.40:0/395815355 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fda3c0b6440 con 0x7fda440b4010 2024-09-13T15:34:43.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.935+0000 7fda4b565640 1 -- 172.21.15.40:0/395815355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda440a4d70 con 0x7fda440b4010 2024-09-13T15:34:43.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.935+0000 7fda41ffb640 1 --2- 172.21.15.40:0/395815355 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fda30035450 0x7fda30037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:43.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.935+0000 7fda41ffb640 1 -- 172.21.15.40:0/395815355 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7fda3c0e30a0 con 0x7fda440b4010 2024-09-13T15:34:43.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.935+0000 7fda48b00640 1 --2- 172.21.15.40:0/395815355 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fda30035450 0x7fda30037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:43.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.935+0000 7fda48b00640 1 --2- 172.21.15.40:0/395815355 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fda30035450 0x7fda30037910 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda38000f70 tx=0x7fda38007a90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:43.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:43.939+0000 7fda41ffb640 1 -- 172.21.15.40:0/395815355 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fda3c0b5d70 con 0x7fda440b4010 2024-09-13T15:34:44.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.095+0000 7fda4b565640 1 -- 172.21.15.40:0/395815355 --> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda44066920 con 0x7fda30035450 2024-09-13T15:34:44.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.107+0000 7fda41ffb640 1 -- 172.21.15.40:0/395815355 <== mgr.4099 v2:172.21.15.40:6824/3185150828 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247377 (secure 0 0 0) 0x7fda44066920 con 0x7fda30035450 2024-09-13T15:34:44.111 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:44.113 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:34:44.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.111+0000 7fda4b565640 1 -- 172.21.15.40:0/395815355 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fda30035450 msgr2=0x7fda30037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:44.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.111+0000 7fda4b565640 1 --2- 172.21.15.40:0/395815355 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fda30035450 0x7fda30037910 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fda38000f70 tx=0x7fda38007a90 comp rx=0 tx=0).stop 2024-09-13T15:34:44.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.111+0000 7fda4b565640 1 -- 172.21.15.40:0/395815355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda440b4010 msgr2=0x7fda440c0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:44.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.111+0000 7fda4b565640 1 --2- 172.21.15.40:0/395815355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda440b4010 0x7fda440c0710 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda3c019640 tx=0x7fda3c0197d0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.111+0000 7fda4b565640 1 -- 172.21.15.40:0/395815355 shutdown_connections 2024-09-13T15:34:44.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.111+0000 7fda4b565640 1 --2- 172.21.15.40:0/395815355 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fda30035450 0x7fda30037910 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.111+0000 7fda4b565640 1 --2- 172.21.15.40:0/395815355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda440b4010 0x7fda440c0710 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.111+0000 7fda4b565640 1 -- 172.21.15.40:0/395815355 >> 172.21.15.40:0/395815355 conn(0x7fda4406a540 msgr2=0x7fda440bcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:44.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.111+0000 7fda4b565640 1 -- 172.21.15.40:0/395815355 shutdown_connections 2024-09-13T15:34:44.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.111+0000 7fda4b565640 1 -- 172.21.15.40:0/395815355 wait complete. 2024-09-13T15:34:44.130 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-13T15:34:43.058883+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":181,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82700,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032820,"statfs":{"total":289910292480,"available":289825607680,"internally_reserved":0,"allocated":1671168,"data_stored":1313662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002611"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302505+0000","last_change":"2024-09-13T15:34:35.347293+0000","last_active":"2024-09-13T15:34:36.302505+0000","last_peered":"2024-09-13T15:34:36.302505+0000","last_clean":"2024-09-13T15:34:36.302505+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:34:36.302505+0000","last_undegraded":"2024-09-13T15:34:36.302505+0000","last_fullsized":"2024-09-13T15:34:36.302505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:52.388403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227786+0000","last_change":"2024-09-13T15:34:35.329279+0000","last_active":"2024-09-13T15:34:38.227786+0000","last_peered":"2024-09-13T15:34:38.227786+0000","last_clean":"2024-09-13T15:34:38.227786+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:34:38.227786+0000","last_undegraded":"2024-09-13T15:34:38.227786+0000","last_fullsized":"2024-09-13T15:34:38.227786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303160+0000","last_change":"2024-09-13T15:34:35.324580+0000","last_active":"2024-09-13T15:34:36.303160+0000","last_peered":"2024-09-13T15:34:36.303160+0000","last_clean":"2024-09-13T15:34:36.303160+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:34:36.303160+0000","last_undegraded":"2024-09-13T15:34:36.303160+0000","last_fullsized":"2024-09-13T15:34:36.303160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:08.082085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.230674+0000","last_change":"2024-09-13T15:34:35.330864+0000","last_active":"2024-09-13T15:34:38.230674+0000","last_peered":"2024-09-13T15:34:38.230674+0000","last_clean":"2024-09-13T15:34:38.230674+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:34:38.230674+0000","last_undegraded":"2024-09-13T15:34:38.230674+0000","last_fullsized":"2024-09-13T15:34:38.230674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303451+0000","last_change":"2024-09-13T15:34:35.327922+0000","last_active":"2024-09-13T15:34:36.303451+0000","last_peered":"2024-09-13T15:34:36.303451+0000","last_clean":"2024-09-13T15:34:36.303451+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:34:36.303451+0000","last_undegraded":"2024-09-13T15:34:36.303451+0000","last_fullsized":"2024-09-13T15:34:36.303451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:22.066293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.230856+0000","last_change":"2024-09-13T15:34:35.329319+0000","last_active":"2024-09-13T15:34:38.230856+0000","last_peered":"2024-09-13T15:34:38.230856+0000","last_clean":"2024-09-13T15:34:38.230856+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:34:38.230856+0000","last_undegraded":"2024-09-13T15:34:38.230856+0000","last_fullsized":"2024-09-13T15:34:38.230856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303392+0000","last_change":"2024-09-13T15:34:35.334719+0000","last_active":"2024-09-13T15:34:36.303392+0000","last_peered":"2024-09-13T15:34:36.303392+0000","last_clean":"2024-09-13T15:34:36.303392+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:34:36.303392+0000","last_undegraded":"2024-09-13T15:34:36.303392+0000","last_fullsized":"2024-09-13T15:34:36.303392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:14.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228428+0000","last_change":"2024-09-13T15:34:35.335400+0000","last_active":"2024-09-13T15:34:38.228428+0000","last_peered":"2024-09-13T15:34:38.228428+0000","last_clean":"2024-09-13T15:34:38.228428+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:34:38.228428+0000","last_undegraded":"2024-09-13T15:34:38.228428+0000","last_fullsized":"2024-09-13T15:34:38.228428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229045+0000","last_change":"2024-09-13T15:34:35.345251+0000","last_active":"2024-09-13T15:34:38.229045+0000","last_peered":"2024-09-13T15:34:38.229045+0000","last_clean":"2024-09-13T15:34:38.229045+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:34:38.229045+0000","last_undegraded":"2024-09-13T15:34:38.229045+0000","last_fullsized":"2024-09-13T15:34:38.229045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303230+0000","last_change":"2024-09-13T15:34:35.319299+0000","last_active":"2024-09-13T15:34:36.303230+0000","last_peered":"2024-09-13T15:34:36.303230+0000","last_clean":"2024-09-13T15:34:36.303230+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:34:36.303230+0000","last_undegraded":"2024-09-13T15:34:36.303230+0000","last_fullsized":"2024-09-13T15:34:36.303230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:16.700428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302978+0000","last_change":"2024-09-13T15:34:35.331709+0000","last_active":"2024-09-13T15:34:36.302978+0000","last_peered":"2024-09-13T15:34:36.302978+0000","last_clean":"2024-09-13T15:34:36.302978+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:34:36.302978+0000","last_undegraded":"2024-09-13T15:34:36.302978+0000","last_fullsized":"2024-09-13T15:34:36.302978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:17.069173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302586+0000","last_change":"2024-09-13T15:34:35.330875+0000","last_active":"2024-09-13T15:34:36.302586+0000","last_peered":"2024-09-13T15:34:36.302586+0000","last_clean":"2024-09-13T15:34:36.302586+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:34:36.302586+0000","last_undegraded":"2024-09-13T15:34:36.302586+0000","last_fullsized":"2024-09-13T15:34:36.302586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:22.297990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303695+0000","last_change":"2024-09-13T15:34:35.335252+0000","last_active":"2024-09-13T15:34:36.303695+0000","last_peered":"2024-09-13T15:34:36.303695+0000","last_clean":"2024-09-13T15:34:36.303695+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:34:36.303695+0000","last_undegraded":"2024-09-13T15:34:36.303695+0000","last_fullsized":"2024-09-13T15:34:36.303695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:37.432254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302324+0000","last_change":"2024-09-13T15:34:35.335599+0000","last_active":"2024-09-13T15:34:36.302324+0000","last_peered":"2024-09-13T15:34:36.302324+0000","last_clean":"2024-09-13T15:34:36.302324+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:34:36.302324+0000","last_undegraded":"2024-09-13T15:34:36.302324+0000","last_fullsized":"2024-09-13T15:34:36.302324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:06.605564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228614+0000","last_change":"2024-09-13T15:34:35.333765+0000","last_active":"2024-09-13T15:34:38.228614+0000","last_peered":"2024-09-13T15:34:38.228614+0000","last_clean":"2024-09-13T15:34:38.228614+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:34:38.228614+0000","last_undegraded":"2024-09-13T15:34:38.228614+0000","last_fullsized":"2024-09-13T15:34:38.228614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229241+0000","last_change":"2024-09-13T15:34:35.331848+0000","last_active":"2024-09-13T15:34:38.229241+0000","last_peered":"2024-09-13T15:34:38.229241+0000","last_clean":"2024-09-13T15:34:38.229241+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:34:38.229241+0000","last_undegraded":"2024-09-13T15:34:38.229241+0000","last_fullsized":"2024-09-13T15:34:38.229241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229727+0000","last_change":"2024-09-13T15:34:35.333522+0000","last_active":"2024-09-13T15:34:38.229727+0000","last_peered":"2024-09-13T15:34:38.229727+0000","last_clean":"2024-09-13T15:34:38.229727+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:34:38.229727+0000","last_undegraded":"2024-09-13T15:34:38.229727+0000","last_fullsized":"2024-09-13T15:34:38.229727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231318+0000","last_change":"2024-09-13T15:34:35.335384+0000","last_active":"2024-09-13T15:34:38.231318+0000","last_peered":"2024-09-13T15:34:38.231318+0000","last_clean":"2024-09-13T15:34:38.231318+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:34:38.231318+0000","last_undegraded":"2024-09-13T15:34:38.231318+0000","last_fullsized":"2024-09-13T15:34:38.231318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303390+0000","last_change":"2024-09-13T15:34:35.324912+0000","last_active":"2024-09-13T15:34:36.303390+0000","last_peered":"2024-09-13T15:34:36.303390+0000","last_clean":"2024-09-13T15:34:36.303390+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:34:36.303390+0000","last_undegraded":"2024-09-13T15:34:36.303390+0000","last_fullsized":"2024-09-13T15:34:36.303390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302638+0000","last_change":"2024-09-13T15:34:35.346893+0000","last_active":"2024-09-13T15:34:36.302638+0000","last_peered":"2024-09-13T15:34:36.302638+0000","last_clean":"2024-09-13T15:34:36.302638+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:34:36.302638+0000","last_undegraded":"2024-09-13T15:34:36.302638+0000","last_fullsized":"2024-09-13T15:34:36.302638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:52.439034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303077+0000","last_change":"2024-09-13T15:34:35.325306+0000","last_active":"2024-09-13T15:34:36.303077+0000","last_peered":"2024-09-13T15:34:36.303077+0000","last_clean":"2024-09-13T15:34:36.303077+0000","last_became_active":"2024-09-13T15:34:35.322050+0000","last_became_peered":"2024-09-13T15:34:35.322050+0000","last_unstale":"2024-09-13T15:34:36.303077+0000","last_undegraded":"2024-09-13T15:34:36.303077+0000","last_fullsized":"2024-09-13T15:34:36.303077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:27.724097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227661+0000","last_change":"2024-09-13T15:34:35.329712+0000","last_active":"2024-09-13T15:34:38.227661+0000","last_peered":"2024-09-13T15:34:38.227661+0000","last_clean":"2024-09-13T15:34:38.227661+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:34:38.227661+0000","last_undegraded":"2024-09-13T15:34:38.227661+0000","last_fullsized":"2024-09-13T15:34:38.227661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.301852+0000","last_change":"2024-09-13T15:34:35.324523+0000","last_active":"2024-09-13T15:34:36.301852+0000","last_peered":"2024-09-13T15:34:36.301852+0000","last_clean":"2024-09-13T15:34:36.301852+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:34:36.301852+0000","last_undegraded":"2024-09-13T15:34:36.301852+0000","last_fullsized":"2024-09-13T15:34:36.301852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.301945+0000","last_change":"2024-09-13T15:34:35.327879+0000","last_active":"2024-09-13T15:34:36.301945+0000","last_peered":"2024-09-13T15:34:36.301945+0000","last_clean":"2024-09-13T15:34:36.301945+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:34:36.301945+0000","last_undegraded":"2024-09-13T15:34:36.301945+0000","last_fullsized":"2024-09-13T15:34:36.301945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231266+0000","last_change":"2024-09-13T15:34:35.336949+0000","last_active":"2024-09-13T15:34:38.231266+0000","last_peered":"2024-09-13T15:34:38.231266+0000","last_clean":"2024-09-13T15:34:38.231266+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:34:38.231266+0000","last_undegraded":"2024-09-13T15:34:38.231266+0000","last_fullsized":"2024-09-13T15:34:38.231266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:45.530761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231406+0000","last_change":"2024-09-13T15:34:35.335209+0000","last_active":"2024-09-13T15:34:38.231406+0000","last_peered":"2024-09-13T15:34:38.231406+0000","last_clean":"2024-09-13T15:34:38.231406+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:34:38.231406+0000","last_undegraded":"2024-09-13T15:34:38.231406+0000","last_fullsized":"2024-09-13T15:34:38.231406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228671+0000","last_change":"2024-09-13T15:34:35.339305+0000","last_active":"2024-09-13T15:34:38.228671+0000","last_peered":"2024-09-13T15:34:38.228671+0000","last_clean":"2024-09-13T15:34:38.228671+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:34:38.228671+0000","last_undegraded":"2024-09-13T15:34:38.228671+0000","last_fullsized":"2024-09-13T15:34:38.228671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302727+0000","last_change":"2024-09-13T15:34:35.328129+0000","last_active":"2024-09-13T15:34:36.302727+0000","last_peered":"2024-09-13T15:34:36.302727+0000","last_clean":"2024-09-13T15:34:36.302727+0000","last_became_active":"2024-09-13T15:34:35.327356+0000","last_became_peered":"2024-09-13T15:34:35.327356+0000","last_unstale":"2024-09-13T15:34:36.302727+0000","last_undegraded":"2024-09-13T15:34:36.302727+0000","last_fullsized":"2024-09-13T15:34:36.302727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:19.369318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302983+0000","last_change":"2024-09-13T15:34:35.331611+0000","last_active":"2024-09-13T15:34:36.302983+0000","last_peered":"2024-09-13T15:34:36.302983+0000","last_clean":"2024-09-13T15:34:36.302983+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:34:36.302983+0000","last_undegraded":"2024-09-13T15:34:36.302983+0000","last_fullsized":"2024-09-13T15:34:36.302983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:08.881292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302465+0000","last_change":"2024-09-13T15:34:35.324690+0000","last_active":"2024-09-13T15:34:36.302465+0000","last_peered":"2024-09-13T15:34:36.302465+0000","last_clean":"2024-09-13T15:34:36.302465+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:34:36.302465+0000","last_undegraded":"2024-09-13T15:34:36.302465+0000","last_fullsized":"2024-09-13T15:34:36.302465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.230387+0000","last_change":"2024-09-13T15:34:35.335517+0000","last_active":"2024-09-13T15:34:38.230387+0000","last_peered":"2024-09-13T15:34:38.230387+0000","last_clean":"2024-09-13T15:34:38.230387+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:34:38.230387+0000","last_undegraded":"2024-09-13T15:34:38.230387+0000","last_fullsized":"2024-09-13T15:34:38.230387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:58.399592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229648+0000","last_change":"2024-09-13T15:34:35.331904+0000","last_active":"2024-09-13T15:34:38.229648+0000","last_peered":"2024-09-13T15:34:38.229648+0000","last_clean":"2024-09-13T15:34:38.229648+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:34:38.229648+0000","last_undegraded":"2024-09-13T15:34:38.229648+0000","last_fullsized":"2024-09-13T15:34:38.229648+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227945+0000","last_change":"2024-09-13T15:34:35.343571+0000","last_active":"2024-09-13T15:34:38.227945+0000","last_peered":"2024-09-13T15:34:38.227945+0000","last_clean":"2024-09-13T15:34:38.227945+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:34:38.227945+0000","last_undegraded":"2024-09-13T15:34:38.227945+0000","last_fullsized":"2024-09-13T15:34:38.227945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.342554+0000","last_change":"2024-09-13T15:34:34.944458+0000","last_active":"2024-09-13T15:34:35.342554+0000","last_peered":"2024-09-13T15:34:35.342554+0000","last_clean":"2024-09-13T15:34:35.342554+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:34:35.342554+0000","last_undegraded":"2024-09-13T15:34:35.342554+0000","last_fullsized":"2024-09-13T15:34:35.342554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303083+0000","last_change":"2024-09-13T15:34:35.331843+0000","last_active":"2024-09-13T15:34:36.303083+0000","last_peered":"2024-09-13T15:34:36.303083+0000","last_clean":"2024-09-13T15:34:36.303083+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:34:36.303083+0000","last_undegraded":"2024-09-13T15:34:36.303083+0000","last_fullsized":"2024-09-13T15:34:36.303083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:43.103418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.328697+0000","last_change":"2024-09-13T15:34:34.957379+0000","last_active":"2024-09-13T15:34:35.328697+0000","last_peered":"2024-09-13T15:34:35.328697+0000","last_clean":"2024-09-13T15:34:35.328697+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:34:35.328697+0000","last_undegraded":"2024-09-13T15:34:35.328697+0000","last_fullsized":"2024-09-13T15:34:35.328697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.300958+0000","last_change":"2024-09-13T15:34:34.954475+0000","last_active":"2024-09-13T15:34:35.300958+0000","last_peered":"2024-09-13T15:34:35.300958+0000","last_clean":"2024-09-13T15:34:35.300958+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:34:35.300958+0000","last_undegraded":"2024-09-13T15:34:35.300958+0000","last_fullsized":"2024-09-13T15:34:35.300958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229772+0000","last_change":"2024-09-13T15:34:35.340304+0000","last_active":"2024-09-13T15:34:38.229772+0000","last_peered":"2024-09-13T15:34:38.229772+0000","last_clean":"2024-09-13T15:34:38.229772+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:34:38.229772+0000","last_undegraded":"2024-09-13T15:34:38.229772+0000","last_fullsized":"2024-09-13T15:34:38.229772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.297580+0000","last_change":"2024-09-13T15:34:34.950709+0000","last_active":"2024-09-13T15:34:35.297580+0000","last_peered":"2024-09-13T15:34:35.297580+0000","last_clean":"2024-09-13T15:34:35.297580+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:34:35.297580+0000","last_undegraded":"2024-09-13T15:34:35.297580+0000","last_fullsized":"2024-09-13T15:34:35.297580+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227382+0000","last_change":"2024-09-13T15:34:35.335773+0000","last_active":"2024-09-13T15:34:38.227382+0000","last_peered":"2024-09-13T15:34:38.227382+0000","last_clean":"2024-09-13T15:34:38.227382+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:34:38.227382+0000","last_undegraded":"2024-09-13T15:34:38.227382+0000","last_fullsized":"2024-09-13T15:34:38.227382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.330447+0000","last_change":"2024-09-13T15:34:34.939305+0000","last_active":"2024-09-13T15:34:35.330447+0000","last_peered":"2024-09-13T15:34:35.330447+0000","last_clean":"2024-09-13T15:34:35.330447+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:34:35.330447+0000","last_undegraded":"2024-09-13T15:34:35.330447+0000","last_fullsized":"2024-09-13T15:34:35.330447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231671+0000","last_change":"2024-09-13T15:34:35.338289+0000","last_active":"2024-09-13T15:34:38.231671+0000","last_peered":"2024-09-13T15:34:38.231671+0000","last_clean":"2024-09-13T15:34:38.231671+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:34:38.231671+0000","last_undegraded":"2024-09-13T15:34:38.231671+0000","last_fullsized":"2024-09-13T15:34:38.231671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:34.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.300585+0000","last_change":"2024-09-13T15:34:34.953625+0000","last_active":"2024-09-13T15:34:35.300585+0000","last_peered":"2024-09-13T15:34:35.300585+0000","last_clean":"2024-09-13T15:34:35.300585+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:34:35.300585+0000","last_undegraded":"2024-09-13T15:34:35.300585+0000","last_fullsized":"2024-09-13T15:34:35.300585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303221+0000","last_change":"2024-09-13T15:34:35.347690+0000","last_active":"2024-09-13T15:34:36.303221+0000","last_peered":"2024-09-13T15:34:36.303221+0000","last_clean":"2024-09-13T15:34:36.303221+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:34:36.303221+0000","last_undegraded":"2024-09-13T15:34:36.303221+0000","last_fullsized":"2024-09-13T15:34:36.303221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:53.778485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.350982+0000","last_change":"2024-09-13T15:34:34.949988+0000","last_active":"2024-09-13T15:34:35.350982+0000","last_peered":"2024-09-13T15:34:35.350982+0000","last_clean":"2024-09-13T15:34:35.350982+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:34:35.350982+0000","last_undegraded":"2024-09-13T15:34:35.350982+0000","last_fullsized":"2024-09-13T15:34:35.350982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228648+0000","last_change":"2024-09-13T15:34:35.341547+0000","last_active":"2024-09-13T15:34:38.228648+0000","last_peered":"2024-09-13T15:34:38.228648+0000","last_clean":"2024-09-13T15:34:38.228648+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:34:38.228648+0000","last_undegraded":"2024-09-13T15:34:38.228648+0000","last_fullsized":"2024-09-13T15:34:38.228648+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"15'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.350263+0000","last_change":"2024-09-13T15:34:34.955883+0000","last_active":"2024-09-13T15:34:35.350263+0000","last_peered":"2024-09-13T15:34:35.350263+0000","last_clean":"2024-09-13T15:34:35.350263+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:34:35.350263+0000","last_undegraded":"2024-09-13T15:34:35.350263+0000","last_fullsized":"2024-09-13T15:34:35.350263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303048+0000","last_change":"2024-09-13T15:34:35.345452+0000","last_active":"2024-09-13T15:34:36.303048+0000","last_peered":"2024-09-13T15:34:36.303048+0000","last_clean":"2024-09-13T15:34:36.303048+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:34:36.303048+0000","last_undegraded":"2024-09-13T15:34:36.303048+0000","last_fullsized":"2024-09-13T15:34:36.303048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:08:25.983299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.310170+0000","last_change":"2024-09-13T15:34:34.942058+0000","last_active":"2024-09-13T15:34:35.310170+0000","last_peered":"2024-09-13T15:34:35.310170+0000","last_clean":"2024-09-13T15:34:35.310170+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:34:35.310170+0000","last_undegraded":"2024-09-13T15:34:35.310170+0000","last_fullsized":"2024-09-13T15:34:35.310170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302628+0000","last_change":"2024-09-13T15:34:35.334637+0000","last_active":"2024-09-13T15:34:36.302628+0000","last_peered":"2024-09-13T15:34:36.302628+0000","last_clean":"2024-09-13T15:34:36.302628+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:34:36.302628+0000","last_undegraded":"2024-09-13T15:34:36.302628+0000","last_fullsized":"2024-09-13T15:34:36.302628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:43.466895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.309490+0000","last_change":"2024-09-13T15:34:34.957763+0000","last_active":"2024-09-13T15:34:35.309490+0000","last_peered":"2024-09-13T15:34:35.309490+0000","last_clean":"2024-09-13T15:34:35.309490+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:34:35.309490+0000","last_undegraded":"2024-09-13T15:34:35.309490+0000","last_fullsized":"2024-09-13T15:34:35.309490+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227481+0000","last_change":"2024-09-13T15:34:35.342732+0000","last_active":"2024-09-13T15:34:38.227481+0000","last_peered":"2024-09-13T15:34:38.227481+0000","last_clean":"2024-09-13T15:34:38.227481+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:34:38.227481+0000","last_undegraded":"2024-09-13T15:34:38.227481+0000","last_fullsized":"2024-09-13T15:34:38.227481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.301557+0000","last_change":"2024-09-13T15:34:34.954181+0000","last_active":"2024-09-13T15:34:35.301557+0000","last_peered":"2024-09-13T15:34:35.301557+0000","last_clean":"2024-09-13T15:34:35.301557+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:34:35.301557+0000","last_undegraded":"2024-09-13T15:34:35.301557+0000","last_fullsized":"2024-09-13T15:34:35.301557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228287+0000","last_change":"2024-09-13T15:34:35.329165+0000","last_active":"2024-09-13T15:34:38.228287+0000","last_peered":"2024-09-13T15:34:38.228287+0000","last_clean":"2024-09-13T15:34:38.228287+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:34:38.228287+0000","last_undegraded":"2024-09-13T15:34:38.228287+0000","last_fullsized":"2024-09-13T15:34:38.228287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.346922+0000","last_change":"2024-09-13T15:34:34.959407+0000","last_active":"2024-09-13T15:34:35.346922+0000","last_peered":"2024-09-13T15:34:35.346922+0000","last_clean":"2024-09-13T15:34:35.346922+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:34:35.346922+0000","last_undegraded":"2024-09-13T15:34:35.346922+0000","last_fullsized":"2024-09-13T15:34:35.346922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:31.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.230371+0000","last_change":"2024-09-13T15:34:35.335319+0000","last_active":"2024-09-13T15:34:38.230371+0000","last_peered":"2024-09-13T15:34:38.230371+0000","last_clean":"2024-09-13T15:34:38.230371+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:34:38.230371+0000","last_undegraded":"2024-09-13T15:34:38.230371+0000","last_fullsized":"2024-09-13T15:34:38.230371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.325671+0000","last_change":"2024-09-13T15:34:34.959935+0000","last_active":"2024-09-13T15:34:35.325671+0000","last_peered":"2024-09-13T15:34:35.325671+0000","last_clean":"2024-09-13T15:34:35.325671+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:34:35.325671+0000","last_undegraded":"2024-09-13T15:34:35.325671+0000","last_fullsized":"2024-09-13T15:34:35.325671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231838+0000","last_change":"2024-09-13T15:34:35.338609+0000","last_active":"2024-09-13T15:34:38.231838+0000","last_peered":"2024-09-13T15:34:38.231838+0000","last_clean":"2024-09-13T15:34:38.231838+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:34:38.231838+0000","last_undegraded":"2024-09-13T15:34:38.231838+0000","last_fullsized":"2024-09-13T15:34:38.231838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.337481+0000","last_change":"2024-09-13T15:34:34.956480+0000","last_active":"2024-09-13T15:34:35.337481+0000","last_peered":"2024-09-13T15:34:35.337481+0000","last_clean":"2024-09-13T15:34:35.337481+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:34:35.337481+0000","last_undegraded":"2024-09-13T15:34:35.337481+0000","last_fullsized":"2024-09-13T15:34:35.337481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.304145+0000","last_change":"2024-09-13T15:34:35.347478+0000","last_active":"2024-09-13T15:34:36.304145+0000","last_peered":"2024-09-13T15:34:36.304145+0000","last_clean":"2024-09-13T15:34:36.304145+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:34:36.304145+0000","last_undegraded":"2024-09-13T15:34:36.304145+0000","last_fullsized":"2024-09-13T15:34:36.304145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.481157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.344238+0000","last_change":"2024-09-13T15:34:34.936361+0000","last_active":"2024-09-13T15:34:35.344238+0000","last_peered":"2024-09-13T15:34:35.344238+0000","last_clean":"2024-09-13T15:34:35.344238+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:34:35.344238+0000","last_undegraded":"2024-09-13T15:34:35.344238+0000","last_fullsized":"2024-09-13T15:34:35.344238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302778+0000","last_change":"2024-09-13T15:34:35.330850+0000","last_active":"2024-09-13T15:34:36.302778+0000","last_peered":"2024-09-13T15:34:36.302778+0000","last_clean":"2024-09-13T15:34:36.302778+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:34:36.302778+0000","last_undegraded":"2024-09-13T15:34:36.302778+0000","last_fullsized":"2024-09-13T15:34:36.302778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:53.423967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.313024+0000","last_change":"2024-09-13T15:34:34.956621+0000","last_active":"2024-09-13T15:34:35.313024+0000","last_peered":"2024-09-13T15:34:35.313024+0000","last_clean":"2024-09-13T15:34:35.313024+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:34:35.313024+0000","last_undegraded":"2024-09-13T15:34:35.313024+0000","last_fullsized":"2024-09-13T15:34:35.313024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228749+0000","last_change":"2024-09-13T15:34:35.333828+0000","last_active":"2024-09-13T15:34:38.228749+0000","last_peered":"2024-09-13T15:34:38.228749+0000","last_clean":"2024-09-13T15:34:38.228749+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:34:38.228749+0000","last_undegraded":"2024-09-13T15:34:38.228749+0000","last_fullsized":"2024-09-13T15:34:38.228749+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.313295+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:34:35.313295+0000","last_peered":"2024-09-13T15:34:35.313295+0000","last_clean":"2024-09-13T15:34:35.313295+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:34:35.313295+0000","last_undegraded":"2024-09-13T15:34:35.313295+0000","last_fullsized":"2024-09-13T15:34:35.313295+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:42.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.320987+0000","last_change":"2024-09-13T15:34:34.939804+0000","last_active":"2024-09-13T15:34:35.320987+0000","last_peered":"2024-09-13T15:34:35.320987+0000","last_clean":"2024-09-13T15:34:35.320987+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:34:35.320987+0000","last_undegraded":"2024-09-13T15:34:35.320987+0000","last_fullsized":"2024-09-13T15:34:35.320987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227999+0000","last_change":"2024-09-13T15:34:35.339727+0000","last_active":"2024-09-13T15:34:38.227999+0000","last_peered":"2024-09-13T15:34:38.227999+0000","last_clean":"2024-09-13T15:34:38.227999+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:34:38.227999+0000","last_undegraded":"2024-09-13T15:34:38.227999+0000","last_fullsized":"2024-09-13T15:34:38.227999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.313404+0000","last_change":"2024-09-13T15:34:34.960919+0000","last_active":"2024-09-13T15:34:35.313404+0000","last_peered":"2024-09-13T15:34:35.313404+0000","last_clean":"2024-09-13T15:34:35.313404+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:34:35.313404+0000","last_undegraded":"2024-09-13T15:34:35.313404+0000","last_fullsized":"2024-09-13T15:34:35.313404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:47.211308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.301967+0000","last_change":"2024-09-13T15:34:35.324328+0000","last_active":"2024-09-13T15:34:36.301967+0000","last_peered":"2024-09-13T15:34:36.301967+0000","last_clean":"2024-09-13T15:34:36.301967+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:34:36.301967+0000","last_undegraded":"2024-09-13T15:34:36.301967+0000","last_fullsized":"2024-09-13T15:34:36.301967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.312893+0000","last_change":"2024-09-13T15:34:34.955761+0000","last_active":"2024-09-13T15:34:35.312893+0000","last_peered":"2024-09-13T15:34:35.312893+0000","last_clean":"2024-09-13T15:34:35.312893+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:34:35.312893+0000","last_undegraded":"2024-09-13T15:34:35.312893+0000","last_fullsized":"2024-09-13T15:34:35.312893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:37.814369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.226955+0000","last_change":"2024-09-13T15:34:35.336428+0000","last_active":"2024-09-13T15:34:38.226955+0000","last_peered":"2024-09-13T15:34:38.226955+0000","last_clean":"2024-09-13T15:34:38.226955+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:34:38.226955+0000","last_undegraded":"2024-09-13T15:34:38.226955+0000","last_fullsized":"2024-09-13T15:34:38.226955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.298341+0000","last_change":"2024-09-13T15:34:34.953984+0000","last_active":"2024-09-13T15:34:35.298341+0000","last_peered":"2024-09-13T15:34:35.298341+0000","last_clean":"2024-09-13T15:34:35.298341+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:34:35.298341+0000","last_undegraded":"2024-09-13T15:34:35.298341+0000","last_fullsized":"2024-09-13T15:34:35.298341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303234+0000","last_change":"2024-09-13T15:34:35.327755+0000","last_active":"2024-09-13T15:34:36.303234+0000","last_peered":"2024-09-13T15:34:36.303234+0000","last_clean":"2024-09-13T15:34:36.303234+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:34:36.303234+0000","last_undegraded":"2024-09-13T15:34:36.303234+0000","last_fullsized":"2024-09-13T15:34:36.303234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.321248+0000","last_change":"2024-09-13T15:34:34.946174+0000","last_active":"2024-09-13T15:34:35.321248+0000","last_peered":"2024-09-13T15:34:35.321248+0000","last_clean":"2024-09-13T15:34:35.321248+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:34:35.321248+0000","last_undegraded":"2024-09-13T15:34:35.321248+0000","last_fullsized":"2024-09-13T15:34:35.321248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231214+0000","last_change":"2024-09-13T15:34:35.335431+0000","last_active":"2024-09-13T15:34:38.231214+0000","last_peered":"2024-09-13T15:34:38.231214+0000","last_clean":"2024-09-13T15:34:38.231214+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:34:38.231214+0000","last_undegraded":"2024-09-13T15:34:38.231214+0000","last_fullsized":"2024-09-13T15:34:38.231214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:24.940353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.324841+0000","last_change":"2024-09-13T15:34:34.949805+0000","last_active":"2024-09-13T15:34:35.324841+0000","last_peered":"2024-09-13T15:34:35.324841+0000","last_clean":"2024-09-13T15:34:35.324841+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:34:35.324841+0000","last_undegraded":"2024-09-13T15:34:35.324841+0000","last_fullsized":"2024-09-13T15:34:35.324841+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228884+0000","last_change":"2024-09-13T15:34:35.339676+0000","last_active":"2024-09-13T15:34:38.228884+0000","last_peered":"2024-09-13T15:34:38.228884+0000","last_clean":"2024-09-13T15:34:38.228884+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:34:38.228884+0000","last_undegraded":"2024-09-13T15:34:38.228884+0000","last_fullsized":"2024-09-13T15:34:38.228884+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.321270+0000","last_change":"2024-09-13T15:34:34.942452+0000","last_active":"2024-09-13T15:34:35.321270+0000","last_peered":"2024-09-13T15:34:35.321270+0000","last_clean":"2024-09-13T15:34:35.321270+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:34:35.321270+0000","last_undegraded":"2024-09-13T15:34:35.321270+0000","last_fullsized":"2024-09-13T15:34:35.321270+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231446+0000","last_change":"2024-09-13T15:34:35.337361+0000","last_active":"2024-09-13T15:34:38.231446+0000","last_peered":"2024-09-13T15:34:38.231446+0000","last_clean":"2024-09-13T15:34:38.231446+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:34:38.231446+0000","last_undegraded":"2024-09-13T15:34:38.231446+0000","last_fullsized":"2024-09-13T15:34:38.231446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:27.081960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.351197+0000","last_change":"2024-09-13T15:34:34.946540+0000","last_active":"2024-09-13T15:34:35.351197+0000","last_peered":"2024-09-13T15:34:35.351197+0000","last_clean":"2024-09-13T15:34:35.351197+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:34:35.351197+0000","last_undegraded":"2024-09-13T15:34:35.351197+0000","last_fullsized":"2024-09-13T15:34:35.351197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303231+0000","last_change":"2024-09-13T15:34:35.334433+0000","last_active":"2024-09-13T15:34:36.303231+0000","last_peered":"2024-09-13T15:34:36.303231+0000","last_clean":"2024-09-13T15:34:36.303231+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:34:36.303231+0000","last_undegraded":"2024-09-13T15:34:36.303231+0000","last_fullsized":"2024-09-13T15:34:36.303231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:34.847820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.297705+0000","last_change":"2024-09-13T15:34:34.941308+0000","last_active":"2024-09-13T15:34:35.297705+0000","last_peered":"2024-09-13T15:34:35.297705+0000","last_clean":"2024-09-13T15:34:35.297705+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:34:35.297705+0000","last_undegraded":"2024-09-13T15:34:35.297705+0000","last_fullsized":"2024-09-13T15:34:35.297705+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.301976+0000","last_change":"2024-09-13T15:34:35.327260+0000","last_active":"2024-09-13T15:34:36.301976+0000","last_peered":"2024-09-13T15:34:36.301976+0000","last_clean":"2024-09-13T15:34:36.301976+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:34:36.301976+0000","last_undegraded":"2024-09-13T15:34:36.301976+0000","last_fullsized":"2024-09-13T15:34:36.301976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.318252+0000","last_change":"2024-09-13T15:34:34.943197+0000","last_active":"2024-09-13T15:34:35.318252+0000","last_peered":"2024-09-13T15:34:35.318252+0000","last_clean":"2024-09-13T15:34:35.318252+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:34:35.318252+0000","last_undegraded":"2024-09-13T15:34:35.318252+0000","last_fullsized":"2024-09-13T15:34:35.318252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229906+0000","last_change":"2024-09-13T15:34:35.340037+0000","last_active":"2024-09-13T15:34:38.229906+0000","last_peered":"2024-09-13T15:34:38.229906+0000","last_clean":"2024-09-13T15:34:38.229906+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:34:38.229906+0000","last_undegraded":"2024-09-13T15:34:38.229906+0000","last_fullsized":"2024-09-13T15:34:38.229906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.320969+0000","last_change":"2024-09-13T15:34:34.943732+0000","last_active":"2024-09-13T15:34:35.320969+0000","last_peered":"2024-09-13T15:34:35.320969+0000","last_clean":"2024-09-13T15:34:35.320969+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:34:35.320969+0000","last_undegraded":"2024-09-13T15:34:35.320969+0000","last_fullsized":"2024-09-13T15:34:35.320969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227681+0000","last_change":"2024-09-13T15:34:35.339704+0000","last_active":"2024-09-13T15:34:38.227681+0000","last_peered":"2024-09-13T15:34:38.227681+0000","last_clean":"2024-09-13T15:34:38.227681+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:34:38.227681+0000","last_undegraded":"2024-09-13T15:34:38.227681+0000","last_fullsized":"2024-09-13T15:34:38.227681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.310249+0000","last_change":"2024-09-13T15:34:34.943033+0000","last_active":"2024-09-13T15:34:35.310249+0000","last_peered":"2024-09-13T15:34:35.310249+0000","last_clean":"2024-09-13T15:34:35.310249+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:34:35.310249+0000","last_undegraded":"2024-09-13T15:34:35.310249+0000","last_fullsized":"2024-09-13T15:34:35.310249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302764+0000","last_change":"2024-09-13T15:34:35.334308+0000","last_active":"2024-09-13T15:34:36.302764+0000","last_peered":"2024-09-13T15:34:36.302764+0000","last_clean":"2024-09-13T15:34:36.302764+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:34:36.302764+0000","last_undegraded":"2024-09-13T15:34:36.302764+0000","last_fullsized":"2024-09-13T15:34:36.302764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:50.918862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231259+0000","last_change":"2024-09-13T15:34:35.329220+0000","last_active":"2024-09-13T15:34:38.231259+0000","last_peered":"2024-09-13T15:34:38.231259+0000","last_clean":"2024-09-13T15:34:38.231259+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:34:38.231259+0000","last_undegraded":"2024-09-13T15:34:38.231259+0000","last_fullsized":"2024-09-13T15:34:38.231259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.314859+0000","last_change":"2024-09-13T15:34:34.954062+0000","last_active":"2024-09-13T15:34:35.314859+0000","last_peered":"2024-09-13T15:34:35.314859+0000","last_clean":"2024-09-13T15:34:35.314859+0000","last_became_active":"2024-09-13T15:34:34.951645+0000","last_became_peered":"2024-09-13T15:34:34.951645+0000","last_unstale":"2024-09-13T15:34:35.314859+0000","last_undegraded":"2024-09-13T15:34:35.314859+0000","last_fullsized":"2024-09-13T15:34:35.314859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228392+0000","last_change":"2024-09-13T15:34:35.333710+0000","last_active":"2024-09-13T15:34:38.228392+0000","last_peered":"2024-09-13T15:34:38.228392+0000","last_clean":"2024-09-13T15:34:38.228392+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:34:38.228392+0000","last_undegraded":"2024-09-13T15:34:38.228392+0000","last_fullsized":"2024-09-13T15:34:38.228392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.317334+0000","last_change":"2024-09-13T15:34:34.950125+0000","last_active":"2024-09-13T15:34:35.317334+0000","last_peered":"2024-09-13T15:34:35.317334+0000","last_clean":"2024-09-13T15:34:35.317334+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:34:35.317334+0000","last_undegraded":"2024-09-13T15:34:35.317334+0000","last_fullsized":"2024-09-13T15:34:35.317334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302974+0000","last_change":"2024-09-13T15:34:35.350474+0000","last_active":"2024-09-13T15:34:36.302974+0000","last_peered":"2024-09-13T15:34:36.302974+0000","last_clean":"2024-09-13T15:34:36.302974+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:34:36.302974+0000","last_undegraded":"2024-09-13T15:34:36.302974+0000","last_fullsized":"2024-09-13T15:34:36.302974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:08:45.573183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.331405+0000","last_change":"2024-09-13T15:34:34.955842+0000","last_active":"2024-09-13T15:34:35.331405+0000","last_peered":"2024-09-13T15:34:35.331405+0000","last_clean":"2024-09-13T15:34:35.331405+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:34:35.331405+0000","last_undegraded":"2024-09-13T15:34:35.331405+0000","last_fullsized":"2024-09-13T15:34:35.331405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231610+0000","last_change":"2024-09-13T15:34:35.338454+0000","last_active":"2024-09-13T15:34:38.231610+0000","last_peered":"2024-09-13T15:34:38.231610+0000","last_clean":"2024-09-13T15:34:38.231610+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:34:38.231610+0000","last_undegraded":"2024-09-13T15:34:38.231610+0000","last_fullsized":"2024-09-13T15:34:38.231610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:49.904225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"15'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.331443+0000","last_change":"2024-09-13T15:34:34.960705+0000","last_active":"2024-09-13T15:34:35.331443+0000","last_peered":"2024-09-13T15:34:35.331443+0000","last_clean":"2024-09-13T15:34:35.331443+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:34:35.331443+0000","last_undegraded":"2024-09-13T15:34:35.331443+0000","last_fullsized":"2024-09-13T15:34:35.331443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":44402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":635430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":633830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:34:44.134 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T15:34:44.134 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T15:34:44.135 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T15:34:44.135 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T15:34:44.135 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T15:34:44.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.291+0000 7f5e350b6640 1 Processor -- start 2024-09-13T15:34:44.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.291+0000 7f5e350b6640 1 -- start start 2024-09-13T15:34:44.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.291+0000 7f5e350b6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e300bebb0 0x7f5e300a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:44.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.291+0000 7f5e350b6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e301515b0 con 0x7f5e300b4010 2024-09-13T15:34:44.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.291+0000 7f5e350b6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3014e2c0 con 0x7f5e300bebb0 2024-09-13T15:34:44.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e2ed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e300bebb0 0x7f5e300a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:44.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e2ed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e300bebb0 0x7f5e300a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47238/0 (socket says 172.21.15.40:47238) 2024-09-13T15:34:44.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e2e59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5e300b4010 0x7f5e3006e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38628/0 (socket says 172.21.15.40:38628) 2024-09-13T15:34:44.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e2ed9d640 1 -- 172.21.15.40:0/4181894494 learned_addr learned my addr 172.21.15.40:0/4181894494 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:44.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e2ed9d640 1 -- 172.21.15.40:0/4181894494 >> v1:172.21.15.40:6789/0 conn(0x7f5e300b4010 legacy=0x7f5e3006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:44.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e2ed9d640 1 -- 172.21.15.40:0/4181894494 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3006f830 con 0x7f5e300bebb0 2024-09-13T15:34:44.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e2dd9b640 1 -- 172.21.15.40:0/4181894494 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238049277 0 0) 0x7f5e301515b0 con 0x7f5e300b4010 2024-09-13T15:34:44.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e2ed9d640 1 --2- 172.21.15.40:0/4181894494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e300bebb0 0x7f5e300a4d70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5e240097f0 tx=0x7f5e2401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc87b2800f947b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:44.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e2dd9b640 1 -- 172.21.15.40:0/4181894494 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e300b6bc0 con 0x7f5e300bebb0 2024-09-13T15:34:44.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e2dd9b640 1 -- 172.21.15.40:0/4181894494 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e240a7050 con 0x7f5e300bebb0 2024-09-13T15:34:44.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e2dd9b640 1 -- 172.21.15.40:0/4181894494 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e240ab680 con 0x7f5e300bebb0 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e350b6640 1 -- 172.21.15.40:0/4181894494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e300bebb0 msgr2=0x7f5e300a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e350b6640 1 --2- 172.21.15.40:0/4181894494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e300bebb0 0x7f5e300a4d70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5e240097f0 tx=0x7f5e2401c4e0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e350b6640 1 -- 172.21.15.40:0/4181894494 shutdown_connections 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e350b6640 1 --2- 172.21.15.40:0/4181894494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e300bebb0 0x7f5e300a4d70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e350b6640 1 -- 172.21.15.40:0/4181894494 >> 172.21.15.40:0/4181894494 conn(0x7f5e3006a540 msgr2=0x7f5e300a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e350b6640 1 -- 172.21.15.40:0/4181894494 shutdown_connections 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.295+0000 7f5e350b6640 1 -- 172.21.15.40:0/4181894494 wait complete. 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e350b6640 1 Processor -- start 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e350b6640 1 -- start start 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e350b6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e300b4010 0x7f5e300bb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e350b6640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3015f680 con 0x7f5e300b4010 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e2ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e300b4010 0x7f5e300bb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:44.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e2ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e300b4010 0x7f5e300bb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47248/0 (socket says 172.21.15.40:47248) 2024-09-13T15:34:44.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e2ed9d640 1 -- 172.21.15.40:0/415034457 learned_addr learned my addr 172.21.15.40:0/415034457 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:44.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e2ed9d640 1 -- 172.21.15.40:0/415034457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e240094d0 con 0x7f5e300b4010 2024-09-13T15:34:44.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e2ed9d640 1 --2- 172.21.15.40:0/415034457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e300b4010 0x7f5e300bb230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5e240190f0 tx=0x7f5e2401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:44.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e177fe640 1 -- 172.21.15.40:0/415034457 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e24004150 con 0x7f5e300b4010 2024-09-13T15:34:44.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e177fe640 1 -- 172.21.15.40:0/415034457 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e240042b0 con 0x7f5e300b4010 2024-09-13T15:34:44.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e350b6640 1 -- 172.21.15.40:0/415034457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e30149e30 con 0x7f5e300b4010 2024-09-13T15:34:44.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e177fe640 1 -- 172.21.15.40:0/415034457 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e24003620 con 0x7f5e300b4010 2024-09-13T15:34:44.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e350b6640 1 -- 172.21.15.40:0/415034457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e300bb770 con 0x7f5e300b4010 2024-09-13T15:34:44.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e177fe640 1 -- 172.21.15.40:0/415034457 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f5e240b2040 con 0x7f5e300b4010 2024-09-13T15:34:44.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e350b6640 1 -- 172.21.15.40:0/415034457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e300a4d70 con 0x7f5e300b4010 2024-09-13T15:34:44.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e177fe640 1 --2- 172.21.15.40:0/415034457 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5e1c035450 0x7f5e1c037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:44.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e177fe640 1 -- 172.21.15.40:0/415034457 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f5e240e1980 con 0x7f5e300b4010 2024-09-13T15:34:44.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e2e59c640 1 --2- 172.21.15.40:0/415034457 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5e1c035450 0x7f5e1c037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:44.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.299+0000 7f5e2e59c640 1 --2- 172.21.15.40:0/415034457 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5e1c035450 0x7f5e1c037910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e20007fd0 tx=0x7f5e20007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:44.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.303+0000 7f5e177fe640 1 -- 172.21.15.40:0/415034457 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5e240c68f0 con 0x7f5e300b4010 2024-09-13T15:34:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.503+0000 7f5e350b6640 1 -- 172.21.15.40:0/415034457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f5e30066920 con 0x7f5e300b4010 2024-09-13T15:34:44.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.507+0000 7f5e177fe640 1 -- 172.21.15.40:0/415034457 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+83114 (secure 0 0 0) 0x7f5e240b0070 con 0x7f5e300b4010 2024-09-13T15:34:44.512 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:44.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.511+0000 7f5e350b6640 1 -- 172.21.15.40:0/415034457 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5e1c035450 msgr2=0x7f5e1c037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:44.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.511+0000 7f5e350b6640 1 --2- 172.21.15.40:0/415034457 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5e1c035450 0x7f5e1c037910 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5e20007fd0 tx=0x7f5e20007920 comp rx=0 tx=0).stop 2024-09-13T15:34:44.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.511+0000 7f5e350b6640 1 -- 172.21.15.40:0/415034457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e300b4010 msgr2=0x7f5e300bb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:44.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.511+0000 7f5e350b6640 1 --2- 172.21.15.40:0/415034457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e300b4010 0x7f5e300bb230 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5e240190f0 tx=0x7f5e2401ad20 comp rx=0 tx=0).stop 2024-09-13T15:34:44.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.511+0000 7f5e350b6640 1 -- 172.21.15.40:0/415034457 shutdown_connections 2024-09-13T15:34:44.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.511+0000 7f5e350b6640 1 --2- 172.21.15.40:0/415034457 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5e1c035450 0x7f5e1c037910 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.511+0000 7f5e350b6640 1 --2- 172.21.15.40:0/415034457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e300b4010 0x7f5e300bb230 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.511+0000 7f5e350b6640 1 -- 172.21.15.40:0/415034457 >> 172.21.15.40:0/415034457 conn(0x7f5e3006a540 msgr2=0x7f5e300be070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:44.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.511+0000 7f5e350b6640 1 -- 172.21.15.40:0/415034457 shutdown_connections 2024-09-13T15:34:44.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.511+0000 7f5e350b6640 1 -- 172.21.15.40:0/415034457 wait complete. 2024-09-13T15:34:44.529 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3185150828},{"type":"v1","addr":"172.21.15.40:6825","nonce":3185150828}]},"active_addr":"172.21.15.40:6825/3185150828","active_change":"2024-09-13T15:34:19.049117+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":3629684271}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":414904326}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":3286012502}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":2241829794}]}]} 2024-09-13T15:34:44.531 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T15:34:44.531 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T15:34:44.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:44.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.647+0000 7fc21542f640 1 Processor -- start 2024-09-13T15:34:44.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.647+0000 7fc21542f640 1 -- start start 2024-09-13T15:34:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.647+0000 7fc21542f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc2100be340 0x7fc21015a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.647+0000 7fc21542f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2100c1130 con 0x7fc2100b4600 2024-09-13T15:34:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.647+0000 7fc21542f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21014e780 con 0x7fc2100be340 2024-09-13T15:34:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.647+0000 7fc20effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc2100b4600 0x7fc21014dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38644/0 (socket says 172.21.15.40:38644) 2024-09-13T15:34:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.647+0000 7fc20effd640 1 -- 172.21.15.40:0/655360463 learned_addr learned my addr 172.21.15.40:0/655360463 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.647+0000 7fc20e7fc640 1 --2- 172.21.15.40:0/655360463 >> v2:172.21.15.40:3300/0 conn(0x7fc2100be340 0x7fc21015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.647+0000 7fc20dffb640 1 -- 172.21.15.40:0/655360463 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171386289 0 0) 0x7fc2100c1130 con 0x7fc2100b4600 2024-09-13T15:34:44.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.647+0000 7fc20dffb640 1 -- 172.21.15.40:0/655360463 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1f8003530 con 0x7fc2100b4600 2024-09-13T15:34:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.647+0000 7fc20e7fc640 1 -- 172.21.15.40:0/655360463 >> v1:172.21.15.40:6789/0 conn(0x7fc2100b4600 legacy=0x7fc21014dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.647+0000 7fc20e7fc640 1 -- 172.21.15.40:0/655360463 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21014e450 con 0x7fc2100be340 2024-09-13T15:34:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc20e7fc640 1 --2- 172.21.15.40:0/655360463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100be340 0x7fc21015a750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc204009740 tx=0x7fc20401c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249b49bb0b9ea9e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc20dffb640 1 -- 172.21.15.40:0/655360463 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2040ab530 con 0x7fc2100be340 2024-09-13T15:34:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc20dffb640 1 -- 172.21.15.40:0/655360463 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2040a7050 con 0x7fc2100be340 2024-09-13T15:34:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc20dffb640 1 -- 172.21.15.40:0/655360463 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2040ab7e0 con 0x7fc2100be340 2024-09-13T15:34:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc21542f640 1 -- 172.21.15.40:0/655360463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100be340 msgr2=0x7fc21015a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc21542f640 1 --2- 172.21.15.40:0/655360463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100be340 0x7fc21015a750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc204009740 tx=0x7fc20401c0d0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc21542f640 1 -- 172.21.15.40:0/655360463 shutdown_connections 2024-09-13T15:34:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc21542f640 1 --2- 172.21.15.40:0/655360463 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100be340 0x7fc21015a750 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc21542f640 1 -- 172.21.15.40:0/655360463 >> 172.21.15.40:0/655360463 conn(0x7fc21006a540 msgr2=0x7fc2100a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc21542f640 1 -- 172.21.15.40:0/655360463 shutdown_connections 2024-09-13T15:34:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc21542f640 1 -- 172.21.15.40:0/655360463 wait complete. 2024-09-13T15:34:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc21542f640 1 Processor -- start 2024-09-13T15:34:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc21542f640 1 -- start start 2024-09-13T15:34:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc21542f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100b4600 0x7fc21015f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc21542f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21015b8f0 con 0x7fc2100b4600 2024-09-13T15:34:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc20effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100b4600 0x7fc21015f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc20effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100b4600 0x7fc21015f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47280/0 (socket says 172.21.15.40:47280) 2024-09-13T15:34:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.651+0000 7fc20effd640 1 -- 172.21.15.40:0/2192526142 learned_addr learned my addr 172.21.15.40:0/2192526142 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc20effd640 1 -- 172.21.15.40:0/2192526142 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc204009420 con 0x7fc2100b4600 2024-09-13T15:34:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc20effd640 1 --2- 172.21.15.40:0/2192526142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100b4600 0x7fc21015f360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc20000c450 tx=0x7fc20000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc1f77fe640 1 -- 172.21.15.40:0/2192526142 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc200005c20 con 0x7fc2100b4600 2024-09-13T15:34:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc1f77fe640 1 -- 172.21.15.40:0/2192526142 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc200005d80 con 0x7fc2100b4600 2024-09-13T15:34:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc21542f640 1 -- 172.21.15.40:0/2192526142 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2100bcb00 con 0x7fc2100b4600 2024-09-13T15:34:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc1f77fe640 1 -- 172.21.15.40:0/2192526142 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2000071a0 con 0x7fc2100b4600 2024-09-13T15:34:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc21542f640 1 -- 172.21.15.40:0/2192526142 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2100bcfa0 con 0x7fc2100b4600 2024-09-13T15:34:44.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc21542f640 1 -- 172.21.15.40:0/2192526142 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21015a750 con 0x7fc2100b4600 2024-09-13T15:34:44.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc1f77fe640 1 -- 172.21.15.40:0/2192526142 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fc200007300 con 0x7fc2100b4600 2024-09-13T15:34:44.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc1f77fe640 1 --2- 172.21.15.40:0/2192526142 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc1fc035450 0x7fc1fc037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:44.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc1f77fe640 1 -- 172.21.15.40:0/2192526142 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7fc200046b70 con 0x7fc2100b4600 2024-09-13T15:34:44.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc20e7fc640 1 --2- 172.21.15.40:0/2192526142 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc1fc035450 0x7fc1fc037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:44.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.655+0000 7fc20e7fc640 1 --2- 172.21.15.40:0/2192526142 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc1fc035450 0x7fc1fc037910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2040ad000 tx=0x7fc2040a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.659+0000 7fc1f77fe640 1 -- 172.21.15.40:0/2192526142 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc200012400 con 0x7fc2100b4600 2024-09-13T15:34:44.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.819+0000 7fc21542f640 1 -- 172.21.15.40:0/2192526142 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2100a3b40 con 0x7fc2100b4600 2024-09-13T15:34:44.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.823+0000 7fc1f77fe640 1 -- 172.21.15.40:0/2192526142 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+10503 (secure 0 0 0) 0x7fc200017020 con 0x7fc2100b4600 2024-09-13T15:34:44.824 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:44.825 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:36.294490+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.823+0000 7fc21542f640 1 -- 172.21.15.40:0/2192526142 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc1fc035450 msgr2=0x7fc1fc037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.823+0000 7fc21542f640 1 --2- 172.21.15.40:0/2192526142 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc1fc035450 0x7fc1fc037910 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc2040ad000 tx=0x7fc2040a6000 comp rx=0 tx=0).stop 2024-09-13T15:34:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.823+0000 7fc21542f640 1 -- 172.21.15.40:0/2192526142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100b4600 msgr2=0x7fc21015f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.823+0000 7fc21542f640 1 --2- 172.21.15.40:0/2192526142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100b4600 0x7fc21015f360 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc20000c450 tx=0x7fc20000c910 comp rx=0 tx=0).stop 2024-09-13T15:34:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.823+0000 7fc21542f640 1 -- 172.21.15.40:0/2192526142 shutdown_connections 2024-09-13T15:34:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.823+0000 7fc21542f640 1 --2- 172.21.15.40:0/2192526142 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc1fc035450 0x7fc1fc037910 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.823+0000 7fc21542f640 1 --2- 172.21.15.40:0/2192526142 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2100b4600 0x7fc21015f360 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.823+0000 7fc21542f640 1 -- 172.21.15.40:0/2192526142 >> 172.21.15.40:0/2192526142 conn(0x7fc21006a540 msgr2=0x7fc21006b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:44.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.823+0000 7fc21542f640 1 -- 172.21.15.40:0/2192526142 shutdown_connections 2024-09-13T15:34:44.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.823+0000 7fc21542f640 1 -- 172.21.15.40:0/2192526142 wait complete. 2024-09-13T15:34:44.843 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T15:34:44.843 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.963+0000 7f062970b640 1 Processor -- start 2024-09-13T15:34:44.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.963+0000 7f062970b640 1 -- start start 2024-09-13T15:34:44.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.967+0000 7f062970b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06240b8530 0x7f062406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:44.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.967+0000 7f062970b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06240be820 con 0x7f06240b8910 2024-09-13T15:34:44.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.967+0000 7f062970b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0624153940 con 0x7f06240b8530 2024-09-13T15:34:44.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.967+0000 7f0622ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06240b8530 0x7f062406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:44.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.967+0000 7f0622ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06240b8530 0x7f062406f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47282/0 (socket says 172.21.15.40:47282) 2024-09-13T15:34:44.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.967+0000 7f0622ffd640 1 -- 172.21.15.40:0/445457991 learned_addr learned my addr 172.21.15.40:0/445457991 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:44.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.967+0000 7f061bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f06240b8910 0x7f062406e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38658/0 (socket says 172.21.15.40:38658) 2024-09-13T15:34:44.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.967+0000 7f0622ffd640 1 -- 172.21.15.40:0/445457991 >> v1:172.21.15.40:6789/0 conn(0x7f06240b8910 legacy=0x7f062406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:44.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.967+0000 7f0622ffd640 1 -- 172.21.15.40:0/445457991 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06240c1290 con 0x7f06240b8530 2024-09-13T15:34:44.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.967+0000 7f06227fc640 1 -- 172.21.15.40:0/445457991 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105673334 0 0) 0x7f06240be820 con 0x7f06240b8910 2024-09-13T15:34:44.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f0622ffd640 1 --2- 172.21.15.40:0/445457991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06240b8530 0x7f062406f160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f06140097f0 tx=0x7f061401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cdc14415636a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:44.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f06227fc640 1 -- 172.21.15.40:0/445457991 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06140ab520 con 0x7f06240b8530 2024-09-13T15:34:44.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f06227fc640 1 -- 172.21.15.40:0/445457991 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06140ab680 con 0x7f06240b8530 2024-09-13T15:34:44.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f06227fc640 1 -- 172.21.15.40:0/445457991 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06140ab940 con 0x7f06240b8530 2024-09-13T15:34:44.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 -- 172.21.15.40:0/445457991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06240b8530 msgr2=0x7f062406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:44.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 --2- 172.21.15.40:0/445457991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06240b8530 0x7f062406f160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f06140097f0 tx=0x7f061401c4e0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 -- 172.21.15.40:0/445457991 shutdown_connections 2024-09-13T15:34:44.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 --2- 172.21.15.40:0/445457991 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06240b8530 0x7f062406f160 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:44.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 -- 172.21.15.40:0/445457991 >> 172.21.15.40:0/445457991 conn(0x7f062406a540 msgr2=0x7f06240a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:44.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 -- 172.21.15.40:0/445457991 shutdown_connections 2024-09-13T15:34:44.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 -- 172.21.15.40:0/445457991 wait complete. 2024-09-13T15:34:44.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 Processor -- start 2024-09-13T15:34:44.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 -- start start 2024-09-13T15:34:44.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06240b8530 0x7f062413d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:44.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624142770 con 0x7f06240b8530 2024-09-13T15:34:44.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f0622ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06240b8530 0x7f062413d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:44.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f0622ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06240b8530 0x7f062413d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47296/0 (socket says 172.21.15.40:47296) 2024-09-13T15:34:44.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f0622ffd640 1 -- 172.21.15.40:0/77053009 learned_addr learned my addr 172.21.15.40:0/77053009 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:44.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f0622ffd640 1 -- 172.21.15.40:0/77053009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06140094d0 con 0x7f06240b8530 2024-09-13T15:34:44.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f0622ffd640 1 --2- 172.21.15.40:0/77053009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06240b8530 0x7f062413d1f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f06140190f0 tx=0x7f061401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:44.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f061b7fe640 1 -- 172.21.15.40:0/77053009 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06140ab4d0 con 0x7f06240b8530 2024-09-13T15:34:44.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f061b7fe640 1 -- 172.21.15.40:0/77053009 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06140b4600 con 0x7f06240b8530 2024-09-13T15:34:44.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 -- 172.21.15.40:0/77053009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062413d730 con 0x7f06240b8530 2024-09-13T15:34:44.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f061b7fe640 1 -- 172.21.15.40:0/77053009 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06140b48e0 con 0x7f06240b8530 2024-09-13T15:34:44.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.971+0000 7f062970b640 1 -- 172.21.15.40:0/77053009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062415f240 con 0x7f06240b8530 2024-09-13T15:34:44.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.975+0000 7f061b7fe640 1 -- 172.21.15.40:0/77053009 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f06140b4a40 con 0x7f06240b8530 2024-09-13T15:34:44.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.975+0000 7f061b7fe640 1 --2- 172.21.15.40:0/77053009 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0604035450 0x7f0604037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:44.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.975+0000 7f061b7fe640 1 -- 172.21.15.40:0/77053009 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f06140a8050 con 0x7f06240b8530 2024-09-13T15:34:44.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.975+0000 7f062970b640 1 -- 172.21.15.40:0/77053009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06240c0020 con 0x7f06240b8530 2024-09-13T15:34:44.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.975+0000 7f061bfff640 1 --2- 172.21.15.40:0/77053009 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0604035450 0x7f0604037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:44.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.975+0000 7f061bfff640 1 --2- 172.21.15.40:0/77053009 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0604035450 0x7f0604037910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f060c007fd0 tx=0x7f060c007940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:44.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:44.979+0000 7f061b7fe640 1 -- 172.21.15.40:0/77053009 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06140b3380 con 0x7f06240b8530 2024-09-13T15:34:45.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.143+0000 7f062970b640 1 -- 172.21.15.40:0/77053009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f062415dd50 con 0x7f06240b8530 2024-09-13T15:34:45.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.143+0000 7f061b7fe640 1 -- 172.21.15.40:0/77053009 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+10503 (secure 0 0 0) 0x7f06140c63a0 con 0x7f06240b8530 2024-09-13T15:34:45.145 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:45.145 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:36.294490+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:45.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.143+0000 7f062970b640 1 -- 172.21.15.40:0/77053009 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0604035450 msgr2=0x7f0604037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.143+0000 7f062970b640 1 --2- 172.21.15.40:0/77053009 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0604035450 0x7f0604037910 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f060c007fd0 tx=0x7f060c007940 comp rx=0 tx=0).stop 2024-09-13T15:34:45.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.143+0000 7f062970b640 1 -- 172.21.15.40:0/77053009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06240b8530 msgr2=0x7f062413d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.143+0000 7f062970b640 1 --2- 172.21.15.40:0/77053009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06240b8530 0x7f062413d1f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f06140190f0 tx=0x7f061401ad20 comp rx=0 tx=0).stop 2024-09-13T15:34:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.143+0000 7f062970b640 1 -- 172.21.15.40:0/77053009 shutdown_connections 2024-09-13T15:34:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.143+0000 7f062970b640 1 --2- 172.21.15.40:0/77053009 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0604035450 0x7f0604037910 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.143+0000 7f062970b640 1 --2- 172.21.15.40:0/77053009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06240b8530 0x7f062413d1f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.143+0000 7f062970b640 1 -- 172.21.15.40:0/77053009 >> 172.21.15.40:0/77053009 conn(0x7f062406a540 msgr2=0x7f0624144d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.143+0000 7f062970b640 1 -- 172.21.15.40:0/77053009 shutdown_connections 2024-09-13T15:34:45.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.143+0000 7f062970b640 1 -- 172.21.15.40:0/77053009 wait complete. 2024-09-13T15:34:45.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T15:34:45.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T15:34:45.166 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T15:34:45.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.275+0000 7f091c6e2640 1 Processor -- start 2024-09-13T15:34:45.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.275+0000 7f091c6e2640 1 -- start start 2024-09-13T15:34:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.275+0000 7f9d4f5e4640 1 Processor -- start 2024-09-13T15:34:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.275+0000 7f9d4f5e4640 1 -- start start 2024-09-13T15:34:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f091c6e2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f091406da80 0x7f091406b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f091c6e2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091406c020 con 0x7f091406d6a0 2024-09-13T15:34:45.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f091c6e2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09140ba300 con 0x7f091406da80 2024-09-13T15:34:45.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f9d4f5e4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d48069f20 0x7f9d4806a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f9d4f5e4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d480b6d60 con 0x7f9d48151380 2024-09-13T15:34:45.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f9d4f5e4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d480b7b60 con 0x7f9d48069f20 2024-09-13T15:34:45.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f9d4d380640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d48069f20 0x7f9d4806a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f9d4d380640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9d48069f20 0x7f9d4806a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47312/0 (socket says 172.21.15.40:47312) 2024-09-13T15:34:45.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f9d4d380640 1 -- 172.21.15.40:0/800753249 learned_addr learned my addr 172.21.15.40:0/800753249 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:45.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f0919c7d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f091406da80 0x7f091406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f0919c7d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f091406da80 0x7f091406b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47308/0 (socket says 172.21.15.40:47308) 2024-09-13T15:34:45.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f091a47e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f091406d6a0 0x7f09140ba7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38674/0 (socket says 172.21.15.40:38674) 2024-09-13T15:34:45.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f0919c7d640 1 -- 172.21.15.40:0/518586534 learned_addr learned my addr 172.21.15.40:0/518586534 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:45.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f9d4d380640 1 -- 172.21.15.40:0/800753249 >> v1:172.21.15.40:6789/0 conn(0x7f9d48151380 legacy=0x7f9d480b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f9d4d380640 1 -- 172.21.15.40:0/800753249 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d480bda80 con 0x7f9d48069f20 2024-09-13T15:34:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f0919c7d640 1 -- 172.21.15.40:0/518586534 >> v1:172.21.15.40:6789/0 conn(0x7f091406d6a0 legacy=0x7f09140ba7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f0919c7d640 1 -- 172.21.15.40:0/518586534 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09140baeb0 con 0x7f091406da80 2024-09-13T15:34:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f091947c640 1 -- 172.21.15.40:0/518586534 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218273744 0 0) 0x7f091406c020 con 0x7f091406d6a0 2024-09-13T15:34:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f9d4d380640 1 --2- 172.21.15.40:0/800753249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d48069f20 0x7f9d4806a300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9d440097f0 tx=0x7f9d4401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab79fde6fe4d7f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f0919c7d640 1 --2- 172.21.15.40:0/518586534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f091406da80 0x7f091406b030 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f09040097f0 tx=0x7f090401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664784db29aa2976 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f9d3ffff640 1 -- 172.21.15.40:0/800753249 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d440ad460 con 0x7f9d48069f20 2024-09-13T15:34:45.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f9d3ffff640 1 -- 172.21.15.40:0/800753249 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d440ad5c0 con 0x7f9d48069f20 2024-09-13T15:34:45.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f9d3ffff640 1 -- 172.21.15.40:0/800753249 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d440ad880 con 0x7f9d48069f20 2024-09-13T15:34:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f091947c640 1 -- 172.21.15.40:0/518586534 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09040ab470 con 0x7f091406da80 2024-09-13T15:34:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f091947c640 1 -- 172.21.15.40:0/518586534 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09040ab5d0 con 0x7f091406da80 2024-09-13T15:34:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.279+0000 7f091947c640 1 -- 172.21.15.40:0/518586534 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09040ab890 con 0x7f091406da80 2024-09-13T15:34:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 -- 172.21.15.40:0/518586534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f091406da80 msgr2=0x7f091406b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 --2- 172.21.15.40:0/518586534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f091406da80 0x7f091406b030 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f09040097f0 tx=0x7f090401c450 comp rx=0 tx=0).stop 2024-09-13T15:34:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 -- 172.21.15.40:0/518586534 shutdown_connections 2024-09-13T15:34:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 --2- 172.21.15.40:0/518586534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f091406da80 0x7f091406b030 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/800753249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d48069f20 msgr2=0x7f9d4806a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4f5e4640 1 --2- 172.21.15.40:0/800753249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d48069f20 0x7f9d4806a300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9d440097f0 tx=0x7f9d4401c450 comp rx=0 tx=0).stop 2024-09-13T15:34:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 -- 172.21.15.40:0/518586534 >> 172.21.15.40:0/518586534 conn(0x7f09140a64c0 msgr2=0x7f09140a68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 -- 172.21.15.40:0/518586534 shutdown_connections 2024-09-13T15:34:45.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 -- 172.21.15.40:0/518586534 wait complete. 2024-09-13T15:34:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/800753249 shutdown_connections 2024-09-13T15:34:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4f5e4640 1 --2- 172.21.15.40:0/800753249 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d48069f20 0x7f9d4806a300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/800753249 >> 172.21.15.40:0/800753249 conn(0x7f9d4806b200 msgr2=0x7f9d4806b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/800753249 shutdown_connections 2024-09-13T15:34:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/800753249 wait complete. 2024-09-13T15:34:45.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 Processor -- start 2024-09-13T15:34:45.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4f5e4640 1 Processor -- start 2024-09-13T15:34:45.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 -- start start 2024-09-13T15:34:45.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4f5e4640 1 -- start start 2024-09-13T15:34:45.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f0d65952640 1 Processor -- start 2024-09-13T15:34:45.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f091406d6a0 0x7f091414a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09141454f0 con 0x7f091406d6a0 2024-09-13T15:34:45.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4f5e4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d48069f20 0x7f9d481379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f0d65952640 1 -- start start 2024-09-13T15:34:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4f5e4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4813c7e0 con 0x7f9d48069f20 2024-09-13T15:34:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091a47e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f091406d6a0 0x7f091414a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4d380640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d48069f20 0x7f9d481379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091a47e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f091406d6a0 0x7f091414a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47324/0 (socket says 172.21.15.40:47324) 2024-09-13T15:34:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091a47e640 1 -- 172.21.15.40:0/3383239415 learned_addr learned my addr 172.21.15.40:0/3383239415 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4d380640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d48069f20 0x7f9d481379a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47340/0 (socket says 172.21.15.40:47340) 2024-09-13T15:34:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4d380640 1 -- 172.21.15.40:0/281084488 learned_addr learned my addr 172.21.15.40:0/281084488 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:45.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091a47e640 1 -- 172.21.15.40:0/3383239415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09040094d0 con 0x7f091406d6a0 2024-09-13T15:34:45.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4d380640 1 -- 172.21.15.40:0/281084488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d440094d0 con 0x7f9d48069f20 2024-09-13T15:34:45.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091a47e640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f091406d6a0 0x7f091414a630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f09100011f0 tx=0x7f091000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f9d4d380640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d48069f20 0x7f9d481379a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d4401a080 tx=0x7f9d440191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f090affd640 1 -- 172.21.15.40:0/3383239415 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0910007410 con 0x7f091406d6a0 2024-09-13T15:34:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f090affd640 1 -- 172.21.15.40:0/3383239415 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0910007570 con 0x7f091406d6a0 2024-09-13T15:34:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 -- 172.21.15.40:0/3383239415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0914147390 con 0x7f091406d6a0 2024-09-13T15:34:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f0d65952640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0d60070a90 0x7f0d600b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f0d65952640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d600b6470 con 0x7f0d600706b0 2024-09-13T15:34:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f0d65952640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d60151710 con 0x7f0d60070a90 2024-09-13T15:34:45.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d3dffb640 1 -- 172.21.15.40:0/281084488 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d440b6620 con 0x7f9d48069f20 2024-09-13T15:34:45.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f090affd640 1 -- 172.21.15.40:0/3383239415 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09100047f0 con 0x7f091406d6a0 2024-09-13T15:34:45.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.283+0000 7f091c6e2640 1 -- 172.21.15.40:0/3383239415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0914149c50 con 0x7f091406d6a0 2024-09-13T15:34:45.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d3dffb640 1 -- 172.21.15.40:0/281084488 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d440b6780 con 0x7f9d48069f20 2024-09-13T15:34:45.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f090affd640 1 -- 172.21.15.40:0/3383239415 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f0910004950 con 0x7f091406d6a0 2024-09-13T15:34:45.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f091c6e2640 1 -- 172.21.15.40:0/3383239415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f091406b030 con 0x7f091406d6a0 2024-09-13T15:34:45.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f0d57fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0d60070a90 0x7f0d600b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f0d57fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0d60070a90 0x7f0d600b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47342/0 (socket says 172.21.15.40:47342) 2024-09-13T15:34:45.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f0d57fff640 1 -- 172.21.15.40:0/909659627 learned_addr learned my addr 172.21.15.40:0/909659627 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:45.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f090affd640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f08f8035450 0x7f08f8037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d3dffb640 1 -- 172.21.15.40:0/281084488 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d440b6a60 con 0x7f9d48069f20 2024-09-13T15:34:45.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/281084488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d48139a90 con 0x7f9d48069f20 2024-09-13T15:34:45.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f090affd640 1 -- 172.21.15.40:0/3383239415 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f0910046bf0 con 0x7f091406d6a0 2024-09-13T15:34:45.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/281084488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4813b8f0 con 0x7f9d48069f20 2024-09-13T15:34:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f090affd640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] conn(0x7f08f803c310 0x7f08f803e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f0919c7d640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f08f8035450 0x7f08f8037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f090affd640 1 -- 172.21.15.40:0/3383239415 --> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f08f803ee20 con 0x7f08f803c310 2024-09-13T15:34:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f090affd640 1 -- 172.21.15.40:0/3383239415 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f091004b2a0 con 0x7f091406d6a0 2024-09-13T15:34:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f0d57fff640 1 -- 172.21.15.40:0/909659627 >> v1:172.21.15.40:6789/0 conn(0x7f0d600706b0 legacy=0x7f0d600713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:34:45.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f0d57fff640 1 -- 172.21.15.40:0/909659627 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d60150400 con 0x7f0d60070a90 2024-09-13T15:34:45.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f0919c7d640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f08f8035450 0x7f08f8037910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f09040af000 tx=0x7f09040a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/281084488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9d480b51b0 con 0x7f9d48069f20 2024-09-13T15:34:45.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d3dffb640 1 -- 172.21.15.40:0/281084488 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f9d440b4040 con 0x7f9d48069f20 2024-09-13T15:34:45.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d3dffb640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9d2c035430 0x7f9d2c0378f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d3dffb640 1 -- 172.21.15.40:0/281084488 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f9d440e1a80 con 0x7f9d48069f20 2024-09-13T15:34:45.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d4cb7f640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9d2c035430 0x7f9d2c0378f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d3dffb640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] conn(0x7f9d2c03c200 0x7f9d2c03e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d3dffb640 1 -- 172.21.15.40:0/281084488 --> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d2c03ed10 con 0x7f9d2c03c200 2024-09-13T15:34:45.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d3dffb640 1 -- 172.21.15.40:0/281084488 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d440e6220 con 0x7f9d48069f20 2024-09-13T15:34:45.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d4db81640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] conn(0x7f9d2c03c200 0x7f9d2c03e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d4cb7f640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9d2c035430 0x7f9d2c0378f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d38001590 tx=0x7f9d38007a60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d4db81640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] conn(0x7f9d2c03c200 0x7f9d2c03e640 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f091ac7f640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] conn(0x7f08f803c310 0x7f08f803e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f0d57fff640 1 --2- 172.21.15.40:0/909659627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d60070a90 0x7f0d600b87e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0d480097f0 tx=0x7f0d4801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967b343d0b5ab688 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f9d3dffb640 1 -- 172.21.15.40:0/281084488 <== osd.2 v2:172.21.15.40:6816/1072951307 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9d2c03ed10 con 0x7f9d2c03c200 2024-09-13T15:34:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f0d5e7fc640 1 -- 172.21.15.40:0/909659627 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d480a88c0 con 0x7f0d60070a90 2024-09-13T15:34:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f0d5e7fc640 1 -- 172.21.15.40:0/909659627 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d480a8a20 con 0x7f0d60070a90 2024-09-13T15:34:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.287+0000 7f0d5e7fc640 1 -- 172.21.15.40:0/909659627 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d480a8ce0 con 0x7f0d60070a90 2024-09-13T15:34:45.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f091ac7f640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] conn(0x7f08f803c310 0x7f08f803e750 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 -- 172.21.15.40:0/909659627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d60070a90 msgr2=0x7f0d600b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 --2- 172.21.15.40:0/909659627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d60070a90 0x7f0d600b87e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0d480097f0 tx=0x7f0d4801ec90 comp rx=0 tx=0).stop 2024-09-13T15:34:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 -- 172.21.15.40:0/909659627 shutdown_connections 2024-09-13T15:34:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 --2- 172.21.15.40:0/909659627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d60070a90 0x7f0d600b87e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 -- 172.21.15.40:0/909659627 >> 172.21.15.40:0/909659627 conn(0x7f0d60065d40 msgr2=0x7f0d60066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 -- 172.21.15.40:0/909659627 shutdown_connections 2024-09-13T15:34:45.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f090affd640 1 -- 172.21.15.40:0/3383239415 <== osd.0 v2:172.21.15.40:6808/3314126899 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f08f803ee20 con 0x7f08f803c310 2024-09-13T15:34:45.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 -- 172.21.15.40:0/909659627 wait complete. 2024-09-13T15:34:45.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 Processor -- start 2024-09-13T15:34:45.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 -- start start 2024-09-13T15:34:45.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d600706b0 0x7f0d6014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6006bf10 con 0x7f0d600706b0 2024-09-13T15:34:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d5effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d600706b0 0x7f0d6014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d5effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d600706b0 0x7f0d6014fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47358/0 (socket says 172.21.15.40:47358) 2024-09-13T15:34:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d5effd640 1 -- 172.21.15.40:0/553860712 learned_addr learned my addr 172.21.15.40:0/553860712 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d5effd640 1 -- 172.21.15.40:0/553860712 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d480094d0 con 0x7f0d600706b0 2024-09-13T15:34:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d5effd640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d600706b0 0x7f0d6014fa90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000c390 tx=0x7f0d50001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d5cff9640 1 -- 172.21.15.40:0/553860712 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d50005410 con 0x7f0d600706b0 2024-09-13T15:34:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d5cff9640 1 -- 172.21.15.40:0/553860712 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d50003600 con 0x7f0d600706b0 2024-09-13T15:34:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d5cff9640 1 -- 172.21.15.40:0/553860712 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d500038e0 con 0x7f0d600706b0 2024-09-13T15:34:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 -- 172.21.15.40:0/553860712 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d60071b50 con 0x7f0d600706b0 2024-09-13T15:34:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.291+0000 7f0d65952640 1 -- 172.21.15.40:0/553860712 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d600bbc70 con 0x7f0d600706b0 2024-09-13T15:34:45.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.295+0000 7f0d65952640 1 -- 172.21.15.40:0/553860712 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d600bc870 con 0x7f0d600706b0 2024-09-13T15:34:45.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.295+0000 7f0d5cff9640 1 -- 172.21.15.40:0/553860712 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f0d50003a40 con 0x7f0d600706b0 2024-09-13T15:34:45.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.295+0000 7f0d5cff9640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0d40035450 0x7f0d40037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.295+0000 7f0d5cff9640 1 -- 172.21.15.40:0/553860712 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f0d50046ca0 con 0x7f0d600706b0 2024-09-13T15:34:45.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.295+0000 7f0d5cff9640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] conn(0x7f0d4003c310 0x7f0d4003e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.295+0000 7f0d5cff9640 1 -- 172.21.15.40:0/553860712 --> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d4003ee20 con 0x7f0d4003c310 2024-09-13T15:34:45.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.295+0000 7f0d5cff9640 1 -- 172.21.15.40:0/553860712 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d50049310 con 0x7f0d600706b0 2024-09-13T15:34:45.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.295+0000 7f0d57fff640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0d40035450 0x7f0d40037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.295+0000 7f0d5f7fe640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] conn(0x7f0d4003c310 0x7f0d4003e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.295+0000 7f0d5f7fe640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] conn(0x7f0d4003c310 0x7f0d4003e750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.295+0000 7f0d57fff640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0d40035450 0x7f0d40037910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0d480b2000 tx=0x7f0d480aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.295+0000 7f0d5cff9640 1 -- 172.21.15.40:0/553860712 <== osd.1 v2:172.21.15.40:6800/884315373 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0d4003ee20 con 0x7f0d4003c310 2024-09-13T15:34:45.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.303+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/281084488 --> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9d4813c630 con 0x7f9d2c03c200 2024-09-13T15:34:45.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.303+0000 7f9d3dffb640 1 -- 172.21.15.40:0/281084488 <== osd.2 v2:172.21.15.40:6816/1072951307 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9d4813c630 con 0x7f9d2c03c200 2024-09-13T15:34:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] conn(0x7f9d2c03c200 msgr2=0x7f9d2c03e640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] conn(0x7f9d2c03c200 0x7f9d2c03e640 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9d2c035430 msgr2=0x7f9d2c0378f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9d2c035430 0x7f9d2c0378f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9d38001590 tx=0x7f9d38007a60 comp rx=0 tx=0).stop 2024-09-13T15:34:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d48069f20 msgr2=0x7f9d481379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d48069f20 0x7f9d481379a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d4401a080 tx=0x7f9d440191f0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/281084488 shutdown_connections 2024-09-13T15:34:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] conn(0x7f9d2c03c200 0x7f9d2c03e640 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9d2c035430 0x7f9d2c0378f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 --2- 172.21.15.40:0/281084488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9d48069f20 0x7f9d481379a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/281084488 >> 172.21.15.40:0/281084488 conn(0x7f9d4806b200 msgr2=0x7f9d4806bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/281084488 shutdown_connections 2024-09-13T15:34:45.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.307+0000 7f9d4f5e4640 1 -- 172.21.15.40:0/281084488 wait complete. 2024-09-13T15:34:45.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 -- 172.21.15.40:0/3383239415 --> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0914147520 con 0x7f08f803c310 2024-09-13T15:34:45.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f090affd640 1 -- 172.21.15.40:0/3383239415 <== osd.0 v2:172.21.15.40:6808/3314126899 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0914147520 con 0x7f08f803c310 2024-09-13T15:34:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 -- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] conn(0x7f08f803c310 msgr2=0x7f08f803e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] conn(0x7f08f803c310 0x7f08f803e750 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 -- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f08f8035450 msgr2=0x7f08f8037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f08f8035450 0x7f08f8037910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f09040af000 tx=0x7f09040a7000 comp rx=0 tx=0).stop 2024-09-13T15:34:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 -- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f091406d6a0 msgr2=0x7f091414a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f091406d6a0 0x7f091414a630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f09100011f0 tx=0x7f091000c930 comp rx=0 tx=0).stop 2024-09-13T15:34:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 -- 172.21.15.40:0/3383239415 shutdown_connections 2024-09-13T15:34:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] conn(0x7f08f803c310 0x7f08f803e750 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f08f8035450 0x7f08f8037910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 --2- 172.21.15.40:0/3383239415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f091406d6a0 0x7f091414a630 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 -- 172.21.15.40:0/3383239415 >> 172.21.15.40:0/3383239415 conn(0x7f09140a64c0 msgr2=0x7f091414e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 -- 172.21.15.40:0/3383239415 shutdown_connections 2024-09-13T15:34:45.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.315+0000 7f091c6e2640 1 -- 172.21.15.40:0/3383239415 wait complete. 2024-09-13T15:34:45.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.319+0000 7f0d65952640 1 -- 172.21.15.40:0/553860712 --> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d60066910 con 0x7f0d4003c310 2024-09-13T15:34:45.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.319+0000 7f0d5cff9640 1 -- 172.21.15.40:0/553860712 <== osd.1 v2:172.21.15.40:6800/884315373 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0d58011040 con 0x7f0d4003c310 2024-09-13T15:34:45.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 -- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] conn(0x7f0d4003c310 msgr2=0x7f0d4003e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] conn(0x7f0d4003c310 0x7f0d4003e750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 -- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0d40035450 msgr2=0x7f0d40037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0d40035450 0x7f0d40037910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0d480b2000 tx=0x7f0d480aa070 comp rx=0 tx=0).stop 2024-09-13T15:34:45.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 -- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d600706b0 msgr2=0x7f0d6014fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d600706b0 0x7f0d6014fa90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000c390 tx=0x7f0d50001e80 comp rx=0 tx=0).stop 2024-09-13T15:34:45.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 -- 172.21.15.40:0/553860712 shutdown_connections 2024-09-13T15:34:45.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] conn(0x7f0d4003c310 0x7f0d4003e750 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0d40035450 0x7f0d40037910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 --2- 172.21.15.40:0/553860712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d600706b0 0x7f0d6014fa90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 -- 172.21.15.40:0/553860712 >> 172.21.15.40:0/553860712 conn(0x7f0d60065d40 msgr2=0x7f0d600713b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 -- 172.21.15.40:0/553860712 shutdown_connections 2024-09-13T15:34:45.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.323+0000 7f0d65952640 1 -- 172.21.15.40:0/553860712 wait complete. 2024-09-13T15:34:45.326 INFO:teuthology.orchestra.run.smithi040.stdout:34359738376 2024-09-13T15:34:45.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T15:34:45.337 INFO:teuthology.orchestra.run.smithi040.stdout:34359738377 2024-09-13T15:34:45.338 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T15:34:45.344 INFO:teuthology.orchestra.run.smithi040.stdout:34359738375 2024-09-13T15:34:45.345 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T15:34:45.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.435+0000 7f2466193640 1 Processor -- start 2024-09-13T15:34:45.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.435+0000 7f2466193640 1 -- start start 2024-09-13T15:34:45.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.435+0000 7f2466193640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2460153f60 0x7f24600c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.435+0000 7f2466193640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24600a7850 con 0x7f24600b7bd0 2024-09-13T15:34:45.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.435+0000 7f2466193640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246008c4f0 con 0x7f2460153f60 2024-09-13T15:34:45.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.435+0000 7f245f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2460153f60 0x7f24600c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.435+0000 7f2457fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f24600b7bd0 0x7f24600c06e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38706/0 (socket says 172.21.15.40:38706) 2024-09-13T15:34:45.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.435+0000 7f245f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2460153f60 0x7f24600c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47366/0 (socket says 172.21.15.40:47366) 2024-09-13T15:34:45.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.435+0000 7f2457fff640 1 -- 172.21.15.40:0/762626484 learned_addr learned my addr 172.21.15.40:0/762626484 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:45.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.435+0000 7f245f7fe640 1 -- 172.21.15.40:0/762626484 >> v1:172.21.15.40:6789/0 conn(0x7f24600b7bd0 legacy=0x7f24600c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.435+0000 7f245f7fe640 1 -- 172.21.15.40:0/762626484 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246008bdb0 con 0x7f2460153f60 2024-09-13T15:34:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f245f7fe640 1 --2- 172.21.15.40:0/762626484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2460153f60 0x7f24600c4b90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2450009770 tx=0x7f245001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f3b1fdf4872c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f245effd640 1 -- 172.21.15.40:0/762626484 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24500ab530 con 0x7f2460153f60 2024-09-13T15:34:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f245effd640 1 -- 172.21.15.40:0/762626484 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24500a7050 con 0x7f2460153f60 2024-09-13T15:34:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f245effd640 1 -- 172.21.15.40:0/762626484 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24500ab7e0 con 0x7f2460153f60 2024-09-13T15:34:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f2466193640 1 -- 172.21.15.40:0/762626484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2460153f60 msgr2=0x7f24600c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f2466193640 1 --2- 172.21.15.40:0/762626484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2460153f60 0x7f24600c4b90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2450009770 tx=0x7f245001c420 comp rx=0 tx=0).stop 2024-09-13T15:34:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f2466193640 1 -- 172.21.15.40:0/762626484 shutdown_connections 2024-09-13T15:34:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f2466193640 1 --2- 172.21.15.40:0/762626484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2460153f60 0x7f24600c4b90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f2466193640 1 -- 172.21.15.40:0/762626484 >> 172.21.15.40:0/762626484 conn(0x7f24600a8640 msgr2=0x7f2460065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f2466193640 1 -- 172.21.15.40:0/762626484 shutdown_connections 2024-09-13T15:34:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f2466193640 1 -- 172.21.15.40:0/762626484 wait complete. 2024-09-13T15:34:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f2466193640 1 Processor -- start 2024-09-13T15:34:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.439+0000 7f2466193640 1 -- start start 2024-09-13T15:34:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f2466193640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24600b7bd0 0x7f24601583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f2466193640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24601ebaf0 con 0x7f24600b7bd0 2024-09-13T15:34:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f245f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24600b7bd0 0x7f24601583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f245f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24600b7bd0 0x7f24601583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47378/0 (socket says 172.21.15.40:47378) 2024-09-13T15:34:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f245f7fe640 1 -- 172.21.15.40:0/2913786248 learned_addr learned my addr 172.21.15.40:0/2913786248 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f245f7fe640 1 -- 172.21.15.40:0/2913786248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2450009420 con 0x7f24600b7bd0 2024-09-13T15:34:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f245f7fe640 1 --2- 172.21.15.40:0/2913786248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24600b7bd0 0x7f24601583e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f245001a050 tx=0x7f245001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f245cff9640 1 -- 172.21.15.40:0/2913786248 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24500b7450 con 0x7f24600b7bd0 2024-09-13T15:34:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f245cff9640 1 -- 172.21.15.40:0/2913786248 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24500b75b0 con 0x7f24600b7bd0 2024-09-13T15:34:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f2466193640 1 -- 172.21.15.40:0/2913786248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246015aa00 con 0x7f24600b7bd0 2024-09-13T15:34:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f245cff9640 1 -- 172.21.15.40:0/2913786248 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f24500b7870 con 0x7f24600b7bd0 2024-09-13T15:34:45.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f2466193640 1 -- 172.21.15.40:0/2913786248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24601ebe70 con 0x7f24600b7bd0 2024-09-13T15:34:45.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f245cff9640 1 -- 172.21.15.40:0/2913786248 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f24500b79d0 con 0x7f24600b7bd0 2024-09-13T15:34:45.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f245cff9640 1 --2- 172.21.15.40:0/2913786248 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2440035450 0x7f2440037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f2466193640 1 -- 172.21.15.40:0/2913786248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2460067510 con 0x7f24600b7bd0 2024-09-13T15:34:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f245cff9640 1 -- 172.21.15.40:0/2913786248 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f24500e1f90 con 0x7f24600b7bd0 2024-09-13T15:34:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f2457fff640 1 --2- 172.21.15.40:0/2913786248 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2440035450 0x7f2440037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.443+0000 7f2457fff640 1 --2- 172.21.15.40:0/2913786248 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2440035450 0x7f2440037910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2448001610 tx=0x7f2448007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.447+0000 7f245cff9640 1 -- 172.21.15.40:0/2913786248 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f24500c74e0 con 0x7f24600b7bd0 2024-09-13T15:34:45.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.499+0000 7f8c18a37640 1 Processor -- start 2024-09-13T15:34:45.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.499+0000 7f8c18a37640 1 -- start start 2024-09-13T15:34:45.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.499+0000 7f8c18a37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c140b7bd0 0x7f8c140c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.499+0000 7f8c18a37640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c140a7850 con 0x7f8c14153f60 2024-09-13T15:34:45.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.499+0000 7f8c18a37640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1408c4f0 con 0x7f8c140b7bd0 2024-09-13T15:34:45.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.499+0000 7f8c11d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c140b7bd0 0x7f8c140c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.499+0000 7f8c1259c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8c14153f60 0x7f8c140c4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38720/0 (socket says 172.21.15.40:38720) 2024-09-13T15:34:45.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.499+0000 7f8c1259c640 1 -- 172.21.15.40:0/1301489231 learned_addr learned my addr 172.21.15.40:0/1301489231 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:45.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.499+0000 7f8c11d9b640 1 -- 172.21.15.40:0/1301489231 >> v1:172.21.15.40:6789/0 conn(0x7f8c14153f60 legacy=0x7f8c140c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.499+0000 7f8c11d9b640 1 -- 172.21.15.40:0/1301489231 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1408bdb0 con 0x7f8c140b7bd0 2024-09-13T15:34:45.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.499+0000 7fb022707640 1 Processor -- start 2024-09-13T15:34:45.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.499+0000 7fb022707640 1 -- start start 2024-09-13T15:34:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c11d9b640 1 --2- 172.21.15.40:0/1301489231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c140b7bd0 0x7f8c140c06e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8c08009770 tx=0x7f8c0801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdfc57358bae8e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7fb022707640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb01c08afa0 0x7fb01c08b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7fb022707640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c08bb80 con 0x7fb01c0b7e10 2024-09-13T15:34:45.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7fb022707640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c152730 con 0x7fb01c08afa0 2024-09-13T15:34:45.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c1159a640 1 -- 172.21.15.40:0/1301489231 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c080ab530 con 0x7f8c140b7bd0 2024-09-13T15:34:45.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7fb01bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb01c08afa0 0x7fb01c08b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c1159a640 1 -- 172.21.15.40:0/1301489231 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c080a7050 con 0x7f8c140b7bd0 2024-09-13T15:34:45.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c1159a640 1 -- 172.21.15.40:0/1301489231 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c080ab7e0 con 0x7f8c140b7bd0 2024-09-13T15:34:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7fb01bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb01c08afa0 0x7fb01c08b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47406/0 (socket says 172.21.15.40:47406) 2024-09-13T15:34:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7fb01bfff640 1 -- 172.21.15.40:0/2233290782 learned_addr learned my addr 172.21.15.40:0/2233290782 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7fb01bfff640 1 -- 172.21.15.40:0/2233290782 >> v1:172.21.15.40:6789/0 conn(0x7fb01c0b7e10 legacy=0x7fb01c151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7fb01bfff640 1 -- 172.21.15.40:0/2233290782 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c08bdb0 con 0x7fb01c08afa0 2024-09-13T15:34:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c18a37640 1 -- 172.21.15.40:0/1301489231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c140b7bd0 msgr2=0x7f8c140c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c18a37640 1 --2- 172.21.15.40:0/1301489231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c140b7bd0 0x7f8c140c06e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8c08009770 tx=0x7f8c0801c420 comp rx=0 tx=0).stop 2024-09-13T15:34:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c18a37640 1 -- 172.21.15.40:0/1301489231 shutdown_connections 2024-09-13T15:34:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c18a37640 1 --2- 172.21.15.40:0/1301489231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c140b7bd0 0x7f8c140c06e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c18a37640 1 -- 172.21.15.40:0/1301489231 >> 172.21.15.40:0/1301489231 conn(0x7f8c140a8640 msgr2=0x7f8c14065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c18a37640 1 -- 172.21.15.40:0/1301489231 shutdown_connections 2024-09-13T15:34:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c18a37640 1 -- 172.21.15.40:0/1301489231 wait complete. 2024-09-13T15:34:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c18a37640 1 Processor -- start 2024-09-13T15:34:45.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.503+0000 7f8c18a37640 1 -- start start 2024-09-13T15:34:45.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb01bfff640 1 --2- 172.21.15.40:0/2233290782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01c08afa0 0x7fb01c08b380 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0097f0 tx=0x7fb00c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4303bc01484a26a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb01affd640 1 -- 172.21.15.40:0/2233290782 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb00c0ab530 con 0x7fb01c08afa0 2024-09-13T15:34:45.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb01affd640 1 -- 172.21.15.40:0/2233290782 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c0a7050 con 0x7fb01c08afa0 2024-09-13T15:34:45.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb01affd640 1 -- 172.21.15.40:0/2233290782 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb00c0ab7e0 con 0x7fb01c08afa0 2024-09-13T15:34:45.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c18a37640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c14153f60 0x7f8c14161310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c18a37640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c141ec180 con 0x7f8c14153f60 2024-09-13T15:34:45.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c1259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c14153f60 0x7f8c14161310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c1259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c14153f60 0x7f8c14161310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47420/0 (socket says 172.21.15.40:47420) 2024-09-13T15:34:45.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c1259c640 1 -- 172.21.15.40:0/979907657 learned_addr learned my addr 172.21.15.40:0/979907657 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:45.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c1259c640 1 -- 172.21.15.40:0/979907657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c08009420 con 0x7f8c14153f60 2024-09-13T15:34:45.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c1259c640 1 --2- 172.21.15.40:0/979907657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c14153f60 0x7f8c14161310 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400c480 tx=0x7f8c0400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb022707640 1 -- 172.21.15.40:0/2233290782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01c08afa0 msgr2=0x7fb01c08b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb022707640 1 --2- 172.21.15.40:0/2233290782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01c08afa0 0x7fb01c08b380 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0097f0 tx=0x7fb00c01c2e0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb022707640 1 -- 172.21.15.40:0/2233290782 shutdown_connections 2024-09-13T15:34:45.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb022707640 1 --2- 172.21.15.40:0/2233290782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01c08afa0 0x7fb01c08b380 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb022707640 1 -- 172.21.15.40:0/2233290782 >> 172.21.15.40:0/2233290782 conn(0x7fb01c0a84f0 msgr2=0x7fb01c065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c02ffd640 1 -- 172.21.15.40:0/979907657 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c04005c20 con 0x7f8c14153f60 2024-09-13T15:34:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c02ffd640 1 -- 172.21.15.40:0/979907657 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c04005d80 con 0x7f8c14153f60 2024-09-13T15:34:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c02ffd640 1 -- 172.21.15.40:0/979907657 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c040071a0 con 0x7f8c14153f60 2024-09-13T15:34:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb022707640 1 -- 172.21.15.40:0/2233290782 shutdown_connections 2024-09-13T15:34:45.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb022707640 1 -- 172.21.15.40:0/2233290782 wait complete. 2024-09-13T15:34:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c18a37640 1 -- 172.21.15.40:0/979907657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c141462d0 con 0x7f8c14153f60 2024-09-13T15:34:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c18a37640 1 -- 172.21.15.40:0/979907657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c14161850 con 0x7f8c14153f60 2024-09-13T15:34:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb022707640 1 Processor -- start 2024-09-13T15:34:45.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb022707640 1 -- start start 2024-09-13T15:34:45.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c02ffd640 1 -- 172.21.15.40:0/979907657 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f8c04007300 con 0x7f8c14153f60 2024-09-13T15:34:45.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c18a37640 1 -- 172.21.15.40:0/979907657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c14067510 con 0x7f8c14153f60 2024-09-13T15:34:45.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c02ffd640 1 --2- 172.21.15.40:0/979907657 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8bf4035450 0x7f8bf4037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c02ffd640 1 -- 172.21.15.40:0/979907657 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f8c04046b00 con 0x7f8c14153f60 2024-09-13T15:34:45.513 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c11d9b640 1 --2- 172.21.15.40:0/979907657 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8bf4035450 0x7f8bf4037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb022707640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01c08afa0 0x7fb01c0a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb022707640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0a0cc0 con 0x7fb01c08afa0 2024-09-13T15:34:45.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb01bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01c08afa0 0x7fb01c0a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb01bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01c08afa0 0x7fb01c0a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47434/0 (socket says 172.21.15.40:47434) 2024-09-13T15:34:45.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7fb01bfff640 1 -- 172.21.15.40:0/1286494016 learned_addr learned my addr 172.21.15.40:0/1286494016 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:45.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.507+0000 7f8c11d9b640 1 --2- 172.21.15.40:0/979907657 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8bf4035450 0x7f8bf4037910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c08009770 tx=0x7f8c080a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.511+0000 7fb01bfff640 1 -- 172.21.15.40:0/1286494016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0094d0 con 0x7fb01c08afa0 2024-09-13T15:34:45.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.511+0000 7fb01bfff640 1 --2- 172.21.15.40:0/1286494016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01c08afa0 0x7fb01c0a0780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb00c019f10 tx=0x7fb00c01ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.515+0000 7fb018ff9640 1 -- 172.21.15.40:0/1286494016 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb00c0b6420 con 0x7fb01c08afa0 2024-09-13T15:34:45.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.515+0000 7fb018ff9640 1 -- 172.21.15.40:0/1286494016 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c0b6580 con 0x7fb01c08afa0 2024-09-13T15:34:45.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.515+0000 7fb018ff9640 1 -- 172.21.15.40:0/1286494016 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb00c0b6840 con 0x7fb01c08afa0 2024-09-13T15:34:45.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.515+0000 7fb022707640 1 -- 172.21.15.40:0/1286494016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c09c950 con 0x7fb01c08afa0 2024-09-13T15:34:45.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.515+0000 7f8c02ffd640 1 -- 172.21.15.40:0/979907657 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c040075b0 con 0x7f8c14153f60 2024-09-13T15:34:45.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.519+0000 7fb022707640 1 -- 172.21.15.40:0/1286494016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c142da0 con 0x7fb01c08afa0 2024-09-13T15:34:45.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.519+0000 7fb022707640 1 -- 172.21.15.40:0/1286494016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c09c6d0 con 0x7fb01c08afa0 2024-09-13T15:34:45.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.519+0000 7fb018ff9640 1 -- 172.21.15.40:0/1286494016 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fb00c0b2040 con 0x7fb01c08afa0 2024-09-13T15:34:45.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.519+0000 7fb018ff9640 1 --2- 172.21.15.40:0/1286494016 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fb0080354a0 0x7fb008037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:45.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.519+0000 7fb018ff9640 1 -- 172.21.15.40:0/1286494016 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7fb00c0e1b20 con 0x7fb01c08afa0 2024-09-13T15:34:45.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.519+0000 7fb01b7fe640 1 --2- 172.21.15.40:0/1286494016 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fb0080354a0 0x7fb008037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:45.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.519+0000 7fb01b7fe640 1 --2- 172.21.15.40:0/1286494016 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fb0080354a0 0x7fb008037960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb010001790 tx=0x7fb010007a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:45.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.527+0000 7fb018ff9640 1 -- 172.21.15.40:0/1286494016 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb00c0b69a0 con 0x7fb01c08afa0 2024-09-13T15:34:45.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.623+0000 7f2466193640 1 -- 172.21.15.40:0/2913786248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f24600c0bb0 con 0x7f24600b7bd0 2024-09-13T15:34:45.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.623+0000 7f245cff9640 1 -- 172.21.15.40:0/2913786248 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24500b0030 con 0x7f24600b7bd0 2024-09-13T15:34:45.625 INFO:teuthology.orchestra.run.smithi040.stdout:34359738375 2024-09-13T15:34:45.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.623+0000 7f2466193640 1 -- 172.21.15.40:0/2913786248 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2440035450 msgr2=0x7f2440037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.623+0000 7f2466193640 1 --2- 172.21.15.40:0/2913786248 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2440035450 0x7f2440037910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2448001610 tx=0x7f2448007ad0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.623+0000 7f2466193640 1 -- 172.21.15.40:0/2913786248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24600b7bd0 msgr2=0x7f24601583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.623+0000 7f2466193640 1 --2- 172.21.15.40:0/2913786248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24600b7bd0 0x7f24601583e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f245001a050 tx=0x7f245001ac60 comp rx=0 tx=0).stop 2024-09-13T15:34:45.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.623+0000 7f2466193640 1 -- 172.21.15.40:0/2913786248 shutdown_connections 2024-09-13T15:34:45.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.623+0000 7f2466193640 1 --2- 172.21.15.40:0/2913786248 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2440035450 0x7f2440037910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.623+0000 7f2466193640 1 --2- 172.21.15.40:0/2913786248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24600b7bd0 0x7f24601583e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.623+0000 7f2466193640 1 -- 172.21.15.40:0/2913786248 >> 172.21.15.40:0/2913786248 conn(0x7f24600a8640 msgr2=0x7f24600c3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.623+0000 7f2466193640 1 -- 172.21.15.40:0/2913786248 shutdown_connections 2024-09-13T15:34:45.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.623+0000 7f2466193640 1 -- 172.21.15.40:0/2913786248 wait complete. 2024-09-13T15:34:45.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.2 2024-09-13T15:34:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.675+0000 7f8c18a37640 1 -- 172.21.15.40:0/979907657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8c140c06e0 con 0x7f8c14153f60 2024-09-13T15:34:45.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.675+0000 7f8c02ffd640 1 -- 172.21.15.40:0/979907657 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8c04017030 con 0x7f8c14153f60 2024-09-13T15:34:45.678 INFO:teuthology.orchestra.run.smithi040.stdout:34359738376 2024-09-13T15:34:45.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.679+0000 7f8c18a37640 1 -- 172.21.15.40:0/979907657 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8bf4035450 msgr2=0x7f8bf4037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.679+0000 7f8c18a37640 1 --2- 172.21.15.40:0/979907657 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8bf4035450 0x7f8bf4037910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c08009770 tx=0x7f8c080a6000 comp rx=0 tx=0).stop 2024-09-13T15:34:45.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.679+0000 7f8c18a37640 1 -- 172.21.15.40:0/979907657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c14153f60 msgr2=0x7f8c14161310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.679+0000 7f8c18a37640 1 --2- 172.21.15.40:0/979907657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c14153f60 0x7f8c14161310 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8c0400c480 tx=0x7f8c0400c940 comp rx=0 tx=0).stop 2024-09-13T15:34:45.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.679+0000 7f8c18a37640 1 -- 172.21.15.40:0/979907657 shutdown_connections 2024-09-13T15:34:45.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.679+0000 7f8c18a37640 1 --2- 172.21.15.40:0/979907657 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8bf4035450 0x7f8bf4037910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.679+0000 7f8c18a37640 1 --2- 172.21.15.40:0/979907657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c14153f60 0x7f8c14161310 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.679+0000 7f8c18a37640 1 -- 172.21.15.40:0/979907657 >> 172.21.15.40:0/979907657 conn(0x7f8c140a8640 msgr2=0x7f8c1415e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.679+0000 7f8c18a37640 1 -- 172.21.15.40:0/979907657 shutdown_connections 2024-09-13T15:34:45.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.679+0000 7f8c18a37640 1 -- 172.21.15.40:0/979907657 wait complete. 2024-09-13T15:34:45.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.691+0000 7fb022707640 1 -- 172.21.15.40:0/1286494016 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb01c152480 con 0x7fb01c08afa0 2024-09-13T15:34:45.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738376 for osd.0 2024-09-13T15:34:45.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.695+0000 7fb018ff9640 1 -- 172.21.15.40:0/1286494016 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb00c0b0030 con 0x7fb01c08afa0 2024-09-13T15:34:45.696 INFO:teuthology.orchestra.run.smithi040.stdout:34359738374 2024-09-13T15:34:45.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.695+0000 7fb022707640 1 -- 172.21.15.40:0/1286494016 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fb0080354a0 msgr2=0x7fb008037960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.695+0000 7fb022707640 1 --2- 172.21.15.40:0/1286494016 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fb0080354a0 0x7fb008037960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb010001790 tx=0x7fb010007a20 comp rx=0 tx=0).stop 2024-09-13T15:34:45.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.695+0000 7fb022707640 1 -- 172.21.15.40:0/1286494016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01c08afa0 msgr2=0x7fb01c0a0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:45.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.695+0000 7fb022707640 1 --2- 172.21.15.40:0/1286494016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01c08afa0 0x7fb01c0a0780 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb00c019f10 tx=0x7fb00c01ab20 comp rx=0 tx=0).stop 2024-09-13T15:34:45.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.695+0000 7fb022707640 1 -- 172.21.15.40:0/1286494016 shutdown_connections 2024-09-13T15:34:45.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.695+0000 7fb022707640 1 --2- 172.21.15.40:0/1286494016 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fb0080354a0 0x7fb008037960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.695+0000 7fb022707640 1 --2- 172.21.15.40:0/1286494016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb01c08afa0 0x7fb01c0a0780 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:45.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.695+0000 7fb022707640 1 -- 172.21.15.40:0/1286494016 >> 172.21.15.40:0/1286494016 conn(0x7fb01c0a84f0 msgr2=0x7fb01c151230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:45.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.695+0000 7fb022707640 1 -- 172.21.15.40:0/1286494016 shutdown_connections 2024-09-13T15:34:45.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:45.695+0000 7fb022707640 1 -- 172.21.15.40:0/1286494016 wait complete. 2024-09-13T15:34:45.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.1 2024-09-13T15:34:46.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T15:34:46.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T15:34:46.713 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T15:34:46.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.775+0000 7faf597a3640 1 Processor -- start 2024-09-13T15:34:46.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.775+0000 7faf597a3640 1 -- start start 2024-09-13T15:34:46.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf597a3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf540b7bd0 0x7faf540c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:46.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf597a3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf540a7850 con 0x7faf54153f60 2024-09-13T15:34:46.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf597a3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf5408c4f0 con 0x7faf540b7bd0 2024-09-13T15:34:46.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf527fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf540b7bd0 0x7faf540c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:46.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf527fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faf540b7bd0 0x7faf540c06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47444/0 (socket says 172.21.15.40:47444) 2024-09-13T15:34:46.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf527fc640 1 -- 172.21.15.40:0/1106315516 learned_addr learned my addr 172.21.15.40:0/1106315516 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:46.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf527fc640 1 -- 172.21.15.40:0/1106315516 >> v1:172.21.15.40:6789/0 conn(0x7faf54153f60 legacy=0x7faf540c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:46.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf51ffb640 1 -- 172.21.15.40:0/1106315516 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375819168 0 0) 0x7faf540a7850 con 0x7faf54153f60 2024-09-13T15:34:46.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf527fc640 1 -- 172.21.15.40:0/1106315516 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5408bdb0 con 0x7faf540b7bd0 2024-09-13T15:34:46.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf527fc640 1 --2- 172.21.15.40:0/1106315516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf540b7bd0 0x7faf540c06e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf48009820 tx=0x7faf4801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03d6141ba8552fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:46.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf51ffb640 1 -- 172.21.15.40:0/1106315516 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf480ac560 con 0x7faf540b7bd0 2024-09-13T15:34:46.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf51ffb640 1 -- 172.21.15.40:0/1106315516 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf480ac6c0 con 0x7faf540b7bd0 2024-09-13T15:34:46.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.779+0000 7faf51ffb640 1 -- 172.21.15.40:0/1106315516 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf480ac980 con 0x7faf540b7bd0 2024-09-13T15:34:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 -- 172.21.15.40:0/1106315516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf540b7bd0 msgr2=0x7faf540c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 --2- 172.21.15.40:0/1106315516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf540b7bd0 0x7faf540c06e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf48009820 tx=0x7faf4801c4c0 comp rx=0 tx=0).stop 2024-09-13T15:34:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 -- 172.21.15.40:0/1106315516 shutdown_connections 2024-09-13T15:34:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 --2- 172.21.15.40:0/1106315516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf540b7bd0 0x7faf540c06e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 -- 172.21.15.40:0/1106315516 >> 172.21.15.40:0/1106315516 conn(0x7faf540a8640 msgr2=0x7faf54065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 -- 172.21.15.40:0/1106315516 shutdown_connections 2024-09-13T15:34:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 -- 172.21.15.40:0/1106315516 wait complete. 2024-09-13T15:34:46.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 Processor -- start 2024-09-13T15:34:46.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 -- start start 2024-09-13T15:34:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf540b7bd0 0x7faf54151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf54146870 con 0x7faf540b7bd0 2024-09-13T15:34:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf52ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf540b7bd0 0x7faf54151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf52ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf540b7bd0 0x7faf54151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47458/0 (socket says 172.21.15.40:47458) 2024-09-13T15:34:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf52ffd640 1 -- 172.21.15.40:0/2493097776 learned_addr learned my addr 172.21.15.40:0/2493097776 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:46.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf52ffd640 1 -- 172.21.15.40:0/2493097776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf480094d0 con 0x7faf540b7bd0 2024-09-13T15:34:46.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf52ffd640 1 --2- 172.21.15.40:0/2493097776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf540b7bd0 0x7faf54151340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faf4400c400 tx=0x7faf4400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:46.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf3b7fe640 1 -- 172.21.15.40:0/2493097776 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf440054d0 con 0x7faf540b7bd0 2024-09-13T15:34:46.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf3b7fe640 1 -- 172.21.15.40:0/2493097776 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf44003600 con 0x7faf540b7bd0 2024-09-13T15:34:46.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 -- 172.21.15.40:0/2493097776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf54151d30 con 0x7faf540b7bd0 2024-09-13T15:34:46.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf3b7fe640 1 -- 172.21.15.40:0/2493097776 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf44003960 con 0x7faf540b7bd0 2024-09-13T15:34:46.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.783+0000 7faf597a3640 1 -- 172.21.15.40:0/2493097776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf541521f0 con 0x7faf540b7bd0 2024-09-13T15:34:46.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.787+0000 7faf3b7fe640 1 -- 172.21.15.40:0/2493097776 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7faf44003ac0 con 0x7faf540b7bd0 2024-09-13T15:34:46.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.787+0000 7faf3b7fe640 1 --2- 172.21.15.40:0/2493097776 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7faf40035450 0x7faf40037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:46.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.787+0000 7faf597a3640 1 -- 172.21.15.40:0/2493097776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf54067510 con 0x7faf540b7bd0 2024-09-13T15:34:46.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.787+0000 7faf3b7fe640 1 -- 172.21.15.40:0/2493097776 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7faf44046c90 con 0x7faf540b7bd0 2024-09-13T15:34:46.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.787+0000 7faf527fc640 1 --2- 172.21.15.40:0/2493097776 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7faf40035450 0x7faf40037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:46.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.787+0000 7faf527fc640 1 --2- 172.21.15.40:0/2493097776 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7faf40035450 0x7faf40037910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf48009820 tx=0x7faf480a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.791+0000 7faf3b7fe640 1 -- 172.21.15.40:0/2493097776 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faf44017070 con 0x7faf540b7bd0 2024-09-13T15:34:46.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.827+0000 7f2c66ae7640 1 Processor -- start 2024-09-13T15:34:46.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.827+0000 7f2c66ae7640 1 -- start start 2024-09-13T15:34:46.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.831+0000 7f2c66ae7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c60153f60 0x7f2c600c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:46.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.831+0000 7f2c66ae7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c600a7850 con 0x7f2c600b7bd0 2024-09-13T15:34:46.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.831+0000 7f2c66ae7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6008c4f0 con 0x7f2c60153f60 2024-09-13T15:34:46.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.831+0000 7f2c64883640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c60153f60 0x7f2c600c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:46.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.831+0000 7f2c64883640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c60153f60 0x7f2c600c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47460/0 (socket says 172.21.15.40:47460) 2024-09-13T15:34:46.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.831+0000 7f2c64883640 1 -- 172.21.15.40:0/1593281628 learned_addr learned my addr 172.21.15.40:0/1593281628 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:46.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.831+0000 7f2c5ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2c600b7bd0 0x7f2c600c06e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38728/0 (socket says 172.21.15.40:38728) 2024-09-13T15:34:46.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.831+0000 7f2c5f7fe640 1 -- 172.21.15.40:0/1593281628 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994047481 0 0) 0x7f2c600a7850 con 0x7f2c600b7bd0 2024-09-13T15:34:46.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.831+0000 7f2c5f7fe640 1 -- 172.21.15.40:0/1593281628 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c50003530 con 0x7f2c600b7bd0 2024-09-13T15:34:46.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.831+0000 7f2c64883640 1 -- 172.21.15.40:0/1593281628 >> v1:172.21.15.40:6789/0 conn(0x7f2c600b7bd0 legacy=0x7f2c600c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:46.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.831+0000 7f2c64883640 1 -- 172.21.15.40:0/1593281628 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6008bdb0 con 0x7f2c60153f60 2024-09-13T15:34:46.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c64883640 1 --2- 172.21.15.40:0/1593281628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c60153f60 0x7f2c600c4b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009820 tx=0x7f2c5401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629e3bfd7a71bd2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:46.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c5f7fe640 1 -- 172.21.15.40:0/1593281628 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c540a8050 con 0x7f2c60153f60 2024-09-13T15:34:46.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c5f7fe640 1 -- 172.21.15.40:0/1593281628 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c540ac520 con 0x7f2c60153f60 2024-09-13T15:34:46.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c5f7fe640 1 -- 172.21.15.40:0/1593281628 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c540ac7e0 con 0x7f2c60153f60 2024-09-13T15:34:46.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c66ae7640 1 -- 172.21.15.40:0/1593281628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c60153f60 msgr2=0x7f2c600c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:46.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c66ae7640 1 --2- 172.21.15.40:0/1593281628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c60153f60 0x7f2c600c4b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009820 tx=0x7f2c5401c4c0 comp rx=0 tx=0).stop 2024-09-13T15:34:46.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c66ae7640 1 -- 172.21.15.40:0/1593281628 shutdown_connections 2024-09-13T15:34:46.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c66ae7640 1 --2- 172.21.15.40:0/1593281628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c60153f60 0x7f2c600c4b90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:46.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c66ae7640 1 -- 172.21.15.40:0/1593281628 >> 172.21.15.40:0/1593281628 conn(0x7f2c600a8640 msgr2=0x7f2c60065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:46.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c66ae7640 1 -- 172.21.15.40:0/1593281628 shutdown_connections 2024-09-13T15:34:46.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c66ae7640 1 -- 172.21.15.40:0/1593281628 wait complete. 2024-09-13T15:34:46.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c66ae7640 1 Processor -- start 2024-09-13T15:34:46.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.835+0000 7f2c66ae7640 1 -- start start 2024-09-13T15:34:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c66ae7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c600b7bd0 0x7f2c60147e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c66ae7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c60162210 con 0x7f2c600b7bd0 2024-09-13T15:34:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c64883640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c600b7bd0 0x7f2c60147e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c64883640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c600b7bd0 0x7f2c60147e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47468/0 (socket says 172.21.15.40:47468) 2024-09-13T15:34:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c64883640 1 -- 172.21.15.40:0/775577540 learned_addr learned my addr 172.21.15.40:0/775577540 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:46.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c64883640 1 -- 172.21.15.40:0/775577540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c540094d0 con 0x7f2c600b7bd0 2024-09-13T15:34:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c64883640 1 --2- 172.21.15.40:0/775577540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c600b7bd0 0x7f2c60147e30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2c5401ab70 tx=0x7f2c5401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c5d7fa640 1 -- 172.21.15.40:0/775577540 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c540b7420 con 0x7f2c600b7bd0 2024-09-13T15:34:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c5d7fa640 1 -- 172.21.15.40:0/775577540 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c540b7580 con 0x7f2c600b7bd0 2024-09-13T15:34:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c5d7fa640 1 -- 172.21.15.40:0/775577540 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c540b7820 con 0x7f2c600b7bd0 2024-09-13T15:34:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c66ae7640 1 -- 172.21.15.40:0/775577540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6014d570 con 0x7f2c600b7bd0 2024-09-13T15:34:46.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c66ae7640 1 -- 172.21.15.40:0/775577540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c601494d0 con 0x7f2c600b7bd0 2024-09-13T15:34:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c66ae7640 1 -- 172.21.15.40:0/775577540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c60067510 con 0x7f2c600b7bd0 2024-09-13T15:34:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c5d7fa640 1 -- 172.21.15.40:0/775577540 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f2c540b3040 con 0x7f2c600b7bd0 2024-09-13T15:34:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c5d7fa640 1 --2- 172.21.15.40:0/775577540 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2c44035400 0x7f2c440378c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:46.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c5d7fa640 1 -- 172.21.15.40:0/775577540 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f2c540e1980 con 0x7f2c600b7bd0 2024-09-13T15:34:46.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.839+0000 7f2c5ffff640 1 --2- 172.21.15.40:0/775577540 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2c44035400 0x7f2c440378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:46.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.843+0000 7f2c5ffff640 1 --2- 172.21.15.40:0/775577540 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2c44035400 0x7f2c440378c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c007fd0 tx=0x7f2c4c007940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:46.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.847+0000 7f2c5d7fa640 1 -- 172.21.15.40:0/775577540 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2c540b7980 con 0x7f2c600b7bd0 2024-09-13T15:34:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.867+0000 7f2cf935f640 1 Processor -- start 2024-09-13T15:34:46.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.867+0000 7f2cf935f640 1 -- start start 2024-09-13T15:34:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf935f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2cf4153f60 0x7f2cf40c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf935f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf40a7850 con 0x7f2cf40b7bd0 2024-09-13T15:34:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf935f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf408c4f0 con 0x7f2cf4153f60 2024-09-13T15:34:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf2ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2cf4153f60 0x7f2cf40c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf27fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2cf40b7bd0 0x7f2cf40c06e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38732/0 (socket says 172.21.15.40:38732) 2024-09-13T15:34:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf27fc640 1 -- 172.21.15.40:0/3083388028 learned_addr learned my addr 172.21.15.40:0/3083388028 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf2ffd640 1 -- 172.21.15.40:0/3083388028 >> v1:172.21.15.40:6789/0 conn(0x7f2cf40b7bd0 legacy=0x7f2cf40c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:46.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf2ffd640 1 -- 172.21.15.40:0/3083388028 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf408bdb0 con 0x7f2cf4153f60 2024-09-13T15:34:46.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf2ffd640 1 --2- 172.21.15.40:0/3083388028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cf4153f60 0x7f2cf40c4b90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009770 tx=0x7f2ce401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d249b334800a758 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:46.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf1ffb640 1 -- 172.21.15.40:0/3083388028 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce40ab530 con 0x7f2cf4153f60 2024-09-13T15:34:46.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf1ffb640 1 -- 172.21.15.40:0/3083388028 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce40a7050 con 0x7f2cf4153f60 2024-09-13T15:34:46.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf1ffb640 1 -- 172.21.15.40:0/3083388028 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce40ab7e0 con 0x7f2cf4153f60 2024-09-13T15:34:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf935f640 1 -- 172.21.15.40:0/3083388028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cf4153f60 msgr2=0x7f2cf40c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf935f640 1 --2- 172.21.15.40:0/3083388028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cf4153f60 0x7f2cf40c4b90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009770 tx=0x7f2ce401c420 comp rx=0 tx=0).stop 2024-09-13T15:34:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf935f640 1 -- 172.21.15.40:0/3083388028 shutdown_connections 2024-09-13T15:34:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf935f640 1 --2- 172.21.15.40:0/3083388028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cf4153f60 0x7f2cf40c4b90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf935f640 1 -- 172.21.15.40:0/3083388028 >> 172.21.15.40:0/3083388028 conn(0x7f2cf40a8640 msgr2=0x7f2cf4065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf935f640 1 -- 172.21.15.40:0/3083388028 shutdown_connections 2024-09-13T15:34:46.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.871+0000 7f2cf935f640 1 -- 172.21.15.40:0/3083388028 wait complete. 2024-09-13T15:34:46.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf935f640 1 Processor -- start 2024-09-13T15:34:46.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf935f640 1 -- start start 2024-09-13T15:34:46.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf935f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cf40b7bd0 0x7f2cf41583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:46.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf935f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf41ebaf0 con 0x7f2cf40b7bd0 2024-09-13T15:34:46.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cf40b7bd0 0x7f2cf41583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:46.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cf40b7bd0 0x7f2cf41583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47494/0 (socket says 172.21.15.40:47494) 2024-09-13T15:34:46.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf2ffd640 1 -- 172.21.15.40:0/1655223761 learned_addr learned my addr 172.21.15.40:0/1655223761 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:46.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf2ffd640 1 -- 172.21.15.40:0/1655223761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4009420 con 0x7f2cf40b7bd0 2024-09-13T15:34:46.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf2ffd640 1 --2- 172.21.15.40:0/1655223761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cf40b7bd0 0x7f2cf41583e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2ce401a050 tx=0x7f2ce401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:46.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cdb7fe640 1 -- 172.21.15.40:0/1655223761 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce40b7450 con 0x7f2cf40b7bd0 2024-09-13T15:34:46.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cdb7fe640 1 -- 172.21.15.40:0/1655223761 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce40b75b0 con 0x7f2cf40b7bd0 2024-09-13T15:34:46.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf935f640 1 -- 172.21.15.40:0/1655223761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf415aa00 con 0x7f2cf40b7bd0 2024-09-13T15:34:46.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cdb7fe640 1 -- 172.21.15.40:0/1655223761 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ce40b7870 con 0x7f2cf40b7bd0 2024-09-13T15:34:46.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf935f640 1 -- 172.21.15.40:0/1655223761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf41ebe70 con 0x7f2cf40b7bd0 2024-09-13T15:34:46.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cd97fa640 1 -- 172.21.15.40:0/1655223761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ccc005260 con 0x7f2cf40b7bd0 2024-09-13T15:34:46.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cdb7fe640 1 -- 172.21.15.40:0/1655223761 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f2ce40b79d0 con 0x7f2cf40b7bd0 2024-09-13T15:34:46.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cdb7fe640 1 --2- 172.21.15.40:0/1655223761 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2ce0035450 0x7f2ce0037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:46.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cdb7fe640 1 -- 172.21.15.40:0/1655223761 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f2ce40e2090 con 0x7f2cf40b7bd0 2024-09-13T15:34:46.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf27fc640 1 --2- 172.21.15.40:0/1655223761 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2ce0035450 0x7f2ce0037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:46.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.875+0000 7f2cf27fc640 1 --2- 172.21.15.40:0/1655223761 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2ce0035450 0x7f2ce0037910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8001610 tx=0x7f2ce8007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:46.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.879+0000 7f2cdb7fe640 1 -- 172.21.15.40:0/1655223761 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ce40c78f0 con 0x7f2cf40b7bd0 2024-09-13T15:34:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.955+0000 7faf597a3640 1 -- 172.21.15.40:0/2493097776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faf5415cc00 con 0x7faf540b7bd0 2024-09-13T15:34:46.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.955+0000 7faf3b7fe640 1 -- 172.21.15.40:0/2493097776 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf44019730 con 0x7faf540b7bd0 2024-09-13T15:34:46.958 INFO:teuthology.orchestra.run.smithi040.stdout:34359738375 2024-09-13T15:34:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.959+0000 7faf597a3640 1 -- 172.21.15.40:0/2493097776 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7faf40035450 msgr2=0x7faf40037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.959+0000 7faf597a3640 1 --2- 172.21.15.40:0/2493097776 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7faf40035450 0x7faf40037910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf48009820 tx=0x7faf480a7000 comp rx=0 tx=0).stop 2024-09-13T15:34:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.959+0000 7faf597a3640 1 -- 172.21.15.40:0/2493097776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf540b7bd0 msgr2=0x7faf54151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.959+0000 7faf597a3640 1 --2- 172.21.15.40:0/2493097776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf540b7bd0 0x7faf54151340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faf4400c400 tx=0x7faf4400c8c0 comp rx=0 tx=0).stop 2024-09-13T15:34:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.959+0000 7faf597a3640 1 -- 172.21.15.40:0/2493097776 shutdown_connections 2024-09-13T15:34:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.959+0000 7faf597a3640 1 --2- 172.21.15.40:0/2493097776 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7faf40035450 0x7faf40037910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.959+0000 7faf597a3640 1 --2- 172.21.15.40:0/2493097776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faf540b7bd0 0x7faf54151340 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.959+0000 7faf597a3640 1 -- 172.21.15.40:0/2493097776 >> 172.21.15.40:0/2493097776 conn(0x7faf540a8640 msgr2=0x7faf540a4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:46.960 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.959+0000 7faf597a3640 1 -- 172.21.15.40:0/2493097776 shutdown_connections 2024-09-13T15:34:46.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:46.959+0000 7faf597a3640 1 -- 172.21.15.40:0/2493097776 wait complete. 2024-09-13T15:34:46.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738375 for osd.2 2024-09-13T15:34:47.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.019+0000 7f2c66ae7640 1 -- 172.21.15.40:0/775577540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2c600c0bd0 con 0x7f2c600b7bd0 2024-09-13T15:34:47.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.019+0000 7f2c5d7fa640 1 -- 172.21.15.40:0/775577540 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2c540b1030 con 0x7f2c600b7bd0 2024-09-13T15:34:47.021 INFO:teuthology.orchestra.run.smithi040.stdout:34359738376 2024-09-13T15:34:47.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.019+0000 7f2c66ae7640 1 -- 172.21.15.40:0/775577540 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2c44035400 msgr2=0x7f2c440378c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:47.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.019+0000 7f2c66ae7640 1 --2- 172.21.15.40:0/775577540 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2c44035400 0x7f2c440378c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c007fd0 tx=0x7f2c4c007940 comp rx=0 tx=0).stop 2024-09-13T15:34:47.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.019+0000 7f2c66ae7640 1 -- 172.21.15.40:0/775577540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c600b7bd0 msgr2=0x7f2c60147e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:47.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.019+0000 7f2c66ae7640 1 --2- 172.21.15.40:0/775577540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c600b7bd0 0x7f2c60147e30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2c5401ab70 tx=0x7f2c5401ad00 comp rx=0 tx=0).stop 2024-09-13T15:34:47.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.019+0000 7f2c66ae7640 1 -- 172.21.15.40:0/775577540 shutdown_connections 2024-09-13T15:34:47.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.019+0000 7f2c66ae7640 1 --2- 172.21.15.40:0/775577540 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2c44035400 0x7f2c440378c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:47.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.019+0000 7f2c66ae7640 1 --2- 172.21.15.40:0/775577540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c600b7bd0 0x7f2c60147e30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:47.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.019+0000 7f2c66ae7640 1 -- 172.21.15.40:0/775577540 >> 172.21.15.40:0/775577540 conn(0x7f2c600a8640 msgr2=0x7f2c6014f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:47.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.019+0000 7f2c66ae7640 1 -- 172.21.15.40:0/775577540 shutdown_connections 2024-09-13T15:34:47.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.019+0000 7f2c66ae7640 1 -- 172.21.15.40:0/775577540 wait complete. 2024-09-13T15:34:47.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738376 for osd.0 2024-09-13T15:34:47.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.035+0000 7f2cd97fa640 1 -- 172.21.15.40:0/1655223761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2ccc005510 con 0x7f2cf40b7bd0 2024-09-13T15:34:47.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.035+0000 7f2cdb7fe640 1 -- 172.21.15.40:0/1655223761 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ce40bb020 con 0x7f2cf40b7bd0 2024-09-13T15:34:47.039 INFO:teuthology.orchestra.run.smithi040.stdout:34359738374 2024-09-13T15:34:47.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.039+0000 7f2cd97fa640 1 -- 172.21.15.40:0/1655223761 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2ce0035450 msgr2=0x7f2ce0037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:47.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.039+0000 7f2cd97fa640 1 --2- 172.21.15.40:0/1655223761 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2ce0035450 0x7f2ce0037910 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8001610 tx=0x7f2ce8007ad0 comp rx=0 tx=0).stop 2024-09-13T15:34:47.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.039+0000 7f2cd97fa640 1 -- 172.21.15.40:0/1655223761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cf40b7bd0 msgr2=0x7f2cf41583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:47.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.039+0000 7f2cd97fa640 1 --2- 172.21.15.40:0/1655223761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cf40b7bd0 0x7f2cf41583e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2ce401a050 tx=0x7f2ce401ac60 comp rx=0 tx=0).stop 2024-09-13T15:34:47.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.039+0000 7f2cd97fa640 1 -- 172.21.15.40:0/1655223761 shutdown_connections 2024-09-13T15:34:47.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.039+0000 7f2cd97fa640 1 --2- 172.21.15.40:0/1655223761 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2ce0035450 0x7f2ce0037910 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:47.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.039+0000 7f2cd97fa640 1 --2- 172.21.15.40:0/1655223761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cf40b7bd0 0x7f2cf41583e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:47.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.039+0000 7f2cd97fa640 1 -- 172.21.15.40:0/1655223761 >> 172.21.15.40:0/1655223761 conn(0x7f2cf40a8640 msgr2=0x7f2cf40c3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:47.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.039+0000 7f2cd97fa640 1 -- 172.21.15.40:0/1655223761 shutdown_connections 2024-09-13T15:34:47.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:47.039+0000 7f2cd97fa640 1 -- 172.21.15.40:0/1655223761 wait complete. 2024-09-13T15:34:47.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738374 for osd.1 2024-09-13T15:34:47.981 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T15:34:48.040 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T15:34:48.056 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T15:34:48.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.111+0000 7f5989bf0640 1 Processor -- start 2024-09-13T15:34:48.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.111+0000 7f5989bf0640 1 -- start start 2024-09-13T15:34:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.111+0000 7f5989bf0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f598406b440 0x7f598406b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.111+0000 7f5989bf0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59840bd4e0 con 0x7f59841534d0 2024-09-13T15:34:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.111+0000 7f5989bf0640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5984153cc0 con 0x7f598406b440 2024-09-13T15:34:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.111+0000 7f59837fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f598406b440 0x7f598406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.111+0000 7f59837fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f598406b440 0x7f598406b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47496/0 (socket says 172.21.15.40:47496) 2024-09-13T15:34:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.111+0000 7f59837fe640 1 -- 172.21.15.40:0/39696166 learned_addr learned my addr 172.21.15.40:0/39696166 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.111+0000 7f5982ffd640 1 --1- 172.21.15.40:0/39696166 >> v1:172.21.15.40:6789/0 conn(0x7f59841534d0 0x7f59840bf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38740/0 (socket says 172.21.15.40:38740) 2024-09-13T15:34:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.115+0000 7f59837fe640 1 -- 172.21.15.40:0/39696166 >> v1:172.21.15.40:6789/0 conn(0x7f59841534d0 legacy=0x7f59840bf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.115+0000 7f59827fc640 1 -- 172.21.15.40:0/39696166 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017489513 0 0) 0x7f59840bd4e0 con 0x7f59841534d0 2024-09-13T15:34:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.115+0000 7f59837fe640 1 -- 172.21.15.40:0/39696166 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59840c0cd0 con 0x7f598406b440 2024-09-13T15:34:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.115+0000 7f59837fe640 1 --2- 172.21.15.40:0/39696166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598406b440 0x7f598406b820 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f59740097f0 tx=0x7f597401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814e70c9846606ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f59827fc640 1 -- 172.21.15.40:0/39696166 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59740ab520 con 0x7f598406b440 2024-09-13T15:34:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f59827fc640 1 -- 172.21.15.40:0/39696166 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59740ab680 con 0x7f598406b440 2024-09-13T15:34:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f59827fc640 1 -- 172.21.15.40:0/39696166 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59740ab940 con 0x7f598406b440 2024-09-13T15:34:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f5989bf0640 1 -- 172.21.15.40:0/39696166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598406b440 msgr2=0x7f598406b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f5989bf0640 1 --2- 172.21.15.40:0/39696166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598406b440 0x7f598406b820 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f59740097f0 tx=0x7f597401c4e0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f5989bf0640 1 -- 172.21.15.40:0/39696166 shutdown_connections 2024-09-13T15:34:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f5989bf0640 1 --2- 172.21.15.40:0/39696166 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598406b440 0x7f598406b820 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f5989bf0640 1 -- 172.21.15.40:0/39696166 >> 172.21.15.40:0/39696166 conn(0x7f598406a370 msgr2=0x7f598406a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f5989bf0640 1 -- 172.21.15.40:0/39696166 shutdown_connections 2024-09-13T15:34:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f5989bf0640 1 -- 172.21.15.40:0/39696166 wait complete. 2024-09-13T15:34:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f5989bf0640 1 Processor -- start 2024-09-13T15:34:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f5989bf0640 1 -- start start 2024-09-13T15:34:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f5989bf0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598406b440 0x7f598414a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f5989bf0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5984149d30 con 0x7f598406b440 2024-09-13T15:34:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f59837fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598406b440 0x7f598414a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f59837fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598406b440 0x7f598414a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47512/0 (socket says 172.21.15.40:47512) 2024-09-13T15:34:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f59837fe640 1 -- 172.21.15.40:0/3269137801 learned_addr learned my addr 172.21.15.40:0/3269137801 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.119+0000 7f59837fe640 1 -- 172.21.15.40:0/3269137801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59740094d0 con 0x7f598406b440 2024-09-13T15:34:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.123+0000 7f59837fe640 1 --2- 172.21.15.40:0/3269137801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598406b440 0x7f598414a210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f59740190f0 tx=0x7f597401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.123+0000 7f596bfff640 1 -- 172.21.15.40:0/3269137801 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59740b4600 con 0x7f598406b440 2024-09-13T15:34:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.123+0000 7f596bfff640 1 -- 172.21.15.40:0/3269137801 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59740b4780 con 0x7f598406b440 2024-09-13T15:34:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.123+0000 7f596bfff640 1 -- 172.21.15.40:0/3269137801 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59740b4a60 con 0x7f598406b440 2024-09-13T15:34:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.123+0000 7f5989bf0640 1 -- 172.21.15.40:0/3269137801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598409d6c0 con 0x7f598406b440 2024-09-13T15:34:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.123+0000 7f5989bf0640 1 -- 172.21.15.40:0/3269137801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59840a3890 con 0x7f598406b440 2024-09-13T15:34:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.123+0000 7f596bfff640 1 -- 172.21.15.40:0/3269137801 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f59740b4bc0 con 0x7f598406b440 2024-09-13T15:34:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.123+0000 7f596bfff640 1 --2- 172.21.15.40:0/3269137801 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5970035450 0x7f5970037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.123+0000 7f596bfff640 1 -- 172.21.15.40:0/3269137801 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f59740a8050 con 0x7f598406b440 2024-09-13T15:34:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.123+0000 7f5989bf0640 1 -- 172.21.15.40:0/3269137801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5984067850 con 0x7f598406b440 2024-09-13T15:34:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.123+0000 7f5982ffd640 1 --2- 172.21.15.40:0/3269137801 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5970035450 0x7f5970037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.123+0000 7f5982ffd640 1 --2- 172.21.15.40:0/3269137801 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5970035450 0x7f5970037910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5978007fd0 tx=0x7f5978007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.127+0000 7f596bfff640 1 -- 172.21.15.40:0/3269137801 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f59740c5930 con 0x7f598406b440 2024-09-13T15:34:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.195+0000 7fc5441c9640 1 Processor -- start 2024-09-13T15:34:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.195+0000 7fc5441c9640 1 -- start start 2024-09-13T15:34:48.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.195+0000 7fc5441c9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc53c06ead0 0x7fc53c0bf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.195+0000 7fc5441c9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c0b5140 con 0x7fc53c06e6f0 2024-09-13T15:34:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.195+0000 7fc5441c9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c0c0090 con 0x7fc53c06ead0 2024-09-13T15:34:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.195+0000 7fc541764640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc53c06ead0 0x7fc53c0bf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.195+0000 7fc541764640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc53c06ead0 0x7fc53c0bf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47520/0 (socket says 172.21.15.40:47520) 2024-09-13T15:34:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.195+0000 7fc541764640 1 -- 172.21.15.40:0/4197550913 learned_addr learned my addr 172.21.15.40:0/4197550913 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.195+0000 7fc541f65640 1 --1- 172.21.15.40:0/4197550913 >> v1:172.21.15.40:6789/0 conn(0x7fc53c06e6f0 0x7fc53c0bd420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38748/0 (socket says 172.21.15.40:38748) 2024-09-13T15:34:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.195+0000 7fc541764640 1 -- 172.21.15.40:0/4197550913 >> v1:172.21.15.40:6789/0 conn(0x7fc53c06e6f0 legacy=0x7fc53c0bd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.195+0000 7fc541764640 1 -- 172.21.15.40:0/4197550913 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c0becd0 con 0x7fc53c06ead0 2024-09-13T15:34:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc541764640 1 --2- 172.21.15.40:0/4197550913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c06ead0 0x7fc53c0bf340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00ba90 tx=0x7fc52c01eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1a597579655e05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc540f63640 1 -- 172.21.15.40:0/4197550913 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc52c0a7aa0 con 0x7fc53c06ead0 2024-09-13T15:34:48.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc540f63640 1 -- 172.21.15.40:0/4197550913 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c0a7c00 con 0x7fc53c06ead0 2024-09-13T15:34:48.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc540f63640 1 -- 172.21.15.40:0/4197550913 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc52c0af440 con 0x7fc53c06ead0 2024-09-13T15:34:48.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc5441c9640 1 -- 172.21.15.40:0/4197550913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c06ead0 msgr2=0x7fc53c0bf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc5441c9640 1 --2- 172.21.15.40:0/4197550913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c06ead0 0x7fc53c0bf340 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00ba90 tx=0x7fc52c01eb90 comp rx=0 tx=0).stop 2024-09-13T15:34:48.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc5441c9640 1 -- 172.21.15.40:0/4197550913 shutdown_connections 2024-09-13T15:34:48.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc5441c9640 1 --2- 172.21.15.40:0/4197550913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c06ead0 0x7fc53c0bf340 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc5441c9640 1 -- 172.21.15.40:0/4197550913 >> 172.21.15.40:0/4197550913 conn(0x7fc53c06a370 msgr2=0x7fc53c06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:48.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc5441c9640 1 -- 172.21.15.40:0/4197550913 shutdown_connections 2024-09-13T15:34:48.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc5441c9640 1 -- 172.21.15.40:0/4197550913 wait complete. 2024-09-13T15:34:48.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc5441c9640 1 Processor -- start 2024-09-13T15:34:48.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc5441c9640 1 -- start start 2024-09-13T15:34:48.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc5441c9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c06e6f0 0x7fc53c13bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.199+0000 7fc5441c9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c13d790 con 0x7fc53c06e6f0 2024-09-13T15:34:48.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc541f65640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c06e6f0 0x7fc53c13bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc541f65640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c06e6f0 0x7fc53c13bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47534/0 (socket says 172.21.15.40:47534) 2024-09-13T15:34:48.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc541f65640 1 -- 172.21.15.40:0/5536879 learned_addr learned my addr 172.21.15.40:0/5536879 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:48.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc541f65640 1 -- 172.21.15.40:0/5536879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c00b770 con 0x7fc53c06e6f0 2024-09-13T15:34:48.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc541f65640 1 --2- 172.21.15.40:0/5536879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c06e6f0 0x7fc53c13bb70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc53800c410 tx=0x7fc53800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc5327fc640 1 -- 172.21.15.40:0/5536879 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc538007410 con 0x7fc53c06e6f0 2024-09-13T15:34:48.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc5327fc640 1 -- 172.21.15.40:0/5536879 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc538007570 con 0x7fc53c06e6f0 2024-09-13T15:34:48.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc5327fc640 1 -- 172.21.15.40:0/5536879 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc5380047f0 con 0x7fc53c06e6f0 2024-09-13T15:34:48.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc5441c9640 1 -- 172.21.15.40:0/5536879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c0b7610 con 0x7fc53c06e6f0 2024-09-13T15:34:48.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc5441c9640 1 -- 172.21.15.40:0/5536879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c0ba000 con 0x7fc53c06e6f0 2024-09-13T15:34:48.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc5441c9640 1 -- 172.21.15.40:0/5536879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c067850 con 0x7fc53c06e6f0 2024-09-13T15:34:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc5327fc640 1 -- 172.21.15.40:0/5536879 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fc538004950 con 0x7fc53c06e6f0 2024-09-13T15:34:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc5327fc640 1 --2- 172.21.15.40:0/5536879 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc520035450 0x7fc520037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc5327fc640 1 -- 172.21.15.40:0/5536879 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7fc5380478e0 con 0x7fc53c06e6f0 2024-09-13T15:34:48.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc541764640 1 --2- 172.21.15.40:0/5536879 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc520035450 0x7fc520037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.203+0000 7fc541764640 1 --2- 172.21.15.40:0/5536879 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc520035450 0x7fc520037910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0b1000 tx=0x7fc52c0a9070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.207+0000 7fea16be2640 1 Processor -- start 2024-09-13T15:34:48.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.207+0000 7fea16be2640 1 -- start start 2024-09-13T15:34:48.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.207+0000 7fea16be2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fea100b7bd0 0x7fea100c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.207+0000 7fea16be2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea100a7850 con 0x7fea10153f60 2024-09-13T15:34:48.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.207+0000 7fea16be2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1008c4f0 con 0x7fea100b7bd0 2024-09-13T15:34:48.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.207+0000 7fea0ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fea100b7bd0 0x7fea100c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.207+0000 7fea1497e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fea10153f60 0x7fea100c4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38762/0 (socket says 172.21.15.40:38762) 2024-09-13T15:34:48.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.207+0000 7fea1497e640 1 -- 172.21.15.40:0/3732939190 learned_addr learned my addr 172.21.15.40:0/3732939190 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:48.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.207+0000 7fea0ffff640 1 -- 172.21.15.40:0/3732939190 >> v1:172.21.15.40:6789/0 conn(0x7fea10153f60 legacy=0x7fea100c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fea0ffff640 1 -- 172.21.15.40:0/3732939190 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1008bdb0 con 0x7fea100b7bd0 2024-09-13T15:34:48.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fea0ffff640 1 --2- 172.21.15.40:0/3732939190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b7bd0 0x7fea100c06e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fea04009770 tx=0x7fea0401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d3d1b6318e8191 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fea0f7fe640 1 -- 172.21.15.40:0/3732939190 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea040ab530 con 0x7fea100b7bd0 2024-09-13T15:34:48.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fea0f7fe640 1 -- 172.21.15.40:0/3732939190 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea040a7050 con 0x7fea100b7bd0 2024-09-13T15:34:48.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fea0f7fe640 1 -- 172.21.15.40:0/3732939190 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea040ab7e0 con 0x7fea100b7bd0 2024-09-13T15:34:48.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fc5327fc640 1 -- 172.21.15.40:0/5536879 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc538004c00 con 0x7fc53c06e6f0 2024-09-13T15:34:48.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fea16be2640 1 -- 172.21.15.40:0/3732939190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b7bd0 msgr2=0x7fea100c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fea16be2640 1 --2- 172.21.15.40:0/3732939190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b7bd0 0x7fea100c06e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fea04009770 tx=0x7fea0401c420 comp rx=0 tx=0).stop 2024-09-13T15:34:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fea16be2640 1 -- 172.21.15.40:0/3732939190 shutdown_connections 2024-09-13T15:34:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fea16be2640 1 --2- 172.21.15.40:0/3732939190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b7bd0 0x7fea100c06e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fea16be2640 1 -- 172.21.15.40:0/3732939190 >> 172.21.15.40:0/3732939190 conn(0x7fea100a8640 msgr2=0x7fea10065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fea16be2640 1 -- 172.21.15.40:0/3732939190 shutdown_connections 2024-09-13T15:34:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.211+0000 7fea16be2640 1 -- 172.21.15.40:0/3732939190 wait complete. 2024-09-13T15:34:48.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea16be2640 1 Processor -- start 2024-09-13T15:34:48.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea16be2640 1 -- start start 2024-09-13T15:34:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea16be2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b7bd0 0x7fea10143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea16be2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea10154720 con 0x7fea100b7bd0 2024-09-13T15:34:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea1497e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b7bd0 0x7fea10143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea1497e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b7bd0 0x7fea10143ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47556/0 (socket says 172.21.15.40:47556) 2024-09-13T15:34:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea1497e640 1 -- 172.21.15.40:0/225870410 learned_addr learned my addr 172.21.15.40:0/225870410 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea1497e640 1 -- 172.21.15.40:0/225870410 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea04009420 con 0x7fea100b7bd0 2024-09-13T15:34:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea1497e640 1 --2- 172.21.15.40:0/225870410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b7bd0 0x7fea10143ab0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc00c480 tx=0x7fe9fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea0d7fa640 1 -- 172.21.15.40:0/225870410 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9fc005c20 con 0x7fea100b7bd0 2024-09-13T15:34:48.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea0d7fa640 1 -- 172.21.15.40:0/225870410 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9fc005d80 con 0x7fea100b7bd0 2024-09-13T15:34:48.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea0d7fa640 1 -- 172.21.15.40:0/225870410 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9fc0071a0 con 0x7fea100b7bd0 2024-09-13T15:34:48.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea16be2640 1 -- 172.21.15.40:0/225870410 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea101567f0 con 0x7fea100b7bd0 2024-09-13T15:34:48.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea16be2640 1 -- 172.21.15.40:0/225870410 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea10156cd0 con 0x7fea100b7bd0 2024-09-13T15:34:48.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea0d7fa640 1 -- 172.21.15.40:0/225870410 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fe9fc007300 con 0x7fea100b7bd0 2024-09-13T15:34:48.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea16be2640 1 -- 172.21.15.40:0/225870410 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea10067510 con 0x7fea100b7bd0 2024-09-13T15:34:48.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea0d7fa640 1 --2- 172.21.15.40:0/225870410 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fe9f4035450 0x7fe9f4037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.215+0000 7fea0d7fa640 1 -- 172.21.15.40:0/225870410 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7fe9fc046bc0 con 0x7fea100b7bd0 2024-09-13T15:34:48.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.219+0000 7fea0ffff640 1 --2- 172.21.15.40:0/225870410 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fe9f4035450 0x7fe9f4037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.219+0000 7fea0ffff640 1 --2- 172.21.15.40:0/225870410 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fe9f4035450 0x7fe9f4037910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea04009770 tx=0x7fea040a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.223+0000 7fea0d7fa640 1 -- 172.21.15.40:0/225870410 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe9fc0075b0 con 0x7fea100b7bd0 2024-09-13T15:34:48.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.335+0000 7f5989bf0640 1 -- 172.21.15.40:0/3269137801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f598406b820 con 0x7f598406b440 2024-09-13T15:34:48.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.335+0000 7f596bfff640 1 -- 172.21.15.40:0/3269137801 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f59740c5340 con 0x7f598406b440 2024-09-13T15:34:48.339 INFO:teuthology.orchestra.run.smithi040.stdout:34359738376 2024-09-13T15:34:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.339+0000 7f5989bf0640 1 -- 172.21.15.40:0/3269137801 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5970035450 msgr2=0x7f5970037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.339+0000 7f5989bf0640 1 --2- 172.21.15.40:0/3269137801 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5970035450 0x7f5970037910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5978007fd0 tx=0x7f5978007920 comp rx=0 tx=0).stop 2024-09-13T15:34:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.339+0000 7f5989bf0640 1 -- 172.21.15.40:0/3269137801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598406b440 msgr2=0x7f598414a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.339+0000 7f5989bf0640 1 --2- 172.21.15.40:0/3269137801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598406b440 0x7f598414a210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f59740190f0 tx=0x7f597401ad20 comp rx=0 tx=0).stop 2024-09-13T15:34:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.339+0000 7f5989bf0640 1 -- 172.21.15.40:0/3269137801 shutdown_connections 2024-09-13T15:34:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.339+0000 7f5989bf0640 1 --2- 172.21.15.40:0/3269137801 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f5970035450 0x7f5970037910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.339+0000 7f5989bf0640 1 --2- 172.21.15.40:0/3269137801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f598406b440 0x7f598414a210 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.339+0000 7f5989bf0640 1 -- 172.21.15.40:0/3269137801 >> 172.21.15.40:0/3269137801 conn(0x7f598406a370 msgr2=0x7f598406a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.339+0000 7f5989bf0640 1 -- 172.21.15.40:0/3269137801 shutdown_connections 2024-09-13T15:34:48.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.339+0000 7f5989bf0640 1 -- 172.21.15.40:0/3269137801 wait complete. 2024-09-13T15:34:48.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738376 got 34359738376 for osd.2 2024-09-13T15:34:48.357 DEBUG:teuthology.parallel:result is None 2024-09-13T15:34:48.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.383+0000 7fea16be2640 1 -- 172.21.15.40:0/225870410 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fea100c0690 con 0x7fea100b7bd0 2024-09-13T15:34:48.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.383+0000 7fea0d7fa640 1 -- 172.21.15.40:0/225870410 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9fc017070 con 0x7fea100b7bd0 2024-09-13T15:34:48.386 INFO:teuthology.orchestra.run.smithi040.stdout:34359738375 2024-09-13T15:34:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.387+0000 7fea16be2640 1 -- 172.21.15.40:0/225870410 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fe9f4035450 msgr2=0x7fe9f4037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.387+0000 7fea16be2640 1 --2- 172.21.15.40:0/225870410 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fe9f4035450 0x7fe9f4037910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fea04009770 tx=0x7fea040a6000 comp rx=0 tx=0).stop 2024-09-13T15:34:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.387+0000 7fea16be2640 1 -- 172.21.15.40:0/225870410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b7bd0 msgr2=0x7fea10143ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.387+0000 7fea16be2640 1 --2- 172.21.15.40:0/225870410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b7bd0 0x7fea10143ab0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc00c480 tx=0x7fe9fc00c940 comp rx=0 tx=0).stop 2024-09-13T15:34:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.387+0000 7fea16be2640 1 -- 172.21.15.40:0/225870410 shutdown_connections 2024-09-13T15:34:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.387+0000 7fea16be2640 1 --2- 172.21.15.40:0/225870410 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fe9f4035450 0x7fe9f4037910 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.387+0000 7fea16be2640 1 --2- 172.21.15.40:0/225870410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fea100b7bd0 0x7fea10143ab0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.387+0000 7fea16be2640 1 -- 172.21.15.40:0/225870410 >> 172.21.15.40:0/225870410 conn(0x7fea100a8640 msgr2=0x7fea100c4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:48.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.387+0000 7fea16be2640 1 -- 172.21.15.40:0/225870410 shutdown_connections 2024-09-13T15:34:48.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.387+0000 7fea16be2640 1 -- 172.21.15.40:0/225870410 wait complete. 2024-09-13T15:34:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.387+0000 7fc5441c9640 1 -- 172.21.15.40:0/5536879 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc53c0bd400 con 0x7fc53c06e6f0 2024-09-13T15:34:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.387+0000 7fc5327fc640 1 -- 172.21.15.40:0/5536879 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc538019ab0 con 0x7fc53c06e6f0 2024-09-13T15:34:48.391 INFO:teuthology.orchestra.run.smithi040.stdout:34359738377 2024-09-13T15:34:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.391+0000 7fc5441c9640 1 -- 172.21.15.40:0/5536879 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc520035450 msgr2=0x7fc520037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.391+0000 7fc5441c9640 1 --2- 172.21.15.40:0/5536879 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc520035450 0x7fc520037910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0b1000 tx=0x7fc52c0a9070 comp rx=0 tx=0).stop 2024-09-13T15:34:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.391+0000 7fc5441c9640 1 -- 172.21.15.40:0/5536879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c06e6f0 msgr2=0x7fc53c13bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.391+0000 7fc5441c9640 1 --2- 172.21.15.40:0/5536879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c06e6f0 0x7fc53c13bb70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc53800c410 tx=0x7fc53800c8d0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.391+0000 7fc5441c9640 1 -- 172.21.15.40:0/5536879 shutdown_connections 2024-09-13T15:34:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.391+0000 7fc5441c9640 1 --2- 172.21.15.40:0/5536879 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc520035450 0x7fc520037910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.391+0000 7fc5441c9640 1 --2- 172.21.15.40:0/5536879 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc53c06e6f0 0x7fc53c13bb70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.391+0000 7fc5441c9640 1 -- 172.21.15.40:0/5536879 >> 172.21.15.40:0/5536879 conn(0x7fc53c06a370 msgr2=0x7fc53c06fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.391+0000 7fc5441c9640 1 -- 172.21.15.40:0/5536879 shutdown_connections 2024-09-13T15:34:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.391+0000 7fc5441c9640 1 -- 172.21.15.40:0/5536879 wait complete. 2024-09-13T15:34:48.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738375 got 34359738375 for osd.1 2024-09-13T15:34:48.406 DEBUG:teuthology.parallel:result is None 2024-09-13T15:34:48.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738377 got 34359738377 for osd.0 2024-09-13T15:34:48.410 DEBUG:teuthology.parallel:result is None 2024-09-13T15:34:48.410 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T15:34:48.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:34:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.563+0000 7f29f8690640 1 Processor -- start 2024-09-13T15:34:48.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.563+0000 7f29f8690640 1 -- start start 2024-09-13T15:34:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.563+0000 7f29f8690640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29f00b4600 0x7f29f014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.563+0000 7f29f8690640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f00c1130 con 0x7f29f014e280 2024-09-13T15:34:48.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.563+0000 7f29f8690640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f014e780 con 0x7f29f00b4600 2024-09-13T15:34:48.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f642c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29f00b4600 0x7f29f014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f5c2b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f29f014e280 0x7f29f00bf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38776/0 (socket says 172.21.15.40:38776) 2024-09-13T15:34:48.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f5c2b640 1 -- 172.21.15.40:0/2025821861 learned_addr learned my addr 172.21.15.40:0/2025821861 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:48.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f642c640 1 -- 172.21.15.40:0/2025821861 >> v1:172.21.15.40:6789/0 conn(0x7f29f014e280 legacy=0x7f29f00bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f642c640 1 -- 172.21.15.40:0/2025821861 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f00b59f0 con 0x7f29f00b4600 2024-09-13T15:34:48.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f642c640 1 --2- 172.21.15.40:0/2025821861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29f00b4600 0x7f29f014dd40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009740 tx=0x7f29ec01c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a072d6e8252d88d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f542a640 1 -- 172.21.15.40:0/2025821861 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29ec0ab530 con 0x7f29f00b4600 2024-09-13T15:34:48.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f542a640 1 -- 172.21.15.40:0/2025821861 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec0a7050 con 0x7f29f00b4600 2024-09-13T15:34:48.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f542a640 1 -- 172.21.15.40:0/2025821861 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29ec0ab7e0 con 0x7f29f00b4600 2024-09-13T15:34:48.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f8690640 1 -- 172.21.15.40:0/2025821861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29f00b4600 msgr2=0x7f29f014dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f8690640 1 --2- 172.21.15.40:0/2025821861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29f00b4600 0x7f29f014dd40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009740 tx=0x7f29ec01c220 comp rx=0 tx=0).stop 2024-09-13T15:34:48.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f8690640 1 -- 172.21.15.40:0/2025821861 shutdown_connections 2024-09-13T15:34:48.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f8690640 1 --2- 172.21.15.40:0/2025821861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29f00b4600 0x7f29f014dd40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f8690640 1 -- 172.21.15.40:0/2025821861 >> 172.21.15.40:0/2025821861 conn(0x7f29f006a540 msgr2=0x7f29f00a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:48.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.567+0000 7f29f8690640 1 -- 172.21.15.40:0/2025821861 shutdown_connections 2024-09-13T15:34:48.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29f8690640 1 -- 172.21.15.40:0/2025821861 wait complete. 2024-09-13T15:34:48.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29f8690640 1 Processor -- start 2024-09-13T15:34:48.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29f8690640 1 -- start start 2024-09-13T15:34:48.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29f8690640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29f00b4600 0x7f29f006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29f8690640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f006eac0 con 0x7f29f00b4600 2024-09-13T15:34:48.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29f642c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29f00b4600 0x7f29f006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29f642c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29f00b4600 0x7f29f006e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47570/0 (socket says 172.21.15.40:47570) 2024-09-13T15:34:48.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29f642c640 1 -- 172.21.15.40:0/933282644 learned_addr learned my addr 172.21.15.40:0/933282644 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:48.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29f642c640 1 -- 172.21.15.40:0/933282644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec009420 con 0x7f29f00b4600 2024-09-13T15:34:48.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29f642c640 1 --2- 172.21.15.40:0/933282644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29f00b4600 0x7f29f006e4d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f29ec019e50 tx=0x7f29ec01aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29e6ffd640 1 -- 172.21.15.40:0/933282644 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29ec0b7450 con 0x7f29f00b4600 2024-09-13T15:34:48.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29e6ffd640 1 -- 172.21.15.40:0/933282644 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec0b75b0 con 0x7f29f00b4600 2024-09-13T15:34:48.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29f8690640 1 -- 172.21.15.40:0/933282644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f00bb330 con 0x7f29f00b4600 2024-09-13T15:34:48.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29e6ffd640 1 -- 172.21.15.40:0/933282644 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29ec0b7850 con 0x7f29f00b4600 2024-09-13T15:34:48.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.571+0000 7f29f8690640 1 -- 172.21.15.40:0/933282644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f0143580 con 0x7f29f00b4600 2024-09-13T15:34:48.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.575+0000 7f29e6ffd640 1 -- 172.21.15.40:0/933282644 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f29ec0b79b0 con 0x7f29f00b4600 2024-09-13T15:34:48.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.575+0000 7f29f8690640 1 -- 172.21.15.40:0/933282644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f00a3b40 con 0x7f29f00b4600 2024-09-13T15:34:48.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.575+0000 7f29e6ffd640 1 --2- 172.21.15.40:0/933282644 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f29d4035450 0x7f29d4037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.575+0000 7f29e6ffd640 1 -- 172.21.15.40:0/933282644 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f29ec0e2120 con 0x7f29f00b4600 2024-09-13T15:34:48.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.575+0000 7f29f5c2b640 1 --2- 172.21.15.40:0/933282644 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f29d4035450 0x7f29d4037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.575+0000 7f29f5c2b640 1 --2- 172.21.15.40:0/933282644 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f29d4035450 0x7f29d4037910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f29e00017b0 tx=0x7f29e0007a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.579+0000 7f29e6ffd640 1 -- 172.21.15.40:0/933282644 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f29ec0c76c0 con 0x7f29f00b4600 2024-09-13T15:34:48.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.727+0000 7f29f8690640 1 -- 172.21.15.40:0/933282644 --> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29f00ba6b0 con 0x7f29d4035450 2024-09-13T15:34:48.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.747+0000 7f29e6ffd640 1 -- 172.21.15.40:0/933282644 <== mgr.4099 v2:172.21.15.40:6824/3185150828 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247299 (secure 0 0 0) 0x7f29f00ba6b0 con 0x7f29d4035450 2024-09-13T15:34:48.749 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:48.755 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:34:48.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.751+0000 7f29f8690640 1 -- 172.21.15.40:0/933282644 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f29d4035450 msgr2=0x7f29d4037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.751+0000 7f29f8690640 1 --2- 172.21.15.40:0/933282644 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f29d4035450 0x7f29d4037910 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f29e00017b0 tx=0x7f29e0007a30 comp rx=0 tx=0).stop 2024-09-13T15:34:48.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.751+0000 7f29f8690640 1 -- 172.21.15.40:0/933282644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29f00b4600 msgr2=0x7f29f006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.751+0000 7f29f8690640 1 --2- 172.21.15.40:0/933282644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29f00b4600 0x7f29f006e4d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f29ec019e50 tx=0x7f29ec01aa60 comp rx=0 tx=0).stop 2024-09-13T15:34:48.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.751+0000 7f29f8690640 1 -- 172.21.15.40:0/933282644 shutdown_connections 2024-09-13T15:34:48.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.751+0000 7f29f8690640 1 --2- 172.21.15.40:0/933282644 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f29d4035450 0x7f29d4037910 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.751+0000 7f29f8690640 1 --2- 172.21.15.40:0/933282644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29f00b4600 0x7f29f006e4d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.751+0000 7f29f8690640 1 -- 172.21.15.40:0/933282644 >> 172.21.15.40:0/933282644 conn(0x7f29f006a540 msgr2=0x7f29f014d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:48.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.751+0000 7f29f8690640 1 -- 172.21.15.40:0/933282644 shutdown_connections 2024-09-13T15:34:48.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.751+0000 7f29f8690640 1 -- 172.21.15.40:0/933282644 wait complete. 2024-09-13T15:34:48.768 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-13T15:34:47.060225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82700,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032820,"statfs":{"total":289910292480,"available":289825607680,"internally_reserved":0,"allocated":1671168,"data_stored":1313662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.760800"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302505+0000","last_change":"2024-09-13T15:34:35.347293+0000","last_active":"2024-09-13T15:34:36.302505+0000","last_peered":"2024-09-13T15:34:36.302505+0000","last_clean":"2024-09-13T15:34:36.302505+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:34:36.302505+0000","last_undegraded":"2024-09-13T15:34:36.302505+0000","last_fullsized":"2024-09-13T15:34:36.302505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:52.388403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227786+0000","last_change":"2024-09-13T15:34:35.329279+0000","last_active":"2024-09-13T15:34:38.227786+0000","last_peered":"2024-09-13T15:34:38.227786+0000","last_clean":"2024-09-13T15:34:38.227786+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:34:38.227786+0000","last_undegraded":"2024-09-13T15:34:38.227786+0000","last_fullsized":"2024-09-13T15:34:38.227786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303160+0000","last_change":"2024-09-13T15:34:35.324580+0000","last_active":"2024-09-13T15:34:36.303160+0000","last_peered":"2024-09-13T15:34:36.303160+0000","last_clean":"2024-09-13T15:34:36.303160+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:34:36.303160+0000","last_undegraded":"2024-09-13T15:34:36.303160+0000","last_fullsized":"2024-09-13T15:34:36.303160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:08.082085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.230674+0000","last_change":"2024-09-13T15:34:35.330864+0000","last_active":"2024-09-13T15:34:38.230674+0000","last_peered":"2024-09-13T15:34:38.230674+0000","last_clean":"2024-09-13T15:34:38.230674+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:34:38.230674+0000","last_undegraded":"2024-09-13T15:34:38.230674+0000","last_fullsized":"2024-09-13T15:34:38.230674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303451+0000","last_change":"2024-09-13T15:34:35.327922+0000","last_active":"2024-09-13T15:34:36.303451+0000","last_peered":"2024-09-13T15:34:36.303451+0000","last_clean":"2024-09-13T15:34:36.303451+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:34:36.303451+0000","last_undegraded":"2024-09-13T15:34:36.303451+0000","last_fullsized":"2024-09-13T15:34:36.303451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:22.066293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.230856+0000","last_change":"2024-09-13T15:34:35.329319+0000","last_active":"2024-09-13T15:34:38.230856+0000","last_peered":"2024-09-13T15:34:38.230856+0000","last_clean":"2024-09-13T15:34:38.230856+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:34:38.230856+0000","last_undegraded":"2024-09-13T15:34:38.230856+0000","last_fullsized":"2024-09-13T15:34:38.230856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303392+0000","last_change":"2024-09-13T15:34:35.334719+0000","last_active":"2024-09-13T15:34:36.303392+0000","last_peered":"2024-09-13T15:34:36.303392+0000","last_clean":"2024-09-13T15:34:36.303392+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:34:36.303392+0000","last_undegraded":"2024-09-13T15:34:36.303392+0000","last_fullsized":"2024-09-13T15:34:36.303392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:14.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228428+0000","last_change":"2024-09-13T15:34:35.335400+0000","last_active":"2024-09-13T15:34:38.228428+0000","last_peered":"2024-09-13T15:34:38.228428+0000","last_clean":"2024-09-13T15:34:38.228428+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:34:38.228428+0000","last_undegraded":"2024-09-13T15:34:38.228428+0000","last_fullsized":"2024-09-13T15:34:38.228428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229045+0000","last_change":"2024-09-13T15:34:35.345251+0000","last_active":"2024-09-13T15:34:38.229045+0000","last_peered":"2024-09-13T15:34:38.229045+0000","last_clean":"2024-09-13T15:34:38.229045+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:34:38.229045+0000","last_undegraded":"2024-09-13T15:34:38.229045+0000","last_fullsized":"2024-09-13T15:34:38.229045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303230+0000","last_change":"2024-09-13T15:34:35.319299+0000","last_active":"2024-09-13T15:34:36.303230+0000","last_peered":"2024-09-13T15:34:36.303230+0000","last_clean":"2024-09-13T15:34:36.303230+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:34:36.303230+0000","last_undegraded":"2024-09-13T15:34:36.303230+0000","last_fullsized":"2024-09-13T15:34:36.303230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:16.700428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302978+0000","last_change":"2024-09-13T15:34:35.331709+0000","last_active":"2024-09-13T15:34:36.302978+0000","last_peered":"2024-09-13T15:34:36.302978+0000","last_clean":"2024-09-13T15:34:36.302978+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:34:36.302978+0000","last_undegraded":"2024-09-13T15:34:36.302978+0000","last_fullsized":"2024-09-13T15:34:36.302978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:17.069173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302586+0000","last_change":"2024-09-13T15:34:35.330875+0000","last_active":"2024-09-13T15:34:36.302586+0000","last_peered":"2024-09-13T15:34:36.302586+0000","last_clean":"2024-09-13T15:34:36.302586+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:34:36.302586+0000","last_undegraded":"2024-09-13T15:34:36.302586+0000","last_fullsized":"2024-09-13T15:34:36.302586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:22.297990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303695+0000","last_change":"2024-09-13T15:34:35.335252+0000","last_active":"2024-09-13T15:34:36.303695+0000","last_peered":"2024-09-13T15:34:36.303695+0000","last_clean":"2024-09-13T15:34:36.303695+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:34:36.303695+0000","last_undegraded":"2024-09-13T15:34:36.303695+0000","last_fullsized":"2024-09-13T15:34:36.303695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:37.432254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302324+0000","last_change":"2024-09-13T15:34:35.335599+0000","last_active":"2024-09-13T15:34:36.302324+0000","last_peered":"2024-09-13T15:34:36.302324+0000","last_clean":"2024-09-13T15:34:36.302324+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:34:36.302324+0000","last_undegraded":"2024-09-13T15:34:36.302324+0000","last_fullsized":"2024-09-13T15:34:36.302324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:06.605564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228614+0000","last_change":"2024-09-13T15:34:35.333765+0000","last_active":"2024-09-13T15:34:38.228614+0000","last_peered":"2024-09-13T15:34:38.228614+0000","last_clean":"2024-09-13T15:34:38.228614+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:34:38.228614+0000","last_undegraded":"2024-09-13T15:34:38.228614+0000","last_fullsized":"2024-09-13T15:34:38.228614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229241+0000","last_change":"2024-09-13T15:34:35.331848+0000","last_active":"2024-09-13T15:34:38.229241+0000","last_peered":"2024-09-13T15:34:38.229241+0000","last_clean":"2024-09-13T15:34:38.229241+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:34:38.229241+0000","last_undegraded":"2024-09-13T15:34:38.229241+0000","last_fullsized":"2024-09-13T15:34:38.229241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229727+0000","last_change":"2024-09-13T15:34:35.333522+0000","last_active":"2024-09-13T15:34:38.229727+0000","last_peered":"2024-09-13T15:34:38.229727+0000","last_clean":"2024-09-13T15:34:38.229727+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:34:38.229727+0000","last_undegraded":"2024-09-13T15:34:38.229727+0000","last_fullsized":"2024-09-13T15:34:38.229727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231318+0000","last_change":"2024-09-13T15:34:35.335384+0000","last_active":"2024-09-13T15:34:38.231318+0000","last_peered":"2024-09-13T15:34:38.231318+0000","last_clean":"2024-09-13T15:34:38.231318+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:34:38.231318+0000","last_undegraded":"2024-09-13T15:34:38.231318+0000","last_fullsized":"2024-09-13T15:34:38.231318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303390+0000","last_change":"2024-09-13T15:34:35.324912+0000","last_active":"2024-09-13T15:34:36.303390+0000","last_peered":"2024-09-13T15:34:36.303390+0000","last_clean":"2024-09-13T15:34:36.303390+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:34:36.303390+0000","last_undegraded":"2024-09-13T15:34:36.303390+0000","last_fullsized":"2024-09-13T15:34:36.303390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302638+0000","last_change":"2024-09-13T15:34:35.346893+0000","last_active":"2024-09-13T15:34:36.302638+0000","last_peered":"2024-09-13T15:34:36.302638+0000","last_clean":"2024-09-13T15:34:36.302638+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:34:36.302638+0000","last_undegraded":"2024-09-13T15:34:36.302638+0000","last_fullsized":"2024-09-13T15:34:36.302638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:52.439034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303077+0000","last_change":"2024-09-13T15:34:35.325306+0000","last_active":"2024-09-13T15:34:36.303077+0000","last_peered":"2024-09-13T15:34:36.303077+0000","last_clean":"2024-09-13T15:34:36.303077+0000","last_became_active":"2024-09-13T15:34:35.322050+0000","last_became_peered":"2024-09-13T15:34:35.322050+0000","last_unstale":"2024-09-13T15:34:36.303077+0000","last_undegraded":"2024-09-13T15:34:36.303077+0000","last_fullsized":"2024-09-13T15:34:36.303077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:27.724097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227661+0000","last_change":"2024-09-13T15:34:35.329712+0000","last_active":"2024-09-13T15:34:38.227661+0000","last_peered":"2024-09-13T15:34:38.227661+0000","last_clean":"2024-09-13T15:34:38.227661+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:34:38.227661+0000","last_undegraded":"2024-09-13T15:34:38.227661+0000","last_fullsized":"2024-09-13T15:34:38.227661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.301852+0000","last_change":"2024-09-13T15:34:35.324523+0000","last_active":"2024-09-13T15:34:36.301852+0000","last_peered":"2024-09-13T15:34:36.301852+0000","last_clean":"2024-09-13T15:34:36.301852+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:34:36.301852+0000","last_undegraded":"2024-09-13T15:34:36.301852+0000","last_fullsized":"2024-09-13T15:34:36.301852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.301945+0000","last_change":"2024-09-13T15:34:35.327879+0000","last_active":"2024-09-13T15:34:36.301945+0000","last_peered":"2024-09-13T15:34:36.301945+0000","last_clean":"2024-09-13T15:34:36.301945+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:34:36.301945+0000","last_undegraded":"2024-09-13T15:34:36.301945+0000","last_fullsized":"2024-09-13T15:34:36.301945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231266+0000","last_change":"2024-09-13T15:34:35.336949+0000","last_active":"2024-09-13T15:34:38.231266+0000","last_peered":"2024-09-13T15:34:38.231266+0000","last_clean":"2024-09-13T15:34:38.231266+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:34:38.231266+0000","last_undegraded":"2024-09-13T15:34:38.231266+0000","last_fullsized":"2024-09-13T15:34:38.231266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:45.530761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231406+0000","last_change":"2024-09-13T15:34:35.335209+0000","last_active":"2024-09-13T15:34:38.231406+0000","last_peered":"2024-09-13T15:34:38.231406+0000","last_clean":"2024-09-13T15:34:38.231406+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:34:38.231406+0000","last_undegraded":"2024-09-13T15:34:38.231406+0000","last_fullsized":"2024-09-13T15:34:38.231406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228671+0000","last_change":"2024-09-13T15:34:35.339305+0000","last_active":"2024-09-13T15:34:38.228671+0000","last_peered":"2024-09-13T15:34:38.228671+0000","last_clean":"2024-09-13T15:34:38.228671+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:34:38.228671+0000","last_undegraded":"2024-09-13T15:34:38.228671+0000","last_fullsized":"2024-09-13T15:34:38.228671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302727+0000","last_change":"2024-09-13T15:34:35.328129+0000","last_active":"2024-09-13T15:34:36.302727+0000","last_peered":"2024-09-13T15:34:36.302727+0000","last_clean":"2024-09-13T15:34:36.302727+0000","last_became_active":"2024-09-13T15:34:35.327356+0000","last_became_peered":"2024-09-13T15:34:35.327356+0000","last_unstale":"2024-09-13T15:34:36.302727+0000","last_undegraded":"2024-09-13T15:34:36.302727+0000","last_fullsized":"2024-09-13T15:34:36.302727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:19.369318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302983+0000","last_change":"2024-09-13T15:34:35.331611+0000","last_active":"2024-09-13T15:34:36.302983+0000","last_peered":"2024-09-13T15:34:36.302983+0000","last_clean":"2024-09-13T15:34:36.302983+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:34:36.302983+0000","last_undegraded":"2024-09-13T15:34:36.302983+0000","last_fullsized":"2024-09-13T15:34:36.302983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:08.881292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302465+0000","last_change":"2024-09-13T15:34:35.324690+0000","last_active":"2024-09-13T15:34:36.302465+0000","last_peered":"2024-09-13T15:34:36.302465+0000","last_clean":"2024-09-13T15:34:36.302465+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:34:36.302465+0000","last_undegraded":"2024-09-13T15:34:36.302465+0000","last_fullsized":"2024-09-13T15:34:36.302465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.230387+0000","last_change":"2024-09-13T15:34:35.335517+0000","last_active":"2024-09-13T15:34:38.230387+0000","last_peered":"2024-09-13T15:34:38.230387+0000","last_clean":"2024-09-13T15:34:38.230387+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:34:38.230387+0000","last_undegraded":"2024-09-13T15:34:38.230387+0000","last_fullsized":"2024-09-13T15:34:38.230387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:58.399592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229648+0000","last_change":"2024-09-13T15:34:35.331904+0000","last_active":"2024-09-13T15:34:38.229648+0000","last_peered":"2024-09-13T15:34:38.229648+0000","last_clean":"2024-09-13T15:34:38.229648+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:34:38.229648+0000","last_undegraded":"2024-09-13T15:34:38.229648+0000","last_fullsized":"2024-09-13T15:34:38.229648+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227945+0000","last_change":"2024-09-13T15:34:35.343571+0000","last_active":"2024-09-13T15:34:38.227945+0000","last_peered":"2024-09-13T15:34:38.227945+0000","last_clean":"2024-09-13T15:34:38.227945+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:34:38.227945+0000","last_undegraded":"2024-09-13T15:34:38.227945+0000","last_fullsized":"2024-09-13T15:34:38.227945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.342554+0000","last_change":"2024-09-13T15:34:34.944458+0000","last_active":"2024-09-13T15:34:35.342554+0000","last_peered":"2024-09-13T15:34:35.342554+0000","last_clean":"2024-09-13T15:34:35.342554+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:34:35.342554+0000","last_undegraded":"2024-09-13T15:34:35.342554+0000","last_fullsized":"2024-09-13T15:34:35.342554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303083+0000","last_change":"2024-09-13T15:34:35.331843+0000","last_active":"2024-09-13T15:34:36.303083+0000","last_peered":"2024-09-13T15:34:36.303083+0000","last_clean":"2024-09-13T15:34:36.303083+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:34:36.303083+0000","last_undegraded":"2024-09-13T15:34:36.303083+0000","last_fullsized":"2024-09-13T15:34:36.303083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:43.103418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.328697+0000","last_change":"2024-09-13T15:34:34.957379+0000","last_active":"2024-09-13T15:34:35.328697+0000","last_peered":"2024-09-13T15:34:35.328697+0000","last_clean":"2024-09-13T15:34:35.328697+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:34:35.328697+0000","last_undegraded":"2024-09-13T15:34:35.328697+0000","last_fullsized":"2024-09-13T15:34:35.328697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.300958+0000","last_change":"2024-09-13T15:34:34.954475+0000","last_active":"2024-09-13T15:34:35.300958+0000","last_peered":"2024-09-13T15:34:35.300958+0000","last_clean":"2024-09-13T15:34:35.300958+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:34:35.300958+0000","last_undegraded":"2024-09-13T15:34:35.300958+0000","last_fullsized":"2024-09-13T15:34:35.300958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229772+0000","last_change":"2024-09-13T15:34:35.340304+0000","last_active":"2024-09-13T15:34:38.229772+0000","last_peered":"2024-09-13T15:34:38.229772+0000","last_clean":"2024-09-13T15:34:38.229772+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:34:38.229772+0000","last_undegraded":"2024-09-13T15:34:38.229772+0000","last_fullsized":"2024-09-13T15:34:38.229772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.297580+0000","last_change":"2024-09-13T15:34:34.950709+0000","last_active":"2024-09-13T15:34:35.297580+0000","last_peered":"2024-09-13T15:34:35.297580+0000","last_clean":"2024-09-13T15:34:35.297580+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:34:35.297580+0000","last_undegraded":"2024-09-13T15:34:35.297580+0000","last_fullsized":"2024-09-13T15:34:35.297580+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227382+0000","last_change":"2024-09-13T15:34:35.335773+0000","last_active":"2024-09-13T15:34:38.227382+0000","last_peered":"2024-09-13T15:34:38.227382+0000","last_clean":"2024-09-13T15:34:38.227382+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:34:38.227382+0000","last_undegraded":"2024-09-13T15:34:38.227382+0000","last_fullsized":"2024-09-13T15:34:38.227382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.330447+0000","last_change":"2024-09-13T15:34:34.939305+0000","last_active":"2024-09-13T15:34:35.330447+0000","last_peered":"2024-09-13T15:34:35.330447+0000","last_clean":"2024-09-13T15:34:35.330447+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:34:35.330447+0000","last_undegraded":"2024-09-13T15:34:35.330447+0000","last_fullsized":"2024-09-13T15:34:35.330447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231671+0000","last_change":"2024-09-13T15:34:35.338289+0000","last_active":"2024-09-13T15:34:38.231671+0000","last_peered":"2024-09-13T15:34:38.231671+0000","last_clean":"2024-09-13T15:34:38.231671+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:34:38.231671+0000","last_undegraded":"2024-09-13T15:34:38.231671+0000","last_fullsized":"2024-09-13T15:34:38.231671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:34.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.300585+0000","last_change":"2024-09-13T15:34:34.953625+0000","last_active":"2024-09-13T15:34:35.300585+0000","last_peered":"2024-09-13T15:34:35.300585+0000","last_clean":"2024-09-13T15:34:35.300585+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:34:35.300585+0000","last_undegraded":"2024-09-13T15:34:35.300585+0000","last_fullsized":"2024-09-13T15:34:35.300585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303221+0000","last_change":"2024-09-13T15:34:35.347690+0000","last_active":"2024-09-13T15:34:36.303221+0000","last_peered":"2024-09-13T15:34:36.303221+0000","last_clean":"2024-09-13T15:34:36.303221+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:34:36.303221+0000","last_undegraded":"2024-09-13T15:34:36.303221+0000","last_fullsized":"2024-09-13T15:34:36.303221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:53.778485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.350982+0000","last_change":"2024-09-13T15:34:34.949988+0000","last_active":"2024-09-13T15:34:35.350982+0000","last_peered":"2024-09-13T15:34:35.350982+0000","last_clean":"2024-09-13T15:34:35.350982+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:34:35.350982+0000","last_undegraded":"2024-09-13T15:34:35.350982+0000","last_fullsized":"2024-09-13T15:34:35.350982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228648+0000","last_change":"2024-09-13T15:34:35.341547+0000","last_active":"2024-09-13T15:34:38.228648+0000","last_peered":"2024-09-13T15:34:38.228648+0000","last_clean":"2024-09-13T15:34:38.228648+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:34:38.228648+0000","last_undegraded":"2024-09-13T15:34:38.228648+0000","last_fullsized":"2024-09-13T15:34:38.228648+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"15'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.350263+0000","last_change":"2024-09-13T15:34:34.955883+0000","last_active":"2024-09-13T15:34:35.350263+0000","last_peered":"2024-09-13T15:34:35.350263+0000","last_clean":"2024-09-13T15:34:35.350263+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:34:35.350263+0000","last_undegraded":"2024-09-13T15:34:35.350263+0000","last_fullsized":"2024-09-13T15:34:35.350263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303048+0000","last_change":"2024-09-13T15:34:35.345452+0000","last_active":"2024-09-13T15:34:36.303048+0000","last_peered":"2024-09-13T15:34:36.303048+0000","last_clean":"2024-09-13T15:34:36.303048+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:34:36.303048+0000","last_undegraded":"2024-09-13T15:34:36.303048+0000","last_fullsized":"2024-09-13T15:34:36.303048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:08:25.983299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.310170+0000","last_change":"2024-09-13T15:34:34.942058+0000","last_active":"2024-09-13T15:34:35.310170+0000","last_peered":"2024-09-13T15:34:35.310170+0000","last_clean":"2024-09-13T15:34:35.310170+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:34:35.310170+0000","last_undegraded":"2024-09-13T15:34:35.310170+0000","last_fullsized":"2024-09-13T15:34:35.310170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302628+0000","last_change":"2024-09-13T15:34:35.334637+0000","last_active":"2024-09-13T15:34:36.302628+0000","last_peered":"2024-09-13T15:34:36.302628+0000","last_clean":"2024-09-13T15:34:36.302628+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:34:36.302628+0000","last_undegraded":"2024-09-13T15:34:36.302628+0000","last_fullsized":"2024-09-13T15:34:36.302628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:43.466895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.309490+0000","last_change":"2024-09-13T15:34:34.957763+0000","last_active":"2024-09-13T15:34:35.309490+0000","last_peered":"2024-09-13T15:34:35.309490+0000","last_clean":"2024-09-13T15:34:35.309490+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:34:35.309490+0000","last_undegraded":"2024-09-13T15:34:35.309490+0000","last_fullsized":"2024-09-13T15:34:35.309490+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227481+0000","last_change":"2024-09-13T15:34:35.342732+0000","last_active":"2024-09-13T15:34:38.227481+0000","last_peered":"2024-09-13T15:34:38.227481+0000","last_clean":"2024-09-13T15:34:38.227481+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:34:38.227481+0000","last_undegraded":"2024-09-13T15:34:38.227481+0000","last_fullsized":"2024-09-13T15:34:38.227481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.301557+0000","last_change":"2024-09-13T15:34:34.954181+0000","last_active":"2024-09-13T15:34:35.301557+0000","last_peered":"2024-09-13T15:34:35.301557+0000","last_clean":"2024-09-13T15:34:35.301557+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:34:35.301557+0000","last_undegraded":"2024-09-13T15:34:35.301557+0000","last_fullsized":"2024-09-13T15:34:35.301557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228287+0000","last_change":"2024-09-13T15:34:35.329165+0000","last_active":"2024-09-13T15:34:38.228287+0000","last_peered":"2024-09-13T15:34:38.228287+0000","last_clean":"2024-09-13T15:34:38.228287+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:34:38.228287+0000","last_undegraded":"2024-09-13T15:34:38.228287+0000","last_fullsized":"2024-09-13T15:34:38.228287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.346922+0000","last_change":"2024-09-13T15:34:34.959407+0000","last_active":"2024-09-13T15:34:35.346922+0000","last_peered":"2024-09-13T15:34:35.346922+0000","last_clean":"2024-09-13T15:34:35.346922+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:34:35.346922+0000","last_undegraded":"2024-09-13T15:34:35.346922+0000","last_fullsized":"2024-09-13T15:34:35.346922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:31.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.230371+0000","last_change":"2024-09-13T15:34:35.335319+0000","last_active":"2024-09-13T15:34:38.230371+0000","last_peered":"2024-09-13T15:34:38.230371+0000","last_clean":"2024-09-13T15:34:38.230371+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:34:38.230371+0000","last_undegraded":"2024-09-13T15:34:38.230371+0000","last_fullsized":"2024-09-13T15:34:38.230371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.325671+0000","last_change":"2024-09-13T15:34:34.959935+0000","last_active":"2024-09-13T15:34:35.325671+0000","last_peered":"2024-09-13T15:34:35.325671+0000","last_clean":"2024-09-13T15:34:35.325671+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:34:35.325671+0000","last_undegraded":"2024-09-13T15:34:35.325671+0000","last_fullsized":"2024-09-13T15:34:35.325671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231838+0000","last_change":"2024-09-13T15:34:35.338609+0000","last_active":"2024-09-13T15:34:38.231838+0000","last_peered":"2024-09-13T15:34:38.231838+0000","last_clean":"2024-09-13T15:34:38.231838+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:34:38.231838+0000","last_undegraded":"2024-09-13T15:34:38.231838+0000","last_fullsized":"2024-09-13T15:34:38.231838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.337481+0000","last_change":"2024-09-13T15:34:34.956480+0000","last_active":"2024-09-13T15:34:35.337481+0000","last_peered":"2024-09-13T15:34:35.337481+0000","last_clean":"2024-09-13T15:34:35.337481+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:34:35.337481+0000","last_undegraded":"2024-09-13T15:34:35.337481+0000","last_fullsized":"2024-09-13T15:34:35.337481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.304145+0000","last_change":"2024-09-13T15:34:35.347478+0000","last_active":"2024-09-13T15:34:36.304145+0000","last_peered":"2024-09-13T15:34:36.304145+0000","last_clean":"2024-09-13T15:34:36.304145+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:34:36.304145+0000","last_undegraded":"2024-09-13T15:34:36.304145+0000","last_fullsized":"2024-09-13T15:34:36.304145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.481157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.344238+0000","last_change":"2024-09-13T15:34:34.936361+0000","last_active":"2024-09-13T15:34:35.344238+0000","last_peered":"2024-09-13T15:34:35.344238+0000","last_clean":"2024-09-13T15:34:35.344238+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:34:35.344238+0000","last_undegraded":"2024-09-13T15:34:35.344238+0000","last_fullsized":"2024-09-13T15:34:35.344238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302778+0000","last_change":"2024-09-13T15:34:35.330850+0000","last_active":"2024-09-13T15:34:36.302778+0000","last_peered":"2024-09-13T15:34:36.302778+0000","last_clean":"2024-09-13T15:34:36.302778+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:34:36.302778+0000","last_undegraded":"2024-09-13T15:34:36.302778+0000","last_fullsized":"2024-09-13T15:34:36.302778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:53.423967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.313024+0000","last_change":"2024-09-13T15:34:34.956621+0000","last_active":"2024-09-13T15:34:35.313024+0000","last_peered":"2024-09-13T15:34:35.313024+0000","last_clean":"2024-09-13T15:34:35.313024+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:34:35.313024+0000","last_undegraded":"2024-09-13T15:34:35.313024+0000","last_fullsized":"2024-09-13T15:34:35.313024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228749+0000","last_change":"2024-09-13T15:34:35.333828+0000","last_active":"2024-09-13T15:34:38.228749+0000","last_peered":"2024-09-13T15:34:38.228749+0000","last_clean":"2024-09-13T15:34:38.228749+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:34:38.228749+0000","last_undegraded":"2024-09-13T15:34:38.228749+0000","last_fullsized":"2024-09-13T15:34:38.228749+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.313295+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:34:35.313295+0000","last_peered":"2024-09-13T15:34:35.313295+0000","last_clean":"2024-09-13T15:34:35.313295+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:34:35.313295+0000","last_undegraded":"2024-09-13T15:34:35.313295+0000","last_fullsized":"2024-09-13T15:34:35.313295+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:42.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.320987+0000","last_change":"2024-09-13T15:34:34.939804+0000","last_active":"2024-09-13T15:34:35.320987+0000","last_peered":"2024-09-13T15:34:35.320987+0000","last_clean":"2024-09-13T15:34:35.320987+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:34:35.320987+0000","last_undegraded":"2024-09-13T15:34:35.320987+0000","last_fullsized":"2024-09-13T15:34:35.320987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227999+0000","last_change":"2024-09-13T15:34:35.339727+0000","last_active":"2024-09-13T15:34:38.227999+0000","last_peered":"2024-09-13T15:34:38.227999+0000","last_clean":"2024-09-13T15:34:38.227999+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:34:38.227999+0000","last_undegraded":"2024-09-13T15:34:38.227999+0000","last_fullsized":"2024-09-13T15:34:38.227999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.313404+0000","last_change":"2024-09-13T15:34:34.960919+0000","last_active":"2024-09-13T15:34:35.313404+0000","last_peered":"2024-09-13T15:34:35.313404+0000","last_clean":"2024-09-13T15:34:35.313404+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:34:35.313404+0000","last_undegraded":"2024-09-13T15:34:35.313404+0000","last_fullsized":"2024-09-13T15:34:35.313404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:47.211308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.301967+0000","last_change":"2024-09-13T15:34:35.324328+0000","last_active":"2024-09-13T15:34:36.301967+0000","last_peered":"2024-09-13T15:34:36.301967+0000","last_clean":"2024-09-13T15:34:36.301967+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:34:36.301967+0000","last_undegraded":"2024-09-13T15:34:36.301967+0000","last_fullsized":"2024-09-13T15:34:36.301967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.312893+0000","last_change":"2024-09-13T15:34:34.955761+0000","last_active":"2024-09-13T15:34:35.312893+0000","last_peered":"2024-09-13T15:34:35.312893+0000","last_clean":"2024-09-13T15:34:35.312893+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:34:35.312893+0000","last_undegraded":"2024-09-13T15:34:35.312893+0000","last_fullsized":"2024-09-13T15:34:35.312893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:37.814369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.226955+0000","last_change":"2024-09-13T15:34:35.336428+0000","last_active":"2024-09-13T15:34:38.226955+0000","last_peered":"2024-09-13T15:34:38.226955+0000","last_clean":"2024-09-13T15:34:38.226955+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:34:38.226955+0000","last_undegraded":"2024-09-13T15:34:38.226955+0000","last_fullsized":"2024-09-13T15:34:38.226955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.298341+0000","last_change":"2024-09-13T15:34:34.953984+0000","last_active":"2024-09-13T15:34:35.298341+0000","last_peered":"2024-09-13T15:34:35.298341+0000","last_clean":"2024-09-13T15:34:35.298341+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:34:35.298341+0000","last_undegraded":"2024-09-13T15:34:35.298341+0000","last_fullsized":"2024-09-13T15:34:35.298341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303234+0000","last_change":"2024-09-13T15:34:35.327755+0000","last_active":"2024-09-13T15:34:36.303234+0000","last_peered":"2024-09-13T15:34:36.303234+0000","last_clean":"2024-09-13T15:34:36.303234+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:34:36.303234+0000","last_undegraded":"2024-09-13T15:34:36.303234+0000","last_fullsized":"2024-09-13T15:34:36.303234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.321248+0000","last_change":"2024-09-13T15:34:34.946174+0000","last_active":"2024-09-13T15:34:35.321248+0000","last_peered":"2024-09-13T15:34:35.321248+0000","last_clean":"2024-09-13T15:34:35.321248+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:34:35.321248+0000","last_undegraded":"2024-09-13T15:34:35.321248+0000","last_fullsized":"2024-09-13T15:34:35.321248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231214+0000","last_change":"2024-09-13T15:34:35.335431+0000","last_active":"2024-09-13T15:34:38.231214+0000","last_peered":"2024-09-13T15:34:38.231214+0000","last_clean":"2024-09-13T15:34:38.231214+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:34:38.231214+0000","last_undegraded":"2024-09-13T15:34:38.231214+0000","last_fullsized":"2024-09-13T15:34:38.231214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:24.940353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.324841+0000","last_change":"2024-09-13T15:34:34.949805+0000","last_active":"2024-09-13T15:34:35.324841+0000","last_peered":"2024-09-13T15:34:35.324841+0000","last_clean":"2024-09-13T15:34:35.324841+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:34:35.324841+0000","last_undegraded":"2024-09-13T15:34:35.324841+0000","last_fullsized":"2024-09-13T15:34:35.324841+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228884+0000","last_change":"2024-09-13T15:34:35.339676+0000","last_active":"2024-09-13T15:34:38.228884+0000","last_peered":"2024-09-13T15:34:38.228884+0000","last_clean":"2024-09-13T15:34:38.228884+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:34:38.228884+0000","last_undegraded":"2024-09-13T15:34:38.228884+0000","last_fullsized":"2024-09-13T15:34:38.228884+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228228+0000","last_change":"2024-09-13T15:34:34.942452+0000","last_active":"2024-09-13T15:34:38.228228+0000","last_peered":"2024-09-13T15:34:38.228228+0000","last_clean":"2024-09-13T15:34:38.228228+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:34:38.228228+0000","last_undegraded":"2024-09-13T15:34:38.228228+0000","last_fullsized":"2024-09-13T15:34:38.228228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231446+0000","last_change":"2024-09-13T15:34:35.337361+0000","last_active":"2024-09-13T15:34:38.231446+0000","last_peered":"2024-09-13T15:34:38.231446+0000","last_clean":"2024-09-13T15:34:38.231446+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:34:38.231446+0000","last_undegraded":"2024-09-13T15:34:38.231446+0000","last_fullsized":"2024-09-13T15:34:38.231446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:27.081960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.351197+0000","last_change":"2024-09-13T15:34:34.946540+0000","last_active":"2024-09-13T15:34:35.351197+0000","last_peered":"2024-09-13T15:34:35.351197+0000","last_clean":"2024-09-13T15:34:35.351197+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:34:35.351197+0000","last_undegraded":"2024-09-13T15:34:35.351197+0000","last_fullsized":"2024-09-13T15:34:35.351197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303231+0000","last_change":"2024-09-13T15:34:35.334433+0000","last_active":"2024-09-13T15:34:36.303231+0000","last_peered":"2024-09-13T15:34:36.303231+0000","last_clean":"2024-09-13T15:34:36.303231+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:34:36.303231+0000","last_undegraded":"2024-09-13T15:34:36.303231+0000","last_fullsized":"2024-09-13T15:34:36.303231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:34.847820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.297705+0000","last_change":"2024-09-13T15:34:34.941308+0000","last_active":"2024-09-13T15:34:35.297705+0000","last_peered":"2024-09-13T15:34:35.297705+0000","last_clean":"2024-09-13T15:34:35.297705+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:34:35.297705+0000","last_undegraded":"2024-09-13T15:34:35.297705+0000","last_fullsized":"2024-09-13T15:34:35.297705+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.301976+0000","last_change":"2024-09-13T15:34:35.327260+0000","last_active":"2024-09-13T15:34:36.301976+0000","last_peered":"2024-09-13T15:34:36.301976+0000","last_clean":"2024-09-13T15:34:36.301976+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:34:36.301976+0000","last_undegraded":"2024-09-13T15:34:36.301976+0000","last_fullsized":"2024-09-13T15:34:36.301976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.318252+0000","last_change":"2024-09-13T15:34:34.943197+0000","last_active":"2024-09-13T15:34:35.318252+0000","last_peered":"2024-09-13T15:34:35.318252+0000","last_clean":"2024-09-13T15:34:35.318252+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:34:35.318252+0000","last_undegraded":"2024-09-13T15:34:35.318252+0000","last_fullsized":"2024-09-13T15:34:35.318252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229906+0000","last_change":"2024-09-13T15:34:35.340037+0000","last_active":"2024-09-13T15:34:38.229906+0000","last_peered":"2024-09-13T15:34:38.229906+0000","last_clean":"2024-09-13T15:34:38.229906+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:34:38.229906+0000","last_undegraded":"2024-09-13T15:34:38.229906+0000","last_fullsized":"2024-09-13T15:34:38.229906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.320969+0000","last_change":"2024-09-13T15:34:34.943732+0000","last_active":"2024-09-13T15:34:35.320969+0000","last_peered":"2024-09-13T15:34:35.320969+0000","last_clean":"2024-09-13T15:34:35.320969+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:34:35.320969+0000","last_undegraded":"2024-09-13T15:34:35.320969+0000","last_fullsized":"2024-09-13T15:34:35.320969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227681+0000","last_change":"2024-09-13T15:34:35.339704+0000","last_active":"2024-09-13T15:34:38.227681+0000","last_peered":"2024-09-13T15:34:38.227681+0000","last_clean":"2024-09-13T15:34:38.227681+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:34:38.227681+0000","last_undegraded":"2024-09-13T15:34:38.227681+0000","last_fullsized":"2024-09-13T15:34:38.227681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.310249+0000","last_change":"2024-09-13T15:34:34.943033+0000","last_active":"2024-09-13T15:34:35.310249+0000","last_peered":"2024-09-13T15:34:35.310249+0000","last_clean":"2024-09-13T15:34:35.310249+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:34:35.310249+0000","last_undegraded":"2024-09-13T15:34:35.310249+0000","last_fullsized":"2024-09-13T15:34:35.310249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302764+0000","last_change":"2024-09-13T15:34:35.334308+0000","last_active":"2024-09-13T15:34:36.302764+0000","last_peered":"2024-09-13T15:34:36.302764+0000","last_clean":"2024-09-13T15:34:36.302764+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:34:36.302764+0000","last_undegraded":"2024-09-13T15:34:36.302764+0000","last_fullsized":"2024-09-13T15:34:36.302764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:50.918862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231259+0000","last_change":"2024-09-13T15:34:35.329220+0000","last_active":"2024-09-13T15:34:38.231259+0000","last_peered":"2024-09-13T15:34:38.231259+0000","last_clean":"2024-09-13T15:34:38.231259+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:34:38.231259+0000","last_undegraded":"2024-09-13T15:34:38.231259+0000","last_fullsized":"2024-09-13T15:34:38.231259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.314859+0000","last_change":"2024-09-13T15:34:34.954062+0000","last_active":"2024-09-13T15:34:35.314859+0000","last_peered":"2024-09-13T15:34:35.314859+0000","last_clean":"2024-09-13T15:34:35.314859+0000","last_became_active":"2024-09-13T15:34:34.951645+0000","last_became_peered":"2024-09-13T15:34:34.951645+0000","last_unstale":"2024-09-13T15:34:35.314859+0000","last_undegraded":"2024-09-13T15:34:35.314859+0000","last_fullsized":"2024-09-13T15:34:35.314859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228392+0000","last_change":"2024-09-13T15:34:35.333710+0000","last_active":"2024-09-13T15:34:38.228392+0000","last_peered":"2024-09-13T15:34:38.228392+0000","last_clean":"2024-09-13T15:34:38.228392+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:34:38.228392+0000","last_undegraded":"2024-09-13T15:34:38.228392+0000","last_fullsized":"2024-09-13T15:34:38.228392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.317334+0000","last_change":"2024-09-13T15:34:34.950125+0000","last_active":"2024-09-13T15:34:35.317334+0000","last_peered":"2024-09-13T15:34:35.317334+0000","last_clean":"2024-09-13T15:34:35.317334+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:34:35.317334+0000","last_undegraded":"2024-09-13T15:34:35.317334+0000","last_fullsized":"2024-09-13T15:34:35.317334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302974+0000","last_change":"2024-09-13T15:34:35.350474+0000","last_active":"2024-09-13T15:34:36.302974+0000","last_peered":"2024-09-13T15:34:36.302974+0000","last_clean":"2024-09-13T15:34:36.302974+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:34:36.302974+0000","last_undegraded":"2024-09-13T15:34:36.302974+0000","last_fullsized":"2024-09-13T15:34:36.302974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:08:45.573183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.331405+0000","last_change":"2024-09-13T15:34:34.955842+0000","last_active":"2024-09-13T15:34:35.331405+0000","last_peered":"2024-09-13T15:34:35.331405+0000","last_clean":"2024-09-13T15:34:35.331405+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:34:35.331405+0000","last_undegraded":"2024-09-13T15:34:35.331405+0000","last_fullsized":"2024-09-13T15:34:35.331405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231610+0000","last_change":"2024-09-13T15:34:35.338454+0000","last_active":"2024-09-13T15:34:38.231610+0000","last_peered":"2024-09-13T15:34:38.231610+0000","last_clean":"2024-09-13T15:34:38.231610+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:34:38.231610+0000","last_undegraded":"2024-09-13T15:34:38.231610+0000","last_fullsized":"2024-09-13T15:34:38.231610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:49.904225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"15'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.331443+0000","last_change":"2024-09-13T15:34:34.960705+0000","last_active":"2024-09-13T15:34:35.331443+0000","last_peered":"2024-09-13T15:34:35.331443+0000","last_clean":"2024-09-13T15:34:35.331443+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:34:35.331443+0000","last_undegraded":"2024-09-13T15:34:35.331443+0000","last_fullsized":"2024-09-13T15:34:35.331443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":44402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":635430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":633830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:34:48.772 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:34:48.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.927+0000 7f3cffb1d640 1 Processor -- start 2024-09-13T15:34:48.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.927+0000 7f3cffb1d640 1 -- start start 2024-09-13T15:34:48.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.931+0000 7f3cffb1d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3cf814f3d0 0x7f3cf80b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.931+0000 7f3cffb1d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf80b48d0 con 0x7f3cf806f400 2024-09-13T15:34:48.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.931+0000 7f3cffb1d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf80b5240 con 0x7f3cf814f3d0 2024-09-13T15:34:48.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.931+0000 7f3cfd8b9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3cf814f3d0 0x7f3cf80b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.931+0000 7f3cfd8b9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3cf814f3d0 0x7f3cf80b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47584/0 (socket says 172.21.15.40:47584) 2024-09-13T15:34:48.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.931+0000 7f3cfd8b9640 1 -- 172.21.15.40:0/2294032766 learned_addr learned my addr 172.21.15.40:0/2294032766 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:48.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.931+0000 7f3cfd8b9640 1 -- 172.21.15.40:0/2294032766 >> v1:172.21.15.40:6789/0 conn(0x7f3cf806f400 legacy=0x7f3cf806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.931+0000 7f3cfd8b9640 1 -- 172.21.15.40:0/2294032766 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf814e7b0 con 0x7f3cf814f3d0 2024-09-13T15:34:48.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.931+0000 7f3cfd8b9640 1 --2- 172.21.15.40:0/2294032766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf814f3d0 0x7f3cf80b4d00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400a990 tx=0x7f3cf401d820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957557693fa8a5d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.931+0000 7f3cfc8b7640 1 -- 172.21.15.40:0/2294032766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cf40a66b0 con 0x7f3cf814f3d0 2024-09-13T15:34:48.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.931+0000 7f3cfc8b7640 1 -- 172.21.15.40:0/2294032766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf40a6810 con 0x7f3cf814f3d0 2024-09-13T15:34:48.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.931+0000 7f3cfc8b7640 1 -- 172.21.15.40:0/2294032766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cf40a6ad0 con 0x7f3cf814f3d0 2024-09-13T15:34:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 -- 172.21.15.40:0/2294032766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf814f3d0 msgr2=0x7f3cf80b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 --2- 172.21.15.40:0/2294032766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf814f3d0 0x7f3cf80b4d00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400a990 tx=0x7f3cf401d820 comp rx=0 tx=0).stop 2024-09-13T15:34:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 -- 172.21.15.40:0/2294032766 shutdown_connections 2024-09-13T15:34:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 --2- 172.21.15.40:0/2294032766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf814f3d0 0x7f3cf80b4d00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 -- 172.21.15.40:0/2294032766 >> 172.21.15.40:0/2294032766 conn(0x7f3cf806a540 msgr2=0x7f3cf80a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 -- 172.21.15.40:0/2294032766 shutdown_connections 2024-09-13T15:34:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 -- 172.21.15.40:0/2294032766 wait complete. 2024-09-13T15:34:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 Processor -- start 2024-09-13T15:34:48.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 -- start start 2024-09-13T15:34:48.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf806f400 0x7f3cf8148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf8148790 con 0x7f3cf806f400 2024-09-13T15:34:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cfd8b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf806f400 0x7f3cf8148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cfd8b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf806f400 0x7f3cf8148250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47600/0 (socket says 172.21.15.40:47600) 2024-09-13T15:34:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cfd8b9640 1 -- 172.21.15.40:0/4273827502 learned_addr learned my addr 172.21.15.40:0/4273827502 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cfd8b9640 1 -- 172.21.15.40:0/4273827502 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf400a670 con 0x7f3cf806f400 2024-09-13T15:34:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cfd8b9640 1 --2- 172.21.15.40:0/4273827502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf806f400 0x7f3cf8148250 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3cf401a430 tx=0x7f3cf401c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cee7fc640 1 -- 172.21.15.40:0/4273827502 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cf40b9790 con 0x7f3cf806f400 2024-09-13T15:34:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cee7fc640 1 -- 172.21.15.40:0/4273827502 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf40b98f0 con 0x7f3cf806f400 2024-09-13T15:34:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 -- 172.21.15.40:0/4273827502 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf80bc210 con 0x7f3cf806f400 2024-09-13T15:34:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cee7fc640 1 -- 172.21.15.40:0/4273827502 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cf40b9bb0 con 0x7f3cf806f400 2024-09-13T15:34:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cffb1d640 1 -- 172.21.15.40:0/4273827502 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf8159880 con 0x7f3cf806f400 2024-09-13T15:34:48.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.935+0000 7f3cee7fc640 1 -- 172.21.15.40:0/4273827502 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f3cf40b5070 con 0x7f3cf806f400 2024-09-13T15:34:48.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.939+0000 7f3cffb1d640 1 -- 172.21.15.40:0/4273827502 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf80b4d00 con 0x7f3cf806f400 2024-09-13T15:34:48.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.939+0000 7f3cee7fc640 1 --2- 172.21.15.40:0/4273827502 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3cdc035450 0x7f3cdc037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:48.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.939+0000 7f3cee7fc640 1 -- 172.21.15.40:0/4273827502 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f3cf40e2430 con 0x7f3cf806f400 2024-09-13T15:34:48.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.939+0000 7f3cfd0b8640 1 --2- 172.21.15.40:0/4273827502 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3cdc035450 0x7f3cdc037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:48.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.939+0000 7f3cfd0b8640 1 --2- 172.21.15.40:0/4273827502 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3cdc035450 0x7f3cdc037910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8000f70 tx=0x7f3ce8007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:48.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:48.943+0000 7f3cee7fc640 1 -- 172.21.15.40:0/4273827502 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3cf40b6bd0 con 0x7f3cf806f400 2024-09-13T15:34:49.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.099+0000 7f3cffb1d640 1 -- 172.21.15.40:0/4273827502 --> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cf815d730 con 0x7f3cdc035450 2024-09-13T15:34:49.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.115+0000 7f3cee7fc640 1 -- 172.21.15.40:0/4273827502 <== mgr.4099 v2:172.21.15.40:6824/3185150828 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247299 (secure 0 0 0) 0x7f3cf815d730 con 0x7f3cdc035450 2024-09-13T15:34:49.121 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:49.123 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:34:49.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.119+0000 7f3cffb1d640 1 -- 172.21.15.40:0/4273827502 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3cdc035450 msgr2=0x7f3cdc037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.119+0000 7f3cffb1d640 1 --2- 172.21.15.40:0/4273827502 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3cdc035450 0x7f3cdc037910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8000f70 tx=0x7f3ce8007a40 comp rx=0 tx=0).stop 2024-09-13T15:34:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.119+0000 7f3cffb1d640 1 -- 172.21.15.40:0/4273827502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf806f400 msgr2=0x7f3cf8148250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.119+0000 7f3cffb1d640 1 --2- 172.21.15.40:0/4273827502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf806f400 0x7f3cf8148250 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3cf401a430 tx=0x7f3cf401c060 comp rx=0 tx=0).stop 2024-09-13T15:34:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.119+0000 7f3cffb1d640 1 -- 172.21.15.40:0/4273827502 shutdown_connections 2024-09-13T15:34:49.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.119+0000 7f3cffb1d640 1 --2- 172.21.15.40:0/4273827502 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3cdc035450 0x7f3cdc037910 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.119+0000 7f3cffb1d640 1 --2- 172.21.15.40:0/4273827502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cf806f400 0x7f3cf8148250 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.119+0000 7f3cffb1d640 1 -- 172.21.15.40:0/4273827502 >> 172.21.15.40:0/4273827502 conn(0x7f3cf806a540 msgr2=0x7f3cf814a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.119+0000 7f3cffb1d640 1 -- 172.21.15.40:0/4273827502 shutdown_connections 2024-09-13T15:34:49.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.119+0000 7f3cffb1d640 1 -- 172.21.15.40:0/4273827502 wait complete. 2024-09-13T15:34:49.141 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-13T15:34:49.060740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":182,"num_write_kb":1908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":82700,"kb_used_data":1632,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283032820,"statfs":{"total":289910292480,"available":289825607680,"internally_reserved":0,"allocated":1671168,"data_stored":1313662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003697"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302505+0000","last_change":"2024-09-13T15:34:35.347293+0000","last_active":"2024-09-13T15:34:36.302505+0000","last_peered":"2024-09-13T15:34:36.302505+0000","last_clean":"2024-09-13T15:34:36.302505+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:34:36.302505+0000","last_undegraded":"2024-09-13T15:34:36.302505+0000","last_fullsized":"2024-09-13T15:34:36.302505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:52.388403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227786+0000","last_change":"2024-09-13T15:34:35.329279+0000","last_active":"2024-09-13T15:34:38.227786+0000","last_peered":"2024-09-13T15:34:38.227786+0000","last_clean":"2024-09-13T15:34:38.227786+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:34:38.227786+0000","last_undegraded":"2024-09-13T15:34:38.227786+0000","last_fullsized":"2024-09-13T15:34:38.227786+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303160+0000","last_change":"2024-09-13T15:34:35.324580+0000","last_active":"2024-09-13T15:34:36.303160+0000","last_peered":"2024-09-13T15:34:36.303160+0000","last_clean":"2024-09-13T15:34:36.303160+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:34:36.303160+0000","last_undegraded":"2024-09-13T15:34:36.303160+0000","last_fullsized":"2024-09-13T15:34:36.303160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:08.082085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.230674+0000","last_change":"2024-09-13T15:34:35.330864+0000","last_active":"2024-09-13T15:34:38.230674+0000","last_peered":"2024-09-13T15:34:38.230674+0000","last_clean":"2024-09-13T15:34:38.230674+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:34:38.230674+0000","last_undegraded":"2024-09-13T15:34:38.230674+0000","last_fullsized":"2024-09-13T15:34:38.230674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303451+0000","last_change":"2024-09-13T15:34:35.327922+0000","last_active":"2024-09-13T15:34:36.303451+0000","last_peered":"2024-09-13T15:34:36.303451+0000","last_clean":"2024-09-13T15:34:36.303451+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:34:36.303451+0000","last_undegraded":"2024-09-13T15:34:36.303451+0000","last_fullsized":"2024-09-13T15:34:36.303451+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:22.066293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.230856+0000","last_change":"2024-09-13T15:34:35.329319+0000","last_active":"2024-09-13T15:34:38.230856+0000","last_peered":"2024-09-13T15:34:38.230856+0000","last_clean":"2024-09-13T15:34:38.230856+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:34:38.230856+0000","last_undegraded":"2024-09-13T15:34:38.230856+0000","last_fullsized":"2024-09-13T15:34:38.230856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303392+0000","last_change":"2024-09-13T15:34:35.334719+0000","last_active":"2024-09-13T15:34:36.303392+0000","last_peered":"2024-09-13T15:34:36.303392+0000","last_clean":"2024-09-13T15:34:36.303392+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:34:36.303392+0000","last_undegraded":"2024-09-13T15:34:36.303392+0000","last_fullsized":"2024-09-13T15:34:36.303392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:14.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228428+0000","last_change":"2024-09-13T15:34:35.335400+0000","last_active":"2024-09-13T15:34:38.228428+0000","last_peered":"2024-09-13T15:34:38.228428+0000","last_clean":"2024-09-13T15:34:38.228428+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:34:38.228428+0000","last_undegraded":"2024-09-13T15:34:38.228428+0000","last_fullsized":"2024-09-13T15:34:38.228428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229045+0000","last_change":"2024-09-13T15:34:35.345251+0000","last_active":"2024-09-13T15:34:38.229045+0000","last_peered":"2024-09-13T15:34:38.229045+0000","last_clean":"2024-09-13T15:34:38.229045+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:34:38.229045+0000","last_undegraded":"2024-09-13T15:34:38.229045+0000","last_fullsized":"2024-09-13T15:34:38.229045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303230+0000","last_change":"2024-09-13T15:34:35.319299+0000","last_active":"2024-09-13T15:34:36.303230+0000","last_peered":"2024-09-13T15:34:36.303230+0000","last_clean":"2024-09-13T15:34:36.303230+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:34:36.303230+0000","last_undegraded":"2024-09-13T15:34:36.303230+0000","last_fullsized":"2024-09-13T15:34:36.303230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:16.700428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302978+0000","last_change":"2024-09-13T15:34:35.331709+0000","last_active":"2024-09-13T15:34:36.302978+0000","last_peered":"2024-09-13T15:34:36.302978+0000","last_clean":"2024-09-13T15:34:36.302978+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:34:36.302978+0000","last_undegraded":"2024-09-13T15:34:36.302978+0000","last_fullsized":"2024-09-13T15:34:36.302978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:17.069173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302586+0000","last_change":"2024-09-13T15:34:35.330875+0000","last_active":"2024-09-13T15:34:36.302586+0000","last_peered":"2024-09-13T15:34:36.302586+0000","last_clean":"2024-09-13T15:34:36.302586+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:34:36.302586+0000","last_undegraded":"2024-09-13T15:34:36.302586+0000","last_fullsized":"2024-09-13T15:34:36.302586+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:22.297990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303695+0000","last_change":"2024-09-13T15:34:35.335252+0000","last_active":"2024-09-13T15:34:36.303695+0000","last_peered":"2024-09-13T15:34:36.303695+0000","last_clean":"2024-09-13T15:34:36.303695+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:34:36.303695+0000","last_undegraded":"2024-09-13T15:34:36.303695+0000","last_fullsized":"2024-09-13T15:34:36.303695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:37.432254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302324+0000","last_change":"2024-09-13T15:34:35.335599+0000","last_active":"2024-09-13T15:34:36.302324+0000","last_peered":"2024-09-13T15:34:36.302324+0000","last_clean":"2024-09-13T15:34:36.302324+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:34:36.302324+0000","last_undegraded":"2024-09-13T15:34:36.302324+0000","last_fullsized":"2024-09-13T15:34:36.302324+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:06.605564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228614+0000","last_change":"2024-09-13T15:34:35.333765+0000","last_active":"2024-09-13T15:34:38.228614+0000","last_peered":"2024-09-13T15:34:38.228614+0000","last_clean":"2024-09-13T15:34:38.228614+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:34:38.228614+0000","last_undegraded":"2024-09-13T15:34:38.228614+0000","last_fullsized":"2024-09-13T15:34:38.228614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229241+0000","last_change":"2024-09-13T15:34:35.331848+0000","last_active":"2024-09-13T15:34:38.229241+0000","last_peered":"2024-09-13T15:34:38.229241+0000","last_clean":"2024-09-13T15:34:38.229241+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:34:38.229241+0000","last_undegraded":"2024-09-13T15:34:38.229241+0000","last_fullsized":"2024-09-13T15:34:38.229241+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229727+0000","last_change":"2024-09-13T15:34:35.333522+0000","last_active":"2024-09-13T15:34:38.229727+0000","last_peered":"2024-09-13T15:34:38.229727+0000","last_clean":"2024-09-13T15:34:38.229727+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:34:38.229727+0000","last_undegraded":"2024-09-13T15:34:38.229727+0000","last_fullsized":"2024-09-13T15:34:38.229727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231318+0000","last_change":"2024-09-13T15:34:35.335384+0000","last_active":"2024-09-13T15:34:38.231318+0000","last_peered":"2024-09-13T15:34:38.231318+0000","last_clean":"2024-09-13T15:34:38.231318+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:34:38.231318+0000","last_undegraded":"2024-09-13T15:34:38.231318+0000","last_fullsized":"2024-09-13T15:34:38.231318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303390+0000","last_change":"2024-09-13T15:34:35.324912+0000","last_active":"2024-09-13T15:34:36.303390+0000","last_peered":"2024-09-13T15:34:36.303390+0000","last_clean":"2024-09-13T15:34:36.303390+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:34:36.303390+0000","last_undegraded":"2024-09-13T15:34:36.303390+0000","last_fullsized":"2024-09-13T15:34:36.303390+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302638+0000","last_change":"2024-09-13T15:34:35.346893+0000","last_active":"2024-09-13T15:34:36.302638+0000","last_peered":"2024-09-13T15:34:36.302638+0000","last_clean":"2024-09-13T15:34:36.302638+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:34:36.302638+0000","last_undegraded":"2024-09-13T15:34:36.302638+0000","last_fullsized":"2024-09-13T15:34:36.302638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:52.439034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303077+0000","last_change":"2024-09-13T15:34:35.325306+0000","last_active":"2024-09-13T15:34:36.303077+0000","last_peered":"2024-09-13T15:34:36.303077+0000","last_clean":"2024-09-13T15:34:36.303077+0000","last_became_active":"2024-09-13T15:34:35.322050+0000","last_became_peered":"2024-09-13T15:34:35.322050+0000","last_unstale":"2024-09-13T15:34:36.303077+0000","last_undegraded":"2024-09-13T15:34:36.303077+0000","last_fullsized":"2024-09-13T15:34:36.303077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:27.724097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227661+0000","last_change":"2024-09-13T15:34:35.329712+0000","last_active":"2024-09-13T15:34:38.227661+0000","last_peered":"2024-09-13T15:34:38.227661+0000","last_clean":"2024-09-13T15:34:38.227661+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:34:38.227661+0000","last_undegraded":"2024-09-13T15:34:38.227661+0000","last_fullsized":"2024-09-13T15:34:38.227661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.301852+0000","last_change":"2024-09-13T15:34:35.324523+0000","last_active":"2024-09-13T15:34:36.301852+0000","last_peered":"2024-09-13T15:34:36.301852+0000","last_clean":"2024-09-13T15:34:36.301852+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:34:36.301852+0000","last_undegraded":"2024-09-13T15:34:36.301852+0000","last_fullsized":"2024-09-13T15:34:36.301852+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.301945+0000","last_change":"2024-09-13T15:34:35.327879+0000","last_active":"2024-09-13T15:34:36.301945+0000","last_peered":"2024-09-13T15:34:36.301945+0000","last_clean":"2024-09-13T15:34:36.301945+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:34:36.301945+0000","last_undegraded":"2024-09-13T15:34:36.301945+0000","last_fullsized":"2024-09-13T15:34:36.301945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231266+0000","last_change":"2024-09-13T15:34:35.336949+0000","last_active":"2024-09-13T15:34:38.231266+0000","last_peered":"2024-09-13T15:34:38.231266+0000","last_clean":"2024-09-13T15:34:38.231266+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:34:38.231266+0000","last_undegraded":"2024-09-13T15:34:38.231266+0000","last_fullsized":"2024-09-13T15:34:38.231266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:45.530761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231406+0000","last_change":"2024-09-13T15:34:35.335209+0000","last_active":"2024-09-13T15:34:38.231406+0000","last_peered":"2024-09-13T15:34:38.231406+0000","last_clean":"2024-09-13T15:34:38.231406+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:34:38.231406+0000","last_undegraded":"2024-09-13T15:34:38.231406+0000","last_fullsized":"2024-09-13T15:34:38.231406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228671+0000","last_change":"2024-09-13T15:34:35.339305+0000","last_active":"2024-09-13T15:34:38.228671+0000","last_peered":"2024-09-13T15:34:38.228671+0000","last_clean":"2024-09-13T15:34:38.228671+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:34:38.228671+0000","last_undegraded":"2024-09-13T15:34:38.228671+0000","last_fullsized":"2024-09-13T15:34:38.228671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302727+0000","last_change":"2024-09-13T15:34:35.328129+0000","last_active":"2024-09-13T15:34:36.302727+0000","last_peered":"2024-09-13T15:34:36.302727+0000","last_clean":"2024-09-13T15:34:36.302727+0000","last_became_active":"2024-09-13T15:34:35.327356+0000","last_became_peered":"2024-09-13T15:34:35.327356+0000","last_unstale":"2024-09-13T15:34:36.302727+0000","last_undegraded":"2024-09-13T15:34:36.302727+0000","last_fullsized":"2024-09-13T15:34:36.302727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:30:19.369318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302983+0000","last_change":"2024-09-13T15:34:35.331611+0000","last_active":"2024-09-13T15:34:36.302983+0000","last_peered":"2024-09-13T15:34:36.302983+0000","last_clean":"2024-09-13T15:34:36.302983+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:34:36.302983+0000","last_undegraded":"2024-09-13T15:34:36.302983+0000","last_fullsized":"2024-09-13T15:34:36.302983+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:08.881292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302465+0000","last_change":"2024-09-13T15:34:35.324690+0000","last_active":"2024-09-13T15:34:36.302465+0000","last_peered":"2024-09-13T15:34:36.302465+0000","last_clean":"2024-09-13T15:34:36.302465+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:34:36.302465+0000","last_undegraded":"2024-09-13T15:34:36.302465+0000","last_fullsized":"2024-09-13T15:34:36.302465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.230387+0000","last_change":"2024-09-13T15:34:35.335517+0000","last_active":"2024-09-13T15:34:38.230387+0000","last_peered":"2024-09-13T15:34:38.230387+0000","last_clean":"2024-09-13T15:34:38.230387+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:34:38.230387+0000","last_undegraded":"2024-09-13T15:34:38.230387+0000","last_fullsized":"2024-09-13T15:34:38.230387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:58.399592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229648+0000","last_change":"2024-09-13T15:34:35.331904+0000","last_active":"2024-09-13T15:34:38.229648+0000","last_peered":"2024-09-13T15:34:38.229648+0000","last_clean":"2024-09-13T15:34:38.229648+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:34:38.229648+0000","last_undegraded":"2024-09-13T15:34:38.229648+0000","last_fullsized":"2024-09-13T15:34:38.229648+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227945+0000","last_change":"2024-09-13T15:34:35.343571+0000","last_active":"2024-09-13T15:34:38.227945+0000","last_peered":"2024-09-13T15:34:38.227945+0000","last_clean":"2024-09-13T15:34:38.227945+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:34:38.227945+0000","last_undegraded":"2024-09-13T15:34:38.227945+0000","last_fullsized":"2024-09-13T15:34:38.227945+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.342554+0000","last_change":"2024-09-13T15:34:34.944458+0000","last_active":"2024-09-13T15:34:35.342554+0000","last_peered":"2024-09-13T15:34:35.342554+0000","last_clean":"2024-09-13T15:34:35.342554+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:34:35.342554+0000","last_undegraded":"2024-09-13T15:34:35.342554+0000","last_fullsized":"2024-09-13T15:34:35.342554+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303083+0000","last_change":"2024-09-13T15:34:35.331843+0000","last_active":"2024-09-13T15:34:36.303083+0000","last_peered":"2024-09-13T15:34:36.303083+0000","last_clean":"2024-09-13T15:34:36.303083+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:34:36.303083+0000","last_undegraded":"2024-09-13T15:34:36.303083+0000","last_fullsized":"2024-09-13T15:34:36.303083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:43.103418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.328697+0000","last_change":"2024-09-13T15:34:34.957379+0000","last_active":"2024-09-13T15:34:35.328697+0000","last_peered":"2024-09-13T15:34:35.328697+0000","last_clean":"2024-09-13T15:34:35.328697+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:34:35.328697+0000","last_undegraded":"2024-09-13T15:34:35.328697+0000","last_fullsized":"2024-09-13T15:34:35.328697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.300958+0000","last_change":"2024-09-13T15:34:34.954475+0000","last_active":"2024-09-13T15:34:35.300958+0000","last_peered":"2024-09-13T15:34:35.300958+0000","last_clean":"2024-09-13T15:34:35.300958+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:34:35.300958+0000","last_undegraded":"2024-09-13T15:34:35.300958+0000","last_fullsized":"2024-09-13T15:34:35.300958+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229772+0000","last_change":"2024-09-13T15:34:35.340304+0000","last_active":"2024-09-13T15:34:38.229772+0000","last_peered":"2024-09-13T15:34:38.229772+0000","last_clean":"2024-09-13T15:34:38.229772+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:34:38.229772+0000","last_undegraded":"2024-09-13T15:34:38.229772+0000","last_fullsized":"2024-09-13T15:34:38.229772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.297580+0000","last_change":"2024-09-13T15:34:34.950709+0000","last_active":"2024-09-13T15:34:35.297580+0000","last_peered":"2024-09-13T15:34:35.297580+0000","last_clean":"2024-09-13T15:34:35.297580+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:34:35.297580+0000","last_undegraded":"2024-09-13T15:34:35.297580+0000","last_fullsized":"2024-09-13T15:34:35.297580+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227382+0000","last_change":"2024-09-13T15:34:35.335773+0000","last_active":"2024-09-13T15:34:38.227382+0000","last_peered":"2024-09-13T15:34:38.227382+0000","last_clean":"2024-09-13T15:34:38.227382+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:34:38.227382+0000","last_undegraded":"2024-09-13T15:34:38.227382+0000","last_fullsized":"2024-09-13T15:34:38.227382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.330447+0000","last_change":"2024-09-13T15:34:34.939305+0000","last_active":"2024-09-13T15:34:35.330447+0000","last_peered":"2024-09-13T15:34:35.330447+0000","last_clean":"2024-09-13T15:34:35.330447+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:34:35.330447+0000","last_undegraded":"2024-09-13T15:34:35.330447+0000","last_fullsized":"2024-09-13T15:34:35.330447+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231671+0000","last_change":"2024-09-13T15:34:35.338289+0000","last_active":"2024-09-13T15:34:38.231671+0000","last_peered":"2024-09-13T15:34:38.231671+0000","last_clean":"2024-09-13T15:34:38.231671+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:34:38.231671+0000","last_undegraded":"2024-09-13T15:34:38.231671+0000","last_fullsized":"2024-09-13T15:34:38.231671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:34.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.300585+0000","last_change":"2024-09-13T15:34:34.953625+0000","last_active":"2024-09-13T15:34:35.300585+0000","last_peered":"2024-09-13T15:34:35.300585+0000","last_clean":"2024-09-13T15:34:35.300585+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:34:35.300585+0000","last_undegraded":"2024-09-13T15:34:35.300585+0000","last_fullsized":"2024-09-13T15:34:35.300585+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303221+0000","last_change":"2024-09-13T15:34:35.347690+0000","last_active":"2024-09-13T15:34:36.303221+0000","last_peered":"2024-09-13T15:34:36.303221+0000","last_clean":"2024-09-13T15:34:36.303221+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:34:36.303221+0000","last_undegraded":"2024-09-13T15:34:36.303221+0000","last_fullsized":"2024-09-13T15:34:36.303221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:53.778485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":14,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.350982+0000","last_change":"2024-09-13T15:34:34.949988+0000","last_active":"2024-09-13T15:34:35.350982+0000","last_peered":"2024-09-13T15:34:35.350982+0000","last_clean":"2024-09-13T15:34:35.350982+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:34:35.350982+0000","last_undegraded":"2024-09-13T15:34:35.350982+0000","last_fullsized":"2024-09-13T15:34:35.350982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228648+0000","last_change":"2024-09-13T15:34:35.341547+0000","last_active":"2024-09-13T15:34:38.228648+0000","last_peered":"2024-09-13T15:34:38.228648+0000","last_clean":"2024-09-13T15:34:38.228648+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:34:38.228648+0000","last_undegraded":"2024-09-13T15:34:38.228648+0000","last_fullsized":"2024-09-13T15:34:38.228648+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"15'6","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.350263+0000","last_change":"2024-09-13T15:34:34.955883+0000","last_active":"2024-09-13T15:34:35.350263+0000","last_peered":"2024-09-13T15:34:35.350263+0000","last_clean":"2024-09-13T15:34:35.350263+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:34:35.350263+0000","last_undegraded":"2024-09-13T15:34:35.350263+0000","last_fullsized":"2024-09-13T15:34:35.350263+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303048+0000","last_change":"2024-09-13T15:34:35.345452+0000","last_active":"2024-09-13T15:34:36.303048+0000","last_peered":"2024-09-13T15:34:36.303048+0000","last_clean":"2024-09-13T15:34:36.303048+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:34:36.303048+0000","last_undegraded":"2024-09-13T15:34:36.303048+0000","last_fullsized":"2024-09-13T15:34:36.303048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:08:25.983299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.310170+0000","last_change":"2024-09-13T15:34:34.942058+0000","last_active":"2024-09-13T15:34:35.310170+0000","last_peered":"2024-09-13T15:34:35.310170+0000","last_clean":"2024-09-13T15:34:35.310170+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:34:35.310170+0000","last_undegraded":"2024-09-13T15:34:35.310170+0000","last_fullsized":"2024-09-13T15:34:35.310170+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302628+0000","last_change":"2024-09-13T15:34:35.334637+0000","last_active":"2024-09-13T15:34:36.302628+0000","last_peered":"2024-09-13T15:34:36.302628+0000","last_clean":"2024-09-13T15:34:36.302628+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:34:36.302628+0000","last_undegraded":"2024-09-13T15:34:36.302628+0000","last_fullsized":"2024-09-13T15:34:36.302628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:43.466895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.309490+0000","last_change":"2024-09-13T15:34:34.957763+0000","last_active":"2024-09-13T15:34:35.309490+0000","last_peered":"2024-09-13T15:34:35.309490+0000","last_clean":"2024-09-13T15:34:35.309490+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:34:35.309490+0000","last_undegraded":"2024-09-13T15:34:35.309490+0000","last_fullsized":"2024-09-13T15:34:35.309490+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227481+0000","last_change":"2024-09-13T15:34:35.342732+0000","last_active":"2024-09-13T15:34:38.227481+0000","last_peered":"2024-09-13T15:34:38.227481+0000","last_clean":"2024-09-13T15:34:38.227481+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:34:38.227481+0000","last_undegraded":"2024-09-13T15:34:38.227481+0000","last_fullsized":"2024-09-13T15:34:38.227481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.301557+0000","last_change":"2024-09-13T15:34:34.954181+0000","last_active":"2024-09-13T15:34:35.301557+0000","last_peered":"2024-09-13T15:34:35.301557+0000","last_clean":"2024-09-13T15:34:35.301557+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:34:35.301557+0000","last_undegraded":"2024-09-13T15:34:35.301557+0000","last_fullsized":"2024-09-13T15:34:35.301557+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228287+0000","last_change":"2024-09-13T15:34:35.329165+0000","last_active":"2024-09-13T15:34:38.228287+0000","last_peered":"2024-09-13T15:34:38.228287+0000","last_clean":"2024-09-13T15:34:38.228287+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:34:38.228287+0000","last_undegraded":"2024-09-13T15:34:38.228287+0000","last_fullsized":"2024-09-13T15:34:38.228287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.346922+0000","last_change":"2024-09-13T15:34:34.959407+0000","last_active":"2024-09-13T15:34:35.346922+0000","last_peered":"2024-09-13T15:34:35.346922+0000","last_clean":"2024-09-13T15:34:35.346922+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:34:35.346922+0000","last_undegraded":"2024-09-13T15:34:35.346922+0000","last_fullsized":"2024-09-13T15:34:35.346922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:31.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.230371+0000","last_change":"2024-09-13T15:34:35.335319+0000","last_active":"2024-09-13T15:34:38.230371+0000","last_peered":"2024-09-13T15:34:38.230371+0000","last_clean":"2024-09-13T15:34:38.230371+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:34:38.230371+0000","last_undegraded":"2024-09-13T15:34:38.230371+0000","last_fullsized":"2024-09-13T15:34:38.230371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.325671+0000","last_change":"2024-09-13T15:34:34.959935+0000","last_active":"2024-09-13T15:34:35.325671+0000","last_peered":"2024-09-13T15:34:35.325671+0000","last_clean":"2024-09-13T15:34:35.325671+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:34:35.325671+0000","last_undegraded":"2024-09-13T15:34:35.325671+0000","last_fullsized":"2024-09-13T15:34:35.325671+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231838+0000","last_change":"2024-09-13T15:34:35.338609+0000","last_active":"2024-09-13T15:34:38.231838+0000","last_peered":"2024-09-13T15:34:38.231838+0000","last_clean":"2024-09-13T15:34:38.231838+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:34:38.231838+0000","last_undegraded":"2024-09-13T15:34:38.231838+0000","last_fullsized":"2024-09-13T15:34:38.231838+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.337481+0000","last_change":"2024-09-13T15:34:34.956480+0000","last_active":"2024-09-13T15:34:35.337481+0000","last_peered":"2024-09-13T15:34:35.337481+0000","last_clean":"2024-09-13T15:34:35.337481+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:34:35.337481+0000","last_undegraded":"2024-09-13T15:34:35.337481+0000","last_fullsized":"2024-09-13T15:34:35.337481+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.304145+0000","last_change":"2024-09-13T15:34:35.347478+0000","last_active":"2024-09-13T15:34:36.304145+0000","last_peered":"2024-09-13T15:34:36.304145+0000","last_clean":"2024-09-13T15:34:36.304145+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:34:36.304145+0000","last_undegraded":"2024-09-13T15:34:36.304145+0000","last_fullsized":"2024-09-13T15:34:36.304145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.481157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.344238+0000","last_change":"2024-09-13T15:34:34.936361+0000","last_active":"2024-09-13T15:34:35.344238+0000","last_peered":"2024-09-13T15:34:35.344238+0000","last_clean":"2024-09-13T15:34:35.344238+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:34:35.344238+0000","last_undegraded":"2024-09-13T15:34:35.344238+0000","last_fullsized":"2024-09-13T15:34:35.344238+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302778+0000","last_change":"2024-09-13T15:34:35.330850+0000","last_active":"2024-09-13T15:34:36.302778+0000","last_peered":"2024-09-13T15:34:36.302778+0000","last_clean":"2024-09-13T15:34:36.302778+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:34:36.302778+0000","last_undegraded":"2024-09-13T15:34:36.302778+0000","last_fullsized":"2024-09-13T15:34:36.302778+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:53.423967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.313024+0000","last_change":"2024-09-13T15:34:34.956621+0000","last_active":"2024-09-13T15:34:35.313024+0000","last_peered":"2024-09-13T15:34:35.313024+0000","last_clean":"2024-09-13T15:34:35.313024+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:34:35.313024+0000","last_undegraded":"2024-09-13T15:34:35.313024+0000","last_fullsized":"2024-09-13T15:34:35.313024+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228749+0000","last_change":"2024-09-13T15:34:35.333828+0000","last_active":"2024-09-13T15:34:38.228749+0000","last_peered":"2024-09-13T15:34:38.228749+0000","last_clean":"2024-09-13T15:34:38.228749+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:34:38.228749+0000","last_undegraded":"2024-09-13T15:34:38.228749+0000","last_fullsized":"2024-09-13T15:34:38.228749+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":141,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.313295+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:34:35.313295+0000","last_peered":"2024-09-13T15:34:35.313295+0000","last_clean":"2024-09-13T15:34:35.313295+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:34:35.313295+0000","last_undegraded":"2024-09-13T15:34:35.313295+0000","last_fullsized":"2024-09-13T15:34:35.313295+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:42.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.320987+0000","last_change":"2024-09-13T15:34:34.939804+0000","last_active":"2024-09-13T15:34:35.320987+0000","last_peered":"2024-09-13T15:34:35.320987+0000","last_clean":"2024-09-13T15:34:35.320987+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:34:35.320987+0000","last_undegraded":"2024-09-13T15:34:35.320987+0000","last_fullsized":"2024-09-13T15:34:35.320987+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227999+0000","last_change":"2024-09-13T15:34:35.339727+0000","last_active":"2024-09-13T15:34:38.227999+0000","last_peered":"2024-09-13T15:34:38.227999+0000","last_clean":"2024-09-13T15:34:38.227999+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:34:38.227999+0000","last_undegraded":"2024-09-13T15:34:38.227999+0000","last_fullsized":"2024-09-13T15:34:38.227999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.313404+0000","last_change":"2024-09-13T15:34:34.960919+0000","last_active":"2024-09-13T15:34:35.313404+0000","last_peered":"2024-09-13T15:34:35.313404+0000","last_clean":"2024-09-13T15:34:35.313404+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:34:35.313404+0000","last_undegraded":"2024-09-13T15:34:35.313404+0000","last_fullsized":"2024-09-13T15:34:35.313404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:47.211308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.301967+0000","last_change":"2024-09-13T15:34:35.324328+0000","last_active":"2024-09-13T15:34:36.301967+0000","last_peered":"2024-09-13T15:34:36.301967+0000","last_clean":"2024-09-13T15:34:36.301967+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:34:36.301967+0000","last_undegraded":"2024-09-13T15:34:36.301967+0000","last_fullsized":"2024-09-13T15:34:36.301967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.312893+0000","last_change":"2024-09-13T15:34:34.955761+0000","last_active":"2024-09-13T15:34:35.312893+0000","last_peered":"2024-09-13T15:34:35.312893+0000","last_clean":"2024-09-13T15:34:35.312893+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:34:35.312893+0000","last_undegraded":"2024-09-13T15:34:35.312893+0000","last_fullsized":"2024-09-13T15:34:35.312893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:37.814369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.226955+0000","last_change":"2024-09-13T15:34:35.336428+0000","last_active":"2024-09-13T15:34:38.226955+0000","last_peered":"2024-09-13T15:34:38.226955+0000","last_clean":"2024-09-13T15:34:38.226955+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:34:38.226955+0000","last_undegraded":"2024-09-13T15:34:38.226955+0000","last_fullsized":"2024-09-13T15:34:38.226955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.298341+0000","last_change":"2024-09-13T15:34:34.953984+0000","last_active":"2024-09-13T15:34:35.298341+0000","last_peered":"2024-09-13T15:34:35.298341+0000","last_clean":"2024-09-13T15:34:35.298341+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:34:35.298341+0000","last_undegraded":"2024-09-13T15:34:35.298341+0000","last_fullsized":"2024-09-13T15:34:35.298341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303234+0000","last_change":"2024-09-13T15:34:35.327755+0000","last_active":"2024-09-13T15:34:36.303234+0000","last_peered":"2024-09-13T15:34:36.303234+0000","last_clean":"2024-09-13T15:34:36.303234+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:34:36.303234+0000","last_undegraded":"2024-09-13T15:34:36.303234+0000","last_fullsized":"2024-09-13T15:34:36.303234+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.321248+0000","last_change":"2024-09-13T15:34:34.946174+0000","last_active":"2024-09-13T15:34:35.321248+0000","last_peered":"2024-09-13T15:34:35.321248+0000","last_clean":"2024-09-13T15:34:35.321248+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:34:35.321248+0000","last_undegraded":"2024-09-13T15:34:35.321248+0000","last_fullsized":"2024-09-13T15:34:35.321248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231214+0000","last_change":"2024-09-13T15:34:35.335431+0000","last_active":"2024-09-13T15:34:38.231214+0000","last_peered":"2024-09-13T15:34:38.231214+0000","last_clean":"2024-09-13T15:34:38.231214+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:34:38.231214+0000","last_undegraded":"2024-09-13T15:34:38.231214+0000","last_fullsized":"2024-09-13T15:34:38.231214+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:24.940353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.324841+0000","last_change":"2024-09-13T15:34:34.949805+0000","last_active":"2024-09-13T15:34:35.324841+0000","last_peered":"2024-09-13T15:34:35.324841+0000","last_clean":"2024-09-13T15:34:35.324841+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:34:35.324841+0000","last_undegraded":"2024-09-13T15:34:35.324841+0000","last_fullsized":"2024-09-13T15:34:35.324841+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228884+0000","last_change":"2024-09-13T15:34:35.339676+0000","last_active":"2024-09-13T15:34:38.228884+0000","last_peered":"2024-09-13T15:34:38.228884+0000","last_clean":"2024-09-13T15:34:38.228884+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:34:38.228884+0000","last_undegraded":"2024-09-13T15:34:38.228884+0000","last_fullsized":"2024-09-13T15:34:38.228884+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228228+0000","last_change":"2024-09-13T15:34:34.942452+0000","last_active":"2024-09-13T15:34:38.228228+0000","last_peered":"2024-09-13T15:34:38.228228+0000","last_clean":"2024-09-13T15:34:38.228228+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:34:38.228228+0000","last_undegraded":"2024-09-13T15:34:38.228228+0000","last_fullsized":"2024-09-13T15:34:38.228228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231446+0000","last_change":"2024-09-13T15:34:35.337361+0000","last_active":"2024-09-13T15:34:38.231446+0000","last_peered":"2024-09-13T15:34:38.231446+0000","last_clean":"2024-09-13T15:34:38.231446+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:34:38.231446+0000","last_undegraded":"2024-09-13T15:34:38.231446+0000","last_fullsized":"2024-09-13T15:34:38.231446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:27.081960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.351197+0000","last_change":"2024-09-13T15:34:34.946540+0000","last_active":"2024-09-13T15:34:35.351197+0000","last_peered":"2024-09-13T15:34:35.351197+0000","last_clean":"2024-09-13T15:34:35.351197+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:34:35.351197+0000","last_undegraded":"2024-09-13T15:34:35.351197+0000","last_fullsized":"2024-09-13T15:34:35.351197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.303231+0000","last_change":"2024-09-13T15:34:35.334433+0000","last_active":"2024-09-13T15:34:36.303231+0000","last_peered":"2024-09-13T15:34:36.303231+0000","last_clean":"2024-09-13T15:34:36.303231+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:34:36.303231+0000","last_undegraded":"2024-09-13T15:34:36.303231+0000","last_fullsized":"2024-09-13T15:34:36.303231+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:34.847820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.297705+0000","last_change":"2024-09-13T15:34:34.941308+0000","last_active":"2024-09-13T15:34:35.297705+0000","last_peered":"2024-09-13T15:34:35.297705+0000","last_clean":"2024-09-13T15:34:35.297705+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:34:35.297705+0000","last_undegraded":"2024-09-13T15:34:35.297705+0000","last_fullsized":"2024-09-13T15:34:35.297705+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.301976+0000","last_change":"2024-09-13T15:34:35.327260+0000","last_active":"2024-09-13T15:34:36.301976+0000","last_peered":"2024-09-13T15:34:36.301976+0000","last_clean":"2024-09-13T15:34:36.301976+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:34:36.301976+0000","last_undegraded":"2024-09-13T15:34:36.301976+0000","last_fullsized":"2024-09-13T15:34:36.301976+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.318252+0000","last_change":"2024-09-13T15:34:34.943197+0000","last_active":"2024-09-13T15:34:35.318252+0000","last_peered":"2024-09-13T15:34:35.318252+0000","last_clean":"2024-09-13T15:34:35.318252+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:34:35.318252+0000","last_undegraded":"2024-09-13T15:34:35.318252+0000","last_fullsized":"2024-09-13T15:34:35.318252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.229906+0000","last_change":"2024-09-13T15:34:35.340037+0000","last_active":"2024-09-13T15:34:38.229906+0000","last_peered":"2024-09-13T15:34:38.229906+0000","last_clean":"2024-09-13T15:34:38.229906+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:34:38.229906+0000","last_undegraded":"2024-09-13T15:34:38.229906+0000","last_fullsized":"2024-09-13T15:34:38.229906+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.320969+0000","last_change":"2024-09-13T15:34:34.943732+0000","last_active":"2024-09-13T15:34:35.320969+0000","last_peered":"2024-09-13T15:34:35.320969+0000","last_clean":"2024-09-13T15:34:35.320969+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:34:35.320969+0000","last_undegraded":"2024-09-13T15:34:35.320969+0000","last_fullsized":"2024-09-13T15:34:35.320969+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.227681+0000","last_change":"2024-09-13T15:34:35.339704+0000","last_active":"2024-09-13T15:34:38.227681+0000","last_peered":"2024-09-13T15:34:38.227681+0000","last_clean":"2024-09-13T15:34:38.227681+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:34:38.227681+0000","last_undegraded":"2024-09-13T15:34:38.227681+0000","last_fullsized":"2024-09-13T15:34:38.227681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.310249+0000","last_change":"2024-09-13T15:34:34.943033+0000","last_active":"2024-09-13T15:34:35.310249+0000","last_peered":"2024-09-13T15:34:35.310249+0000","last_clean":"2024-09-13T15:34:35.310249+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:34:35.310249+0000","last_undegraded":"2024-09-13T15:34:35.310249+0000","last_fullsized":"2024-09-13T15:34:35.310249+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302764+0000","last_change":"2024-09-13T15:34:35.334308+0000","last_active":"2024-09-13T15:34:36.302764+0000","last_peered":"2024-09-13T15:34:36.302764+0000","last_clean":"2024-09-13T15:34:36.302764+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:34:36.302764+0000","last_undegraded":"2024-09-13T15:34:36.302764+0000","last_fullsized":"2024-09-13T15:34:36.302764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:50.918862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231259+0000","last_change":"2024-09-13T15:34:35.329220+0000","last_active":"2024-09-13T15:34:38.231259+0000","last_peered":"2024-09-13T15:34:38.231259+0000","last_clean":"2024-09-13T15:34:38.231259+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:34:38.231259+0000","last_undegraded":"2024-09-13T15:34:38.231259+0000","last_fullsized":"2024-09-13T15:34:38.231259+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.314859+0000","last_change":"2024-09-13T15:34:34.954062+0000","last_active":"2024-09-13T15:34:35.314859+0000","last_peered":"2024-09-13T15:34:35.314859+0000","last_clean":"2024-09-13T15:34:35.314859+0000","last_became_active":"2024-09-13T15:34:34.951645+0000","last_became_peered":"2024-09-13T15:34:34.951645+0000","last_unstale":"2024-09-13T15:34:35.314859+0000","last_undegraded":"2024-09-13T15:34:35.314859+0000","last_fullsized":"2024-09-13T15:34:35.314859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.228392+0000","last_change":"2024-09-13T15:34:35.333710+0000","last_active":"2024-09-13T15:34:38.228392+0000","last_peered":"2024-09-13T15:34:38.228392+0000","last_clean":"2024-09-13T15:34:38.228392+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:34:38.228392+0000","last_undegraded":"2024-09-13T15:34:38.228392+0000","last_fullsized":"2024-09-13T15:34:38.228392+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":13,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.317334+0000","last_change":"2024-09-13T15:34:34.950125+0000","last_active":"2024-09-13T15:34:35.317334+0000","last_peered":"2024-09-13T15:34:35.317334+0000","last_clean":"2024-09-13T15:34:35.317334+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:34:35.317334+0000","last_undegraded":"2024-09-13T15:34:35.317334+0000","last_fullsized":"2024-09-13T15:34:35.317334+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:36.302974+0000","last_change":"2024-09-13T15:34:35.350474+0000","last_active":"2024-09-13T15:34:36.302974+0000","last_peered":"2024-09-13T15:34:36.302974+0000","last_clean":"2024-09-13T15:34:36.302974+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:34:36.302974+0000","last_undegraded":"2024-09-13T15:34:36.302974+0000","last_fullsized":"2024-09-13T15:34:36.302974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:08:45.573183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.331405+0000","last_change":"2024-09-13T15:34:34.955842+0000","last_active":"2024-09-13T15:34:35.331405+0000","last_peered":"2024-09-13T15:34:35.331405+0000","last_clean":"2024-09-13T15:34:35.331405+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:34:35.331405+0000","last_undegraded":"2024-09-13T15:34:35.331405+0000","last_fullsized":"2024-09-13T15:34:35.331405+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-09-13T15:34:38.231610+0000","last_change":"2024-09-13T15:34:35.338454+0000","last_active":"2024-09-13T15:34:38.231610+0000","last_peered":"2024-09-13T15:34:38.231610+0000","last_clean":"2024-09-13T15:34:38.231610+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:34:38.231610+0000","last_undegraded":"2024-09-13T15:34:38.231610+0000","last_fullsized":"2024-09-13T15:34:38.231610+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:49.904225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"15'4","reported_seq":15,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-13T15:34:35.331443+0000","last_change":"2024-09-13T15:34:34.960705+0000","last_active":"2024-09-13T15:34:35.331443+0000","last_peered":"2024-09-13T15:34:35.331443+0000","last_clean":"2024-09-13T15:34:35.331443+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:34:35.331443+0000","last_undegraded":"2024-09-13T15:34:35.331443+0000","last_fullsized":"2024-09-13T15:34:35.331443+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738376,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":44402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":635430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":749568,"data_stored":633830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:34:49.146 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T15:34:49.146 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T15:34:49.146 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T15:34:49.147 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T15:34:49.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.303+0000 7f9fcc76d640 1 Processor -- start 2024-09-13T15:34:49.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.303+0000 7f9fcc76d640 1 -- start start 2024-09-13T15:34:49.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.303+0000 7f9fcc76d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9fc40b4600 0x7f9fc414dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:49.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.303+0000 7f9fcc76d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc40c1130 con 0x7f9fc414e280 2024-09-13T15:34:49.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.303+0000 7f9fcc76d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc414e780 con 0x7f9fc40b4600 2024-09-13T15:34:49.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.303+0000 7f9fca509640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9fc40b4600 0x7f9fc414dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:49.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.303+0000 7f9fc9d08640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9fc414e280 0x7f9fc40bf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38804/0 (socket says 172.21.15.40:38804) 2024-09-13T15:34:49.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.303+0000 7f9fc9d08640 1 -- 172.21.15.40:0/1822768709 learned_addr learned my addr 172.21.15.40:0/1822768709 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:49.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.303+0000 7f9fca509640 1 -- 172.21.15.40:0/1822768709 >> v1:172.21.15.40:6789/0 conn(0x7f9fc414e280 legacy=0x7f9fc40bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:49.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.303+0000 7f9fca509640 1 -- 172.21.15.40:0/1822768709 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc40b59f0 con 0x7f9fc40b4600 2024-09-13T15:34:49.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.307+0000 7f9fca509640 1 --2- 172.21.15.40:0/1822768709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc40b4600 0x7f9fc414dd40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009740 tx=0x7f9fc001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f1904048a98b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:49.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.307+0000 7f9fc9507640 1 -- 172.21.15.40:0/1822768709 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fc00ab530 con 0x7f9fc40b4600 2024-09-13T15:34:49.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.307+0000 7f9fc9507640 1 -- 172.21.15.40:0/1822768709 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc00a7050 con 0x7f9fc40b4600 2024-09-13T15:34:49.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.307+0000 7f9fc9507640 1 -- 172.21.15.40:0/1822768709 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fc00ab7e0 con 0x7f9fc40b4600 2024-09-13T15:34:49.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.307+0000 7f9fcc76d640 1 -- 172.21.15.40:0/1822768709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc40b4600 msgr2=0x7f9fc414dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:49.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.307+0000 7f9fcc76d640 1 --2- 172.21.15.40:0/1822768709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc40b4600 0x7f9fc414dd40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009740 tx=0x7f9fc001c390 comp rx=0 tx=0).stop 2024-09-13T15:34:49.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.307+0000 7f9fcc76d640 1 -- 172.21.15.40:0/1822768709 shutdown_connections 2024-09-13T15:34:49.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.307+0000 7f9fcc76d640 1 --2- 172.21.15.40:0/1822768709 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc40b4600 0x7f9fc414dd40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:49.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.307+0000 7f9fcc76d640 1 -- 172.21.15.40:0/1822768709 >> 172.21.15.40:0/1822768709 conn(0x7f9fc406a540 msgr2=0x7f9fc40a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:49.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.307+0000 7f9fcc76d640 1 -- 172.21.15.40:0/1822768709 shutdown_connections 2024-09-13T15:34:49.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.307+0000 7f9fcc76d640 1 -- 172.21.15.40:0/1822768709 wait complete. 2024-09-13T15:34:49.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.307+0000 7f9fcc76d640 1 Processor -- start 2024-09-13T15:34:49.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fcc76d640 1 -- start start 2024-09-13T15:34:49.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fcc76d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc40b4600 0x7f9fc4147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:49.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fcc76d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc41480d0 con 0x7f9fc40b4600 2024-09-13T15:34:49.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fca509640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc40b4600 0x7f9fc4147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:49.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fca509640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc40b4600 0x7f9fc4147b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47616/0 (socket says 172.21.15.40:47616) 2024-09-13T15:34:49.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fca509640 1 -- 172.21.15.40:0/2399464726 learned_addr learned my addr 172.21.15.40:0/2399464726 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:49.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fca509640 1 -- 172.21.15.40:0/2399464726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc0009420 con 0x7f9fc40b4600 2024-09-13T15:34:49.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fca509640 1 --2- 172.21.15.40:0/2399464726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc40b4600 0x7f9fc4147b90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00ae040 tx=0x7f9fc0019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:49.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fbaffd640 1 -- 172.21.15.40:0/2399464726 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fc00b4410 con 0x7f9fc40b4600 2024-09-13T15:34:49.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fbaffd640 1 -- 172.21.15.40:0/2399464726 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc00b4570 con 0x7f9fc40b4600 2024-09-13T15:34:49.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fcc76d640 1 -- 172.21.15.40:0/2399464726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc4159aa0 con 0x7f9fc40b4600 2024-09-13T15:34:49.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fbaffd640 1 -- 172.21.15.40:0/2399464726 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9fc00b4850 con 0x7f9fc40b4600 2024-09-13T15:34:49.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fcc76d640 1 -- 172.21.15.40:0/2399464726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc414b810 con 0x7f9fc40b4600 2024-09-13T15:34:49.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fcc76d640 1 -- 172.21.15.40:0/2399464726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc414dd40 con 0x7f9fc40b4600 2024-09-13T15:34:49.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fbaffd640 1 -- 172.21.15.40:0/2399464726 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f9fc00b2040 con 0x7f9fc40b4600 2024-09-13T15:34:49.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fbaffd640 1 --2- 172.21.15.40:0/2399464726 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9fa8035450 0x7f9fa8037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:49.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fbaffd640 1 -- 172.21.15.40:0/2399464726 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f9fc00e18b0 con 0x7f9fc40b4600 2024-09-13T15:34:49.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fc9d08640 1 --2- 172.21.15.40:0/2399464726 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9fa8035450 0x7f9fa8037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:49.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.311+0000 7f9fc9d08640 1 --2- 172.21.15.40:0/2399464726 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9fa8035450 0x7f9fa8037910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4001610 tx=0x7f9fb4007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:49.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.315+0000 7f9fbaffd640 1 -- 172.21.15.40:0/2399464726 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9fc00b49b0 con 0x7f9fc40b4600 2024-09-13T15:34:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.507+0000 7f9fcc76d640 1 -- 172.21.15.40:0/2399464726 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9fc40a3b40 con 0x7f9fc40b4600 2024-09-13T15:34:49.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.507+0000 7f9fbaffd640 1 -- 172.21.15.40:0/2399464726 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9fc00b0070 con 0x7f9fc40b4600 2024-09-13T15:34:49.510 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:49.510 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T15:34:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.507+0000 7f9fcc76d640 1 -- 172.21.15.40:0/2399464726 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9fa8035450 msgr2=0x7f9fa8037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.507+0000 7f9fcc76d640 1 --2- 172.21.15.40:0/2399464726 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9fa8035450 0x7f9fa8037910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4001610 tx=0x7f9fb4007ad0 comp rx=0 tx=0).stop 2024-09-13T15:34:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.507+0000 7f9fcc76d640 1 -- 172.21.15.40:0/2399464726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc40b4600 msgr2=0x7f9fc4147b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.507+0000 7f9fcc76d640 1 --2- 172.21.15.40:0/2399464726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc40b4600 0x7f9fc4147b90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00ae040 tx=0x7f9fc0019130 comp rx=0 tx=0).stop 2024-09-13T15:34:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.511+0000 7f9fcc76d640 1 -- 172.21.15.40:0/2399464726 shutdown_connections 2024-09-13T15:34:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.511+0000 7f9fcc76d640 1 --2- 172.21.15.40:0/2399464726 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9fa8035450 0x7f9fa8037910 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.511+0000 7f9fcc76d640 1 --2- 172.21.15.40:0/2399464726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9fc40b4600 0x7f9fc4147b90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.511+0000 7f9fcc76d640 1 -- 172.21.15.40:0/2399464726 >> 172.21.15.40:0/2399464726 conn(0x7f9fc406a540 msgr2=0x7f9fc40bf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.511+0000 7f9fcc76d640 1 -- 172.21.15.40:0/2399464726 shutdown_connections 2024-09-13T15:34:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.511+0000 7f9fcc76d640 1 -- 172.21.15.40:0/2399464726 wait complete. 2024-09-13T15:34:49.527 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T15:34:49.528 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:49.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.639+0000 7ff9898b9640 1 Processor -- start 2024-09-13T15:34:49.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.639+0000 7ff9898b9640 1 -- start start 2024-09-13T15:34:49.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.643+0000 7ff9898b9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff9840b4600 0x7ff98414dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:49.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.643+0000 7ff9898b9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9840c1130 con 0x7ff98414e280 2024-09-13T15:34:49.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.643+0000 7ff9898b9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98414e780 con 0x7ff9840b4600 2024-09-13T15:34:49.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.643+0000 7ff9827fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff98414e280 0x7ff9840bf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38812/0 (socket says 172.21.15.40:38812) 2024-09-13T15:34:49.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.643+0000 7ff9827fc640 1 -- 172.21.15.40:0/2300074740 learned_addr learned my addr 172.21.15.40:0/2300074740 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:49.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.643+0000 7ff982ffd640 1 --2- 172.21.15.40:0/2300074740 >> v2:172.21.15.40:3300/0 conn(0x7ff9840b4600 0x7ff98414dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:49.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.643+0000 7ff981ffb640 1 -- 172.21.15.40:0/2300074740 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502533228 0 0) 0x7ff9840c1130 con 0x7ff98414e280 2024-09-13T15:34:49.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.643+0000 7ff981ffb640 1 -- 172.21.15.40:0/2300074740 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff96c003530 con 0x7ff98414e280 2024-09-13T15:34:49.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.643+0000 7ff982ffd640 1 -- 172.21.15.40:0/2300074740 >> v1:172.21.15.40:6789/0 conn(0x7ff98414e280 legacy=0x7ff9840bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:49.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.643+0000 7ff982ffd640 1 -- 172.21.15.40:0/2300074740 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9840b59f0 con 0x7ff9840b4600 2024-09-13T15:34:49.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff982ffd640 1 --2- 172.21.15.40:0/2300074740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9840b4600 0x7ff98414dd40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff974009740 tx=0x7ff97401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0868c2c40a2c129 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:49.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff981ffb640 1 -- 172.21.15.40:0/2300074740 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9740ab530 con 0x7ff9840b4600 2024-09-13T15:34:49.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff981ffb640 1 -- 172.21.15.40:0/2300074740 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9740a7050 con 0x7ff9840b4600 2024-09-13T15:34:49.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff981ffb640 1 -- 172.21.15.40:0/2300074740 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9740ab7c0 con 0x7ff9840b4600 2024-09-13T15:34:49.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff9898b9640 1 -- 172.21.15.40:0/2300074740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9840b4600 msgr2=0x7ff98414dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:49.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff9898b9640 1 --2- 172.21.15.40:0/2300074740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9840b4600 0x7ff98414dd40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff974009740 tx=0x7ff97401c390 comp rx=0 tx=0).stop 2024-09-13T15:34:49.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff9898b9640 1 -- 172.21.15.40:0/2300074740 shutdown_connections 2024-09-13T15:34:49.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff9898b9640 1 --2- 172.21.15.40:0/2300074740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9840b4600 0x7ff98414dd40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:49.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff9898b9640 1 -- 172.21.15.40:0/2300074740 >> 172.21.15.40:0/2300074740 conn(0x7ff98406a540 msgr2=0x7ff9840a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:49.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff9898b9640 1 -- 172.21.15.40:0/2300074740 shutdown_connections 2024-09-13T15:34:49.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff9898b9640 1 -- 172.21.15.40:0/2300074740 wait complete. 2024-09-13T15:34:49.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff9898b9640 1 Processor -- start 2024-09-13T15:34:49.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff9898b9640 1 -- start start 2024-09-13T15:34:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff9898b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9840b4600 0x7ff984159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff9898b9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff984142960 con 0x7ff9840b4600 2024-09-13T15:34:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff982ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9840b4600 0x7ff984159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff982ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9840b4600 0x7ff984159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47632/0 (socket says 172.21.15.40:47632) 2024-09-13T15:34:49.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.647+0000 7ff982ffd640 1 -- 172.21.15.40:0/980810226 learned_addr learned my addr 172.21.15.40:0/980810226 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:49.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff982ffd640 1 -- 172.21.15.40:0/980810226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff974009420 con 0x7ff9840b4600 2024-09-13T15:34:49.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff982ffd640 1 --2- 172.21.15.40:0/980810226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9840b4600 0x7ff984159f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff9740ae040 tx=0x7ff974019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:49.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff96bfff640 1 -- 172.21.15.40:0/980810226 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9740abd70 con 0x7ff9840b4600 2024-09-13T15:34:49.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff96bfff640 1 -- 172.21.15.40:0/980810226 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9740b4410 con 0x7ff9840b4600 2024-09-13T15:34:49.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff96bfff640 1 -- 172.21.15.40:0/980810226 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9740b4580 con 0x7ff9840b4600 2024-09-13T15:34:49.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff9898b9640 1 -- 172.21.15.40:0/980810226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9841475e0 con 0x7ff9840b4600 2024-09-13T15:34:49.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff9898b9640 1 -- 172.21.15.40:0/980810226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9841ec370 con 0x7ff9840b4600 2024-09-13T15:34:49.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff96bfff640 1 -- 172.21.15.40:0/980810226 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7ff9740b2040 con 0x7ff9840b4600 2024-09-13T15:34:49.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff9898b9640 1 -- 172.21.15.40:0/980810226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98414dd40 con 0x7ff9840b4600 2024-09-13T15:34:49.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff96bfff640 1 --2- 172.21.15.40:0/980810226 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff970035450 0x7ff970037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:49.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff96bfff640 1 -- 172.21.15.40:0/980810226 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7ff9740e1830 con 0x7ff9840b4600 2024-09-13T15:34:49.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff9827fc640 1 --2- 172.21.15.40:0/980810226 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff970035450 0x7ff970037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:49.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.651+0000 7ff9827fc640 1 --2- 172.21.15.40:0/980810226 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff970035450 0x7ff970037910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff978000f70 tx=0x7ff9780010b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:49.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.655+0000 7ff96bfff640 1 -- 172.21.15.40:0/980810226 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff9740bc3b0 con 0x7ff9840b4600 2024-09-13T15:34:49.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.815+0000 7ff9898b9640 1 -- 172.21.15.40:0/980810226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9840a3b40 con 0x7ff9840b4600 2024-09-13T15:34:49.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.819+0000 7ff96bfff640 1 -- 172.21.15.40:0/980810226 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+10503 (secure 0 0 0) 0x7ff9740b0070 con 0x7ff9840b4600 2024-09-13T15:34:49.821 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:49.821 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:36.294490+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:49.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.819+0000 7ff9898b9640 1 -- 172.21.15.40:0/980810226 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff970035450 msgr2=0x7ff970037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:49.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.819+0000 7ff9898b9640 1 --2- 172.21.15.40:0/980810226 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff970035450 0x7ff970037910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff978000f70 tx=0x7ff9780010b0 comp rx=0 tx=0).stop 2024-09-13T15:34:49.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.819+0000 7ff9898b9640 1 -- 172.21.15.40:0/980810226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9840b4600 msgr2=0x7ff984159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:49.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.819+0000 7ff9898b9640 1 --2- 172.21.15.40:0/980810226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9840b4600 0x7ff984159f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff9740ae040 tx=0x7ff974019130 comp rx=0 tx=0).stop 2024-09-13T15:34:49.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.819+0000 7ff9898b9640 1 -- 172.21.15.40:0/980810226 shutdown_connections 2024-09-13T15:34:49.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.819+0000 7ff9898b9640 1 --2- 172.21.15.40:0/980810226 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff970035450 0x7ff970037910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:49.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.819+0000 7ff9898b9640 1 --2- 172.21.15.40:0/980810226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9840b4600 0x7ff984159f20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:49.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.819+0000 7ff9898b9640 1 -- 172.21.15.40:0/980810226 >> 172.21.15.40:0/980810226 conn(0x7ff98406a540 msgr2=0x7ff98406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:49.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.819+0000 7ff9898b9640 1 -- 172.21.15.40:0/980810226 shutdown_connections 2024-09-13T15:34:49.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.819+0000 7ff9898b9640 1 -- 172.21.15.40:0/980810226 wait complete. 2024-09-13T15:34:49.841 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:34:25.125767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:34:33.833957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:34:34.276037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:34:49.841 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:34:49.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.959+0000 7ff1b5a1b640 1 Processor -- start 2024-09-13T15:34:49.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.959+0000 7ff1b5a1b640 1 -- start start 2024-09-13T15:34:49.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1b5a1b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff1b00bebb0 0x7ff1b00a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1b5a1b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b01515b0 con 0x7ff1b00b4010 2024-09-13T15:34:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1b5a1b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b014e2c0 con 0x7ff1b00bebb0 2024-09-13T15:34:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1aeffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff1b00bebb0 0x7ff1b00a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1aeffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff1b00bebb0 0x7ff1b00a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47646/0 (socket says 172.21.15.40:47646) 2024-09-13T15:34:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1aeffd640 1 -- 172.21.15.40:0/997638635 learned_addr learned my addr 172.21.15.40:0/997638635 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1ae7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff1b00b4010 0x7ff1b006e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38824/0 (socket says 172.21.15.40:38824) 2024-09-13T15:34:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1aeffd640 1 -- 172.21.15.40:0/997638635 >> v1:172.21.15.40:6789/0 conn(0x7ff1b00b4010 legacy=0x7ff1b006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1adffb640 1 -- 172.21.15.40:0/997638635 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2568418552 0 0) 0x7ff1b01515b0 con 0x7ff1b00b4010 2024-09-13T15:34:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1aeffd640 1 -- 172.21.15.40:0/997638635 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b006f830 con 0x7ff1b00bebb0 2024-09-13T15:34:49.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1aeffd640 1 --2- 172.21.15.40:0/997638635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1b00bebb0 0x7ff1b00a4d70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00097f0 tx=0x7ff1a001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e244116c3cc0368 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:49.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1adffb640 1 -- 172.21.15.40:0/997638635 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1b00b6bc0 con 0x7ff1b00bebb0 2024-09-13T15:34:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1adffb640 1 -- 172.21.15.40:0/997638635 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a00a7050 con 0x7ff1b00bebb0 2024-09-13T15:34:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1adffb640 1 -- 172.21.15.40:0/997638635 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1a00ab680 con 0x7ff1b00bebb0 2024-09-13T15:34:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/997638635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1b00bebb0 msgr2=0x7ff1b00a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1b5a1b640 1 --2- 172.21.15.40:0/997638635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1b00bebb0 0x7ff1b00a4d70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00097f0 tx=0x7ff1a001c4e0 comp rx=0 tx=0).stop 2024-09-13T15:34:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/997638635 shutdown_connections 2024-09-13T15:34:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1b5a1b640 1 --2- 172.21.15.40:0/997638635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1b00bebb0 0x7ff1b00a4d70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/997638635 >> 172.21.15.40:0/997638635 conn(0x7ff1b006a540 msgr2=0x7ff1b00a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/997638635 shutdown_connections 2024-09-13T15:34:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.963+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/997638635 wait complete. 2024-09-13T15:34:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1b5a1b640 1 Processor -- start 2024-09-13T15:34:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1b5a1b640 1 -- start start 2024-09-13T15:34:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1b5a1b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1b00b4010 0x7ff1b00bb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1b5a1b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b00bb920 con 0x7ff1b00b4010 2024-09-13T15:34:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1aeffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1b00b4010 0x7ff1b00bb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:49.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1aeffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1b00b4010 0x7ff1b00bb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47656/0 (socket says 172.21.15.40:47656) 2024-09-13T15:34:49.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1aeffd640 1 -- 172.21.15.40:0/3650198697 learned_addr learned my addr 172.21.15.40:0/3650198697 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1aeffd640 1 -- 172.21.15.40:0/3650198697 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00094d0 con 0x7ff1b00b4010 2024-09-13T15:34:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1aeffd640 1 --2- 172.21.15.40:0/3650198697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1b00b4010 0x7ff1b00bb210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00190f0 tx=0x7ff1a001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff197fff640 1 -- 172.21.15.40:0/3650198697 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1a0004150 con 0x7ff1b00b4010 2024-09-13T15:34:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff197fff640 1 -- 172.21.15.40:0/3650198697 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a00042b0 con 0x7ff1b00b4010 2024-09-13T15:34:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/3650198697 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b014f6c0 con 0x7ff1b00b4010 2024-09-13T15:34:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff197fff640 1 -- 172.21.15.40:0/3650198697 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1a0003620 con 0x7ff1b00b4010 2024-09-13T15:34:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/3650198697 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b009a7f0 con 0x7ff1b00b4010 2024-09-13T15:34:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff197fff640 1 -- 172.21.15.40:0/3650198697 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7ff1a00b2040 con 0x7ff1b00b4010 2024-09-13T15:34:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/3650198697 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b00a4d70 con 0x7ff1b00b4010 2024-09-13T15:34:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff197fff640 1 --2- 172.21.15.40:0/3650198697 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff19c0354a0 0x7ff19c037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff197fff640 1 -- 172.21.15.40:0/3650198697 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7ff1a00e1980 con 0x7ff1b00b4010 2024-09-13T15:34:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.967+0000 7ff1ae7fc640 1 --2- 172.21.15.40:0/3650198697 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff19c0354a0 0x7ff19c037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.971+0000 7ff1ae7fc640 1 --2- 172.21.15.40:0/3650198697 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff19c0354a0 0x7ff19c037960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4000f90 tx=0x7ff1a4007ca0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:49.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:49.975+0000 7ff197fff640 1 -- 172.21.15.40:0/3650198697 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff1a00c68f0 con 0x7ff1b00b4010 2024-09-13T15:34:50.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.131+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/3650198697 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1b0151020 con 0x7ff1b00b4010 2024-09-13T15:34:50.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.131+0000 7ff197fff640 1 -- 172.21.15.40:0/3650198697 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1a00b0030 con 0x7ff1b00b4010 2024-09-13T15:34:50.135 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-09-13T15:34:50.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.135+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/3650198697 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff19c0354a0 msgr2=0x7ff19c037960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:50.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.135+0000 7ff1b5a1b640 1 --2- 172.21.15.40:0/3650198697 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff19c0354a0 0x7ff19c037960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4000f90 tx=0x7ff1a4007ca0 comp rx=0 tx=0).stop 2024-09-13T15:34:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.135+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/3650198697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1b00b4010 msgr2=0x7ff1b00bb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.135+0000 7ff1b5a1b640 1 --2- 172.21.15.40:0/3650198697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1b00b4010 0x7ff1b00bb210 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00190f0 tx=0x7ff1a001ad20 comp rx=0 tx=0).stop 2024-09-13T15:34:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.135+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/3650198697 shutdown_connections 2024-09-13T15:34:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.135+0000 7ff1b5a1b640 1 --2- 172.21.15.40:0/3650198697 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ff19c0354a0 0x7ff19c037960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.135+0000 7ff1b5a1b640 1 --2- 172.21.15.40:0/3650198697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1b00b4010 0x7ff1b00bb210 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.135+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/3650198697 >> 172.21.15.40:0/3650198697 conn(0x7ff1b006a540 msgr2=0x7ff1b01482c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.135+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/3650198697 shutdown_connections 2024-09-13T15:34:50.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.135+0000 7ff1b5a1b640 1 -- 172.21.15.40:0/3650198697 wait complete. 2024-09-13T15:34:50.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:34:50.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.263+0000 7f1b8ef07640 1 Processor -- start 2024-09-13T15:34:50.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.263+0000 7f1b8ef07640 1 -- start start 2024-09-13T15:34:50.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.263+0000 7f1b8ef07640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b88071900 0x7f1b880b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:50.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.263+0000 7f1b8ef07640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b880bac80 con 0x7f1b880b8670 2024-09-13T15:34:50.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.263+0000 7f1b8ef07640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b880706f0 con 0x7f1b88071900 2024-09-13T15:34:50.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.263+0000 7f1b8cca3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b88071900 0x7f1b880b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:50.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.263+0000 7f1b87fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1b880b8670 0x7f1b8806fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38828/0 (socket says 172.21.15.40:38828) 2024-09-13T15:34:50.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.263+0000 7f1b87fff640 1 -- 172.21.15.40:0/2140613087 learned_addr learned my addr 172.21.15.40:0/2140613087 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:50.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.263+0000 7f1b8cca3640 1 -- 172.21.15.40:0/2140613087 >> v1:172.21.15.40:6789/0 conn(0x7f1b880b8670 legacy=0x7f1b8806fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:50.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.263+0000 7f1b8cca3640 1 -- 172.21.15.40:0/2140613087 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b880703c0 con 0x7f1b88071900 2024-09-13T15:34:50.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.263+0000 7f1b877fe640 1 -- 172.21.15.40:0/2140613087 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259226390 0 0) 0x7f1b880bac80 con 0x7f1b880b8670 2024-09-13T15:34:50.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b8cca3640 1 --2- 172.21.15.40:0/2140613087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b88071900 0x7f1b880b79d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009d90 tx=0x7f1b8001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb3cb77eb1b111c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:50.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b877fe640 1 -- 172.21.15.40:0/2140613087 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b800a5900 con 0x7f1b88071900 2024-09-13T15:34:50.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b877fe640 1 -- 172.21.15.40:0/2140613087 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b800a5a60 con 0x7f1b88071900 2024-09-13T15:34:50.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b877fe640 1 -- 172.21.15.40:0/2140613087 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b800a5d20 con 0x7f1b88071900 2024-09-13T15:34:50.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b8ef07640 1 -- 172.21.15.40:0/2140613087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b88071900 msgr2=0x7f1b880b79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:50.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b8ef07640 1 --2- 172.21.15.40:0/2140613087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b88071900 0x7f1b880b79d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009d90 tx=0x7f1b8001c970 comp rx=0 tx=0).stop 2024-09-13T15:34:50.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b8ef07640 1 -- 172.21.15.40:0/2140613087 shutdown_connections 2024-09-13T15:34:50.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b8ef07640 1 --2- 172.21.15.40:0/2140613087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b88071900 0x7f1b880b79d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:50.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b8ef07640 1 -- 172.21.15.40:0/2140613087 >> 172.21.15.40:0/2140613087 conn(0x7f1b88065f10 msgr2=0x7f1b88070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:50.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b8ef07640 1 -- 172.21.15.40:0/2140613087 shutdown_connections 2024-09-13T15:34:50.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b8ef07640 1 -- 172.21.15.40:0/2140613087 wait complete. 2024-09-13T15:34:50.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b8ef07640 1 Processor -- start 2024-09-13T15:34:50.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.267+0000 7f1b8ef07640 1 -- start start 2024-09-13T15:34:50.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b8ef07640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b88071900 0x7f1b881e7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:50.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b8ef07640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b881e81e0 con 0x7f1b88071900 2024-09-13T15:34:50.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b8cca3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b88071900 0x7f1b881e7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:50.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b8cca3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b88071900 0x7f1b881e7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47674/0 (socket says 172.21.15.40:47674) 2024-09-13T15:34:50.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b8cca3640 1 -- 172.21.15.40:0/1688628782 learned_addr learned my addr 172.21.15.40:0/1688628782 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:50.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b8cca3640 1 -- 172.21.15.40:0/1688628782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b80009a70 con 0x7f1b88071900 2024-09-13T15:34:50.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b8cca3640 1 --2- 172.21.15.40:0/1688628782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b88071900 0x7f1b881e7ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b8001c9b0 tx=0x7f1b80019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:50.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b857fa640 1 -- 172.21.15.40:0/1688628782 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b800ad990 con 0x7f1b88071900 2024-09-13T15:34:50.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b857fa640 1 -- 172.21.15.40:0/1688628782 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b800adaf0 con 0x7f1b88071900 2024-09-13T15:34:50.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b8ef07640 1 -- 172.21.15.40:0/1688628782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8813c500 con 0x7f1b88071900 2024-09-13T15:34:50.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b857fa640 1 -- 172.21.15.40:0/1688628782 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b800add90 con 0x7f1b88071900 2024-09-13T15:34:50.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b8ef07640 1 -- 172.21.15.40:0/1688628782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b881e9250 con 0x7f1b88071900 2024-09-13T15:34:50.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b857fa640 1 -- 172.21.15.40:0/1688628782 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f1b800b4050 con 0x7f1b88071900 2024-09-13T15:34:50.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b8ef07640 1 -- 172.21.15.40:0/1688628782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8813fa70 con 0x7f1b88071900 2024-09-13T15:34:50.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b857fa640 1 --2- 172.21.15.40:0/1688628782 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f1b68035450 0x7f1b68037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:50.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b857fa640 1 -- 172.21.15.40:0/1688628782 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f1b800e25c0 con 0x7f1b88071900 2024-09-13T15:34:50.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b87fff640 1 --2- 172.21.15.40:0/1688628782 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f1b68035450 0x7f1b68037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:50.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.271+0000 7f1b87fff640 1 --2- 172.21.15.40:0/1688628782 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f1b68035450 0x7f1b68037910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007fd0 tx=0x7f1b70007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:50.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.275+0000 7f1b857fa640 1 -- 172.21.15.40:0/1688628782 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1b8813fa70 con 0x7f1b88071900 2024-09-13T15:34:50.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.435+0000 7f1b8ef07640 1 -- 172.21.15.40:0/1688628782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b88071ef0 con 0x7f1b88071900 2024-09-13T15:34:50.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.435+0000 7f1b857fa640 1 -- 172.21.15.40:0/1688628782 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b88071ef0 con 0x7f1b88071900 2024-09-13T15:34:50.437 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:34:50.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.435+0000 7f1b8ef07640 1 -- 172.21.15.40:0/1688628782 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f1b68035450 msgr2=0x7f1b68037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:50.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.435+0000 7f1b8ef07640 1 --2- 172.21.15.40:0/1688628782 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f1b68035450 0x7f1b68037910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007fd0 tx=0x7f1b70007920 comp rx=0 tx=0).stop 2024-09-13T15:34:50.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.435+0000 7f1b8ef07640 1 -- 172.21.15.40:0/1688628782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b88071900 msgr2=0x7f1b881e7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:50.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.435+0000 7f1b8ef07640 1 --2- 172.21.15.40:0/1688628782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b88071900 0x7f1b881e7ae0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b8001c9b0 tx=0x7f1b80019710 comp rx=0 tx=0).stop 2024-09-13T15:34:50.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.435+0000 7f1b8ef07640 1 -- 172.21.15.40:0/1688628782 shutdown_connections 2024-09-13T15:34:50.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.435+0000 7f1b8ef07640 1 --2- 172.21.15.40:0/1688628782 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f1b68035450 0x7f1b68037910 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:50.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.435+0000 7f1b8ef07640 1 --2- 172.21.15.40:0/1688628782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b88071900 0x7f1b881e7ae0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:50.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.435+0000 7f1b8ef07640 1 -- 172.21.15.40:0/1688628782 >> 172.21.15.40:0/1688628782 conn(0x7f1b88065f10 msgr2=0x7f1b880bd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:50.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.439+0000 7f1b8ef07640 1 -- 172.21.15.40:0/1688628782 shutdown_connections 2024-09-13T15:34:50.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.439+0000 7f1b8ef07640 1 -- 172.21.15.40:0/1688628782 wait complete. 2024-09-13T15:34:50.456 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:34:50.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.579+0000 7fb39c8c2640 1 Processor -- start 2024-09-13T15:34:50.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.583+0000 7fb39c8c2640 1 -- start start 2024-09-13T15:34:50.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.583+0000 7fb39c8c2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb3980bebb0 0x7fb3980a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:50.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.583+0000 7fb39c8c2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3981515b0 con 0x7fb3980b4010 2024-09-13T15:34:50.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.583+0000 7fb39c8c2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb39814e2c0 con 0x7fb3980bebb0 2024-09-13T15:34:50.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.583+0000 7fb395d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb3980b4010 0x7fb39806e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38834/0 (socket says 172.21.15.40:38834) 2024-09-13T15:34:50.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.583+0000 7fb395d9b640 1 -- 172.21.15.40:0/393128761 learned_addr learned my addr 172.21.15.40:0/393128761 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:50.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.583+0000 7fb39659c640 1 --2- 172.21.15.40:0/393128761 >> v2:172.21.15.40:3300/0 conn(0x7fb3980bebb0 0x7fb3980a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:50.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.583+0000 7fb39659c640 1 -- 172.21.15.40:0/393128761 >> v1:172.21.15.40:6789/0 conn(0x7fb3980b4010 legacy=0x7fb39806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:50.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.583+0000 7fb39659c640 1 -- 172.21.15.40:0/393128761 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39806f830 con 0x7fb3980bebb0 2024-09-13T15:34:50.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.583+0000 7fb39659c640 1 --2- 172.21.15.40:0/393128761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3980bebb0 0x7fb3980a4d70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb388009740 tx=0x7fb38801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb44488692e0b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:50.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.583+0000 7fb39559a640 1 -- 172.21.15.40:0/393128761 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3980b6bc0 con 0x7fb3980bebb0 2024-09-13T15:34:50.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.583+0000 7fb39559a640 1 -- 172.21.15.40:0/393128761 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3880a7050 con 0x7fb3980bebb0 2024-09-13T15:34:50.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39559a640 1 -- 172.21.15.40:0/393128761 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3880ab680 con 0x7fb3980bebb0 2024-09-13T15:34:50.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 -- 172.21.15.40:0/393128761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3980bebb0 msgr2=0x7fb3980a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:50.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 --2- 172.21.15.40:0/393128761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3980bebb0 0x7fb3980a4d70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb388009740 tx=0x7fb38801c420 comp rx=0 tx=0).stop 2024-09-13T15:34:50.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 -- 172.21.15.40:0/393128761 shutdown_connections 2024-09-13T15:34:50.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 --2- 172.21.15.40:0/393128761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3980bebb0 0x7fb3980a4d70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:50.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 -- 172.21.15.40:0/393128761 >> 172.21.15.40:0/393128761 conn(0x7fb39806a540 msgr2=0x7fb3980a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:50.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 -- 172.21.15.40:0/393128761 shutdown_connections 2024-09-13T15:34:50.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 -- 172.21.15.40:0/393128761 wait complete. 2024-09-13T15:34:50.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 Processor -- start 2024-09-13T15:34:50.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 -- start start 2024-09-13T15:34:50.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3980b4010 0x7fb3980b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:50.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb398147790 con 0x7fb3980b4010 2024-09-13T15:34:50.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3980b4010 0x7fb3980b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:50.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3980b4010 0x7fb3980b81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47694/0 (socket says 172.21.15.40:47694) 2024-09-13T15:34:50.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39659c640 1 -- 172.21.15.40:0/4036634586 learned_addr learned my addr 172.21.15.40:0/4036634586 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:50.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39659c640 1 -- 172.21.15.40:0/4036634586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb388009420 con 0x7fb3980b4010 2024-09-13T15:34:50.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39659c640 1 --2- 172.21.15.40:0/4036634586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3980b4010 0x7fb3980b81b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb3880ae040 tx=0x7fb3880191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:50.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb386ffd640 1 -- 172.21.15.40:0/4036634586 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3880b4540 con 0x7fb3980b4010 2024-09-13T15:34:50.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb386ffd640 1 -- 172.21.15.40:0/4036634586 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3880b46a0 con 0x7fb3980b4010 2024-09-13T15:34:50.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb386ffd640 1 -- 172.21.15.40:0/4036634586 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb3880b4980 con 0x7fb3980b4010 2024-09-13T15:34:50.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 -- 172.21.15.40:0/4036634586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3980b88b0 con 0x7fb3980b4010 2024-09-13T15:34:50.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.587+0000 7fb39c8c2640 1 -- 172.21.15.40:0/4036634586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb398140a30 con 0x7fb3980b4010 2024-09-13T15:34:50.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.591+0000 7fb386ffd640 1 -- 172.21.15.40:0/4036634586 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fb3880b2040 con 0x7fb3980b4010 2024-09-13T15:34:50.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.591+0000 7fb39c8c2640 1 -- 172.21.15.40:0/4036634586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3980b86f0 con 0x7fb3980b4010 2024-09-13T15:34:50.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.591+0000 7fb386ffd640 1 --2- 172.21.15.40:0/4036634586 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fb3780354a0 0x7fb378037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:50.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.591+0000 7fb386ffd640 1 -- 172.21.15.40:0/4036634586 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7fb3880e1b00 con 0x7fb3980b4010 2024-09-13T15:34:50.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.591+0000 7fb395d9b640 1 --2- 172.21.15.40:0/4036634586 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fb3780354a0 0x7fb378037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:50.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.591+0000 7fb395d9b640 1 --2- 172.21.15.40:0/4036634586 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fb3780354a0 0x7fb378037960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb38c001610 tx=0x7fb38c007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:50.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.595+0000 7fb386ffd640 1 -- 172.21.15.40:0/4036634586 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb3880b4e60 con 0x7fb3980b4010 2024-09-13T15:34:50.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.747+0000 7fb39c8c2640 1 -- 172.21.15.40:0/4036634586 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3980a4d70 con 0x7fb3980b4010 2024-09-13T15:34:50.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.751+0000 7fb386ffd640 1 -- 172.21.15.40:0/4036634586 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3880b0020 con 0x7fb3980b4010 2024-09-13T15:34:50.752 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-09-13T15:34:50.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.751+0000 7fb39c8c2640 1 -- 172.21.15.40:0/4036634586 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fb3780354a0 msgr2=0x7fb378037960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.751+0000 7fb39c8c2640 1 --2- 172.21.15.40:0/4036634586 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fb3780354a0 0x7fb378037960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb38c001610 tx=0x7fb38c007ad0 comp rx=0 tx=0).stop 2024-09-13T15:34:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.751+0000 7fb39c8c2640 1 -- 172.21.15.40:0/4036634586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3980b4010 msgr2=0x7fb3980b81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.751+0000 7fb39c8c2640 1 --2- 172.21.15.40:0/4036634586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3980b4010 0x7fb3980b81b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb3880ae040 tx=0x7fb3880191c0 comp rx=0 tx=0).stop 2024-09-13T15:34:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.751+0000 7fb39c8c2640 1 -- 172.21.15.40:0/4036634586 shutdown_connections 2024-09-13T15:34:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.751+0000 7fb39c8c2640 1 --2- 172.21.15.40:0/4036634586 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fb3780354a0 0x7fb378037960 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.751+0000 7fb39c8c2640 1 --2- 172.21.15.40:0/4036634586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb3980b4010 0x7fb3980b81b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.751+0000 7fb39c8c2640 1 -- 172.21.15.40:0/4036634586 >> 172.21.15.40:0/4036634586 conn(0x7fb39806a540 msgr2=0x7fb39806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.751+0000 7fb39c8c2640 1 -- 172.21.15.40:0/4036634586 shutdown_connections 2024-09-13T15:34:50.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.751+0000 7fb39c8c2640 1 -- 172.21.15.40:0/4036634586 wait complete. 2024-09-13T15:34:50.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:34:50.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.875+0000 7f944d046640 1 Processor -- start 2024-09-13T15:34:50.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.875+0000 7f944d046640 1 -- start start 2024-09-13T15:34:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.879+0000 7f944d046640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94480b4600 0x7f944814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.879+0000 7f944d046640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94480c1130 con 0x7f944814e280 2024-09-13T15:34:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.879+0000 7f944d046640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944814e780 con 0x7f94480b4600 2024-09-13T15:34:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.879+0000 7f9446d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94480b4600 0x7f944814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.879+0000 7f9446d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94480b4600 0x7f944814dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47698/0 (socket says 172.21.15.40:47698) 2024-09-13T15:34:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.879+0000 7f9446d9d640 1 -- 172.21.15.40:0/3079898926 learned_addr learned my addr 172.21.15.40:0/3079898926 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.879+0000 7f9446d9d640 1 -- 172.21.15.40:0/3079898926 >> v1:172.21.15.40:6789/0 conn(0x7f944814e280 legacy=0x7f94480bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:50.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.879+0000 7f9446d9d640 1 -- 172.21.15.40:0/3079898926 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94480b59f0 con 0x7f94480b4600 2024-09-13T15:34:50.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f9446d9d640 1 --2- 172.21.15.40:0/3079898926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94480b4600 0x7f944814dd40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f94380097f0 tx=0x7f943801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0c68cec13a5056 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:50.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f9445d9b640 1 -- 172.21.15.40:0/3079898926 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94380ab530 con 0x7f94480b4600 2024-09-13T15:34:50.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f9445d9b640 1 -- 172.21.15.40:0/3079898926 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94380a7050 con 0x7f94480b4600 2024-09-13T15:34:50.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f9445d9b640 1 -- 172.21.15.40:0/3079898926 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94380ab7e0 con 0x7f94480b4600 2024-09-13T15:34:50.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f944d046640 1 -- 172.21.15.40:0/3079898926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94480b4600 msgr2=0x7f944814dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:50.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f944d046640 1 --2- 172.21.15.40:0/3079898926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94480b4600 0x7f944814dd40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f94380097f0 tx=0x7f943801c450 comp rx=0 tx=0).stop 2024-09-13T15:34:50.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f944d046640 1 -- 172.21.15.40:0/3079898926 shutdown_connections 2024-09-13T15:34:50.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f944d046640 1 --2- 172.21.15.40:0/3079898926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94480b4600 0x7f944814dd40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:50.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f944d046640 1 -- 172.21.15.40:0/3079898926 >> 172.21.15.40:0/3079898926 conn(0x7f944806a540 msgr2=0x7f94480a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:50.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f944d046640 1 -- 172.21.15.40:0/3079898926 shutdown_connections 2024-09-13T15:34:50.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f944d046640 1 -- 172.21.15.40:0/3079898926 wait complete. 2024-09-13T15:34:50.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f944d046640 1 Processor -- start 2024-09-13T15:34:50.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f944d046640 1 -- start start 2024-09-13T15:34:50.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.883+0000 7f944d046640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94480b4600 0x7f94481f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:50.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f944d046640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94480ba3b0 con 0x7f94480b4600 2024-09-13T15:34:50.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f9446d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94480b4600 0x7f94481f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:50.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f9446d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94480b4600 0x7f94481f2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47704/0 (socket says 172.21.15.40:47704) 2024-09-13T15:34:50.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f9446d9d640 1 -- 172.21.15.40:0/2236713391 learned_addr learned my addr 172.21.15.40:0/2236713391 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:50.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f9446d9d640 1 -- 172.21.15.40:0/2236713391 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94380094d0 con 0x7f94480b4600 2024-09-13T15:34:50.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f9446d9d640 1 --2- 172.21.15.40:0/2236713391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94480b4600 0x7f94481f2f00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f943801a080 tx=0x7f94380191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:50.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f943f7fe640 1 -- 172.21.15.40:0/2236713391 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94380b4440 con 0x7f94480b4600 2024-09-13T15:34:50.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f943f7fe640 1 -- 172.21.15.40:0/2236713391 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94380b45a0 con 0x7f94480b4600 2024-09-13T15:34:50.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f943f7fe640 1 -- 172.21.15.40:0/2236713391 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94380b4880 con 0x7f94480b4600 2024-09-13T15:34:50.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f944d046640 1 -- 172.21.15.40:0/2236713391 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94480b93a0 con 0x7f94480b4600 2024-09-13T15:34:50.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f944d046640 1 -- 172.21.15.40:0/2236713391 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94480b8a20 con 0x7f94480b4600 2024-09-13T15:34:50.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f943f7fe640 1 -- 172.21.15.40:0/2236713391 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f94380b2070 con 0x7f94480b4600 2024-09-13T15:34:50.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f944d046640 1 -- 172.21.15.40:0/2236713391 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944814ac90 con 0x7f94480b4600 2024-09-13T15:34:50.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f943f7fe640 1 --2- 172.21.15.40:0/2236713391 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9428035450 0x7f9428037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:50.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f943f7fe640 1 -- 172.21.15.40:0/2236713391 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f94380e1790 con 0x7f94480b4600 2024-09-13T15:34:50.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f944659c640 1 --2- 172.21.15.40:0/2236713391 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9428035450 0x7f9428037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:50.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.887+0000 7f944659c640 1 --2- 172.21.15.40:0/2236713391 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9428035450 0x7f9428037910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9430000f70 tx=0x7f9430007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:50.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:50.891+0000 7f943f7fe640 1 -- 172.21.15.40:0/2236713391 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f94380c48f0 con 0x7f94480b4600 2024-09-13T15:34:51.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.083+0000 7f944d046640 1 -- 172.21.15.40:0/2236713391 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94480b8d20 con 0x7f94480b4600 2024-09-13T15:34:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.083+0000 7f943f7fe640 1 -- 172.21.15.40:0/2236713391 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5484 (secure 0 0 0) 0x7f94380b8020 con 0x7f94480b4600 2024-09-13T15:34:51.087 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:51.088 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4148,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6827/1054435232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1054435232},{"type":"v1","addr":"172.21.15.40:6827","nonce":1054435232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6829/3516561034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3516561034},{"type":"v1","addr":"172.21.15.40:6829","nonce":3516561034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6832/3545499514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6831","nonce":3545499514},{"type":"v1","addr":"172.21.15.40:6832","nonce":3545499514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4151,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3266942466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3266942466},{"type":"v1","addr":"172.21.15.40:6833","nonce":3266942466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:34:35.292383+0000","modified":"2024-09-13T15:34:38.300209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4153":{"gid":4153,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3668838086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3668838086},{"type":"v1","addr":"172.21.15.40:6835","nonce":3668838086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:34:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-13T15:34:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.087+0000 7f944d046640 1 -- 172.21.15.40:0/2236713391 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9428035450 msgr2=0x7f9428037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.087+0000 7f944d046640 1 --2- 172.21.15.40:0/2236713391 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9428035450 0x7f9428037910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9430000f70 tx=0x7f9430007a40 comp rx=0 tx=0).stop 2024-09-13T15:34:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.087+0000 7f944d046640 1 -- 172.21.15.40:0/2236713391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94480b4600 msgr2=0x7f94481f2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.087+0000 7f944d046640 1 --2- 172.21.15.40:0/2236713391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94480b4600 0x7f94481f2f00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f943801a080 tx=0x7f94380191f0 comp rx=0 tx=0).stop 2024-09-13T15:34:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.087+0000 7f944d046640 1 -- 172.21.15.40:0/2236713391 shutdown_connections 2024-09-13T15:34:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.087+0000 7f944d046640 1 --2- 172.21.15.40:0/2236713391 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f9428035450 0x7f9428037910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.087+0000 7f944d046640 1 --2- 172.21.15.40:0/2236713391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94480b4600 0x7f94481f2f00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:51.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.087+0000 7f944d046640 1 -- 172.21.15.40:0/2236713391 >> 172.21.15.40:0/2236713391 conn(0x7f944806a540 msgr2=0x7f944814f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:51.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.087+0000 7f944d046640 1 -- 172.21.15.40:0/2236713391 shutdown_connections 2024-09-13T15:34:51.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.087+0000 7f944d046640 1 -- 172.21.15.40:0/2236713391 wait complete. 2024-09-13T15:34:51.105 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:51.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.215+0000 7f0fd82c5640 1 Processor -- start 2024-09-13T15:34:51.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.215+0000 7f0fd82c5640 1 -- start start 2024-09-13T15:34:51.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd82c5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fd00bebb0 0x7f0fd00a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:51.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd82c5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd01515b0 con 0x7f0fd00b4010 2024-09-13T15:34:51.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd82c5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd014e2c0 con 0x7f0fd00bebb0 2024-09-13T15:34:51.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd5860640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0fd00b4010 0x7f0fd006e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38852/0 (socket says 172.21.15.40:38852) 2024-09-13T15:34:51.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd6061640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0fd00bebb0 0x7f0fd00a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:51.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd5860640 1 -- 172.21.15.40:0/175428341 learned_addr learned my addr 172.21.15.40:0/175428341 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:51.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd6061640 1 -- 172.21.15.40:0/175428341 >> v1:172.21.15.40:6789/0 conn(0x7f0fd00b4010 legacy=0x7f0fd006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:51.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd6061640 1 -- 172.21.15.40:0/175428341 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd006f830 con 0x7f0fd00bebb0 2024-09-13T15:34:51.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd505f640 1 -- 172.21.15.40:0/175428341 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700691692 0 0) 0x7f0fd01515b0 con 0x7f0fd00b4010 2024-09-13T15:34:51.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd6061640 1 --2- 172.21.15.40:0/175428341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd00bebb0 0x7f0fd00a4d70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc009740 tx=0x7f0fcc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fdf693ee99cdba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:51.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd505f640 1 -- 172.21.15.40:0/175428341 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fd00b6bc0 con 0x7f0fd00bebb0 2024-09-13T15:34:51.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd505f640 1 -- 172.21.15.40:0/175428341 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc0a7050 con 0x7f0fd00bebb0 2024-09-13T15:34:51.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.219+0000 7f0fd505f640 1 -- 172.21.15.40:0/175428341 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fcc0ab680 con 0x7f0fd00bebb0 2024-09-13T15:34:51.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 -- 172.21.15.40:0/175428341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd00bebb0 msgr2=0x7f0fd00a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:51.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 --2- 172.21.15.40:0/175428341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd00bebb0 0x7f0fd00a4d70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc009740 tx=0x7f0fcc01c420 comp rx=0 tx=0).stop 2024-09-13T15:34:51.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 -- 172.21.15.40:0/175428341 shutdown_connections 2024-09-13T15:34:51.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 --2- 172.21.15.40:0/175428341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd00bebb0 0x7f0fd00a4d70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:51.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 -- 172.21.15.40:0/175428341 >> 172.21.15.40:0/175428341 conn(0x7f0fd006a540 msgr2=0x7f0fd00a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:51.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 -- 172.21.15.40:0/175428341 shutdown_connections 2024-09-13T15:34:51.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 -- 172.21.15.40:0/175428341 wait complete. 2024-09-13T15:34:51.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 Processor -- start 2024-09-13T15:34:51.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 -- start start 2024-09-13T15:34:51.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd00b4010 0x7f0fd00bb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:51.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd014b960 con 0x7f0fd00b4010 2024-09-13T15:34:51.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd6061640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd00b4010 0x7f0fd00bb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:51.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd6061640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd00b4010 0x7f0fd00bb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47730/0 (socket says 172.21.15.40:47730) 2024-09-13T15:34:51.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd6061640 1 -- 172.21.15.40:0/3462247259 learned_addr learned my addr 172.21.15.40:0/3462247259 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:51.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd6061640 1 -- 172.21.15.40:0/3462247259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc009420 con 0x7f0fd00b4010 2024-09-13T15:34:51.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd6061640 1 --2- 172.21.15.40:0/3462247259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd00b4010 0x7f0fd00bb900 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0ae040 tx=0x7f0fcc01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fc6ffd640 1 -- 172.21.15.40:0/3462247259 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fcc0b7580 con 0x7f0fd00b4010 2024-09-13T15:34:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fc6ffd640 1 -- 172.21.15.40:0/3462247259 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc0b76e0 con 0x7f0fd00b4010 2024-09-13T15:34:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fc6ffd640 1 -- 172.21.15.40:0/3462247259 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0fcc0b79c0 con 0x7f0fd00b4010 2024-09-13T15:34:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 -- 172.21.15.40:0/3462247259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd00b7910 con 0x7f0fd00b4010 2024-09-13T15:34:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.223+0000 7f0fd82c5640 1 -- 172.21.15.40:0/3462247259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd0147700 con 0x7f0fd00b4010 2024-09-13T15:34:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.227+0000 7f0fc6ffd640 1 -- 172.21.15.40:0/3462247259 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f0fcc0b7b20 con 0x7f0fd00b4010 2024-09-13T15:34:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.227+0000 7f0fc6ffd640 1 --2- 172.21.15.40:0/3462247259 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0fb4035450 0x7f0fb4037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.227+0000 7f0fd82c5640 1 -- 172.21.15.40:0/3462247259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd00a4d70 con 0x7f0fd00b4010 2024-09-13T15:34:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.227+0000 7f0fc6ffd640 1 -- 172.21.15.40:0/3462247259 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f0fcc0e2200 con 0x7f0fd00b4010 2024-09-13T15:34:51.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.227+0000 7f0fd5860640 1 --2- 172.21.15.40:0/3462247259 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0fb4035450 0x7f0fb4037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:51.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.227+0000 7f0fd5860640 1 --2- 172.21.15.40:0/3462247259 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0fb4035450 0x7f0fb4037910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0007fd0 tx=0x7f0fc0007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:51.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.231+0000 7f0fc6ffd640 1 -- 172.21.15.40:0/3462247259 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0fcc0bb020 con 0x7f0fd00b4010 2024-09-13T15:34:51.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.391+0000 7f0fd82c5640 1 -- 172.21.15.40:0/3462247259 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fd00a3d10 con 0x7f0fd00b4010 2024-09-13T15:34:51.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.391+0000 7f0fc6ffd640 1 -- 172.21.15.40:0/3462247259 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+10503 (secure 0 0 0) 0x7f0fcc0b0070 con 0x7f0fd00b4010 2024-09-13T15:34:51.394 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:51.394 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:36.294490+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:51.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.395+0000 7f0fd82c5640 1 -- 172.21.15.40:0/3462247259 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0fb4035450 msgr2=0x7f0fb4037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.395+0000 7f0fd82c5640 1 --2- 172.21.15.40:0/3462247259 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0fb4035450 0x7f0fb4037910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0007fd0 tx=0x7f0fc0007920 comp rx=0 tx=0).stop 2024-09-13T15:34:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.395+0000 7f0fd82c5640 1 -- 172.21.15.40:0/3462247259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd00b4010 msgr2=0x7f0fd00bb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.395+0000 7f0fd82c5640 1 --2- 172.21.15.40:0/3462247259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd00b4010 0x7f0fd00bb900 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0ae040 tx=0x7f0fcc01ac60 comp rx=0 tx=0).stop 2024-09-13T15:34:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.395+0000 7f0fd82c5640 1 -- 172.21.15.40:0/3462247259 shutdown_connections 2024-09-13T15:34:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.395+0000 7f0fd82c5640 1 --2- 172.21.15.40:0/3462247259 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f0fb4035450 0x7f0fb4037910 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.395+0000 7f0fd82c5640 1 --2- 172.21.15.40:0/3462247259 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0fd00b4010 0x7f0fd00bb900 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.395+0000 7f0fd82c5640 1 -- 172.21.15.40:0/3462247259 >> 172.21.15.40:0/3462247259 conn(0x7f0fd006a540 msgr2=0x7f0fd00b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.395+0000 7f0fd82c5640 1 -- 172.21.15.40:0/3462247259 shutdown_connections 2024-09-13T15:34:51.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.395+0000 7f0fd82c5640 1 -- 172.21.15.40:0/3462247259 wait complete. 2024-09-13T15:34:51.412 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:34:25.125767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:34:33.833957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:34:34.276037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3600000143051147, 'score_stable': 1.3600000143051147, 'optimal_score': 1, 'raw_score_acting': 1.3600000143051147, 'raw_score_stable': 1.3600000143051147, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:34:51.412 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:34:51.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.527+0000 7ffbb85d3640 1 Processor -- start 2024-09-13T15:34:51.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.527+0000 7ffbb85d3640 1 -- start start 2024-09-13T15:34:51.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.531+0000 7ffbb85d3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffbb00bebb0 0x7ffbb00a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:51.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.531+0000 7ffbb85d3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb01515b0 con 0x7ffbb00b4010 2024-09-13T15:34:51.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.531+0000 7ffbb85d3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb014e2c0 con 0x7ffbb00bebb0 2024-09-13T15:34:51.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.531+0000 7ffbb636f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffbb00bebb0 0x7ffbb00a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:51.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.531+0000 7ffbb5b6e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ffbb00b4010 0x7ffbb006e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38854/0 (socket says 172.21.15.40:38854) 2024-09-13T15:34:51.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.531+0000 7ffbb5b6e640 1 -- 172.21.15.40:0/3046019105 learned_addr learned my addr 172.21.15.40:0/3046019105 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:51.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.531+0000 7ffbb536d640 1 -- 172.21.15.40:0/3046019105 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835567448 0 0) 0x7ffbb01515b0 con 0x7ffbb00b4010 2024-09-13T15:34:51.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.531+0000 7ffbb536d640 1 -- 172.21.15.40:0/3046019105 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb98003530 con 0x7ffbb00b4010 2024-09-13T15:34:51.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.531+0000 7ffbb636f640 1 -- 172.21.15.40:0/3046019105 >> v1:172.21.15.40:6789/0 conn(0x7ffbb00b4010 legacy=0x7ffbb006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:51.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.531+0000 7ffbb636f640 1 -- 172.21.15.40:0/3046019105 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb006f830 con 0x7ffbb00bebb0 2024-09-13T15:34:51.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.531+0000 7ffbb636f640 1 --2- 172.21.15.40:0/3046019105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbb00bebb0 0x7ffbb00a4d70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009d90 tx=0x7ffba001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec23c62690c8f3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:51.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.531+0000 7ffbb536d640 1 -- 172.21.15.40:0/3046019105 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbb00b6bc0 con 0x7ffbb00bebb0 2024-09-13T15:34:51.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb536d640 1 -- 172.21.15.40:0/3046019105 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba00a56e0 con 0x7ffbb00bebb0 2024-09-13T15:34:51.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb536d640 1 -- 172.21.15.40:0/3046019105 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffba00a5980 con 0x7ffbb00bebb0 2024-09-13T15:34:51.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 -- 172.21.15.40:0/3046019105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbb00bebb0 msgr2=0x7ffbb00a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:51.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 --2- 172.21.15.40:0/3046019105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbb00bebb0 0x7ffbb00a4d70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffba0009d90 tx=0x7ffba001c970 comp rx=0 tx=0).stop 2024-09-13T15:34:51.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 -- 172.21.15.40:0/3046019105 shutdown_connections 2024-09-13T15:34:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 --2- 172.21.15.40:0/3046019105 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbb00bebb0 0x7ffbb00a4d70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 -- 172.21.15.40:0/3046019105 >> 172.21.15.40:0/3046019105 conn(0x7ffbb006a540 msgr2=0x7ffbb00a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 -- 172.21.15.40:0/3046019105 shutdown_connections 2024-09-13T15:34:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 -- 172.21.15.40:0/3046019105 wait complete. 2024-09-13T15:34:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 Processor -- start 2024-09-13T15:34:51.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 -- start start 2024-09-13T15:34:51.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbb00b4010 0x7ffbb0150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:51.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb0150c90 con 0x7ffbb00b4010 2024-09-13T15:34:51.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb636f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbb00b4010 0x7ffbb0150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:51.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb636f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbb00b4010 0x7ffbb0150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47738/0 (socket says 172.21.15.40:47738) 2024-09-13T15:34:51.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb636f640 1 -- 172.21.15.40:0/2530783460 learned_addr learned my addr 172.21.15.40:0/2530783460 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:51.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb636f640 1 -- 172.21.15.40:0/2530783460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba0009a70 con 0x7ffbb00b4010 2024-09-13T15:34:51.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb636f640 1 --2- 172.21.15.40:0/2530783460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbb00b4010 0x7ffbb0150750 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffba001a5a0 tx=0x7ffba0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:51.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbaeffd640 1 -- 172.21.15.40:0/2530783460 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffba00a6da0 con 0x7ffbb00b4010 2024-09-13T15:34:51.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbaeffd640 1 -- 172.21.15.40:0/2530783460 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba0004040 con 0x7ffbb00b4010 2024-09-13T15:34:51.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 -- 172.21.15.40:0/2530783460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb0142f10 con 0x7ffbb00b4010 2024-09-13T15:34:51.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbaeffd640 1 -- 172.21.15.40:0/2530783460 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffba00042e0 con 0x7ffbb00b4010 2024-09-13T15:34:51.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.535+0000 7ffbb85d3640 1 -- 172.21.15.40:0/2530783460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb00b81b0 con 0x7ffbb00b4010 2024-09-13T15:34:51.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.539+0000 7ffbb85d3640 1 -- 172.21.15.40:0/2530783460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb00a4d70 con 0x7ffbb00b4010 2024-09-13T15:34:51.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.539+0000 7ffbaeffd640 1 -- 172.21.15.40:0/2530783460 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7ffba0004440 con 0x7ffbb00b4010 2024-09-13T15:34:51.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.539+0000 7ffbaeffd640 1 --2- 172.21.15.40:0/2530783460 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ffb9c035450 0x7ffb9c037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:51.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.539+0000 7ffbaeffd640 1 -- 172.21.15.40:0/2530783460 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7ffba00e2bc0 con 0x7ffbb00b4010 2024-09-13T15:34:51.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.539+0000 7ffbb5b6e640 1 --2- 172.21.15.40:0/2530783460 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ffb9c035450 0x7ffb9c037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:51.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.539+0000 7ffbb5b6e640 1 --2- 172.21.15.40:0/2530783460 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ffb9c035450 0x7ffb9c037910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffba4007fd0 tx=0x7ffba4007980 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:51.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.543+0000 7ffbaeffd640 1 -- 172.21.15.40:0/2530783460 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffba00b9450 con 0x7ffbb00b4010 2024-09-13T15:34:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.695+0000 7ffbb85d3640 1 -- 172.21.15.40:0/2530783460 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffbb0066920 con 0x7ffbb00b4010 2024-09-13T15:34:51.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.699+0000 7ffbaeffd640 1 -- 172.21.15.40:0/2530783460 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffba00b2070 con 0x7ffbb00b4010 2024-09-13T15:34:51.700 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-09-13T15:34:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.699+0000 7ffbb85d3640 1 -- 172.21.15.40:0/2530783460 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ffb9c035450 msgr2=0x7ffb9c037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.699+0000 7ffbb85d3640 1 --2- 172.21.15.40:0/2530783460 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ffb9c035450 0x7ffb9c037910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffba4007fd0 tx=0x7ffba4007980 comp rx=0 tx=0).stop 2024-09-13T15:34:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.699+0000 7ffbb85d3640 1 -- 172.21.15.40:0/2530783460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbb00b4010 msgr2=0x7ffbb0150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.699+0000 7ffbb85d3640 1 --2- 172.21.15.40:0/2530783460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbb00b4010 0x7ffbb0150750 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffba001a5a0 tx=0x7ffba0019710 comp rx=0 tx=0).stop 2024-09-13T15:34:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.699+0000 7ffbb85d3640 1 -- 172.21.15.40:0/2530783460 shutdown_connections 2024-09-13T15:34:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.699+0000 7ffbb85d3640 1 --2- 172.21.15.40:0/2530783460 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7ffb9c035450 0x7ffb9c037910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.699+0000 7ffbb85d3640 1 --2- 172.21.15.40:0/2530783460 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffbb00b4010 0x7ffbb0150750 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.699+0000 7ffbb85d3640 1 -- 172.21.15.40:0/2530783460 >> 172.21.15.40:0/2530783460 conn(0x7ffbb006a540 msgr2=0x7ffbb01478a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.699+0000 7ffbb85d3640 1 -- 172.21.15.40:0/2530783460 shutdown_connections 2024-09-13T15:34:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.699+0000 7ffbb85d3640 1 -- 172.21.15.40:0/2530783460 wait complete. 2024-09-13T15:34:51.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:34:51.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.835+0000 7f4909ce3640 1 Processor -- start 2024-09-13T15:34:51.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.835+0000 7f4909ce3640 1 -- start start 2024-09-13T15:34:51.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.835+0000 7f4909ce3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f49040bebb0 0x7f49040a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:51.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.835+0000 7f4909ce3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49041515b0 con 0x7f49040b4010 2024-09-13T15:34:51.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.835+0000 7f4909ce3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490414e2c0 con 0x7f49040bebb0 2024-09-13T15:34:51.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f49037fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f49040bebb0 0x7f49040a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:51.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f49037fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f49040bebb0 0x7f49040a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47740/0 (socket says 172.21.15.40:47740) 2024-09-13T15:34:51.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f4902ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f49040b4010 0x7f490406e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38858/0 (socket says 172.21.15.40:38858) 2024-09-13T15:34:51.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f49037fe640 1 -- 172.21.15.40:0/2106408903 learned_addr learned my addr 172.21.15.40:0/2106408903 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:51.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f49037fe640 1 -- 172.21.15.40:0/2106408903 >> v1:172.21.15.40:6789/0 conn(0x7f49040b4010 legacy=0x7f490406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:51.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f49037fe640 1 -- 172.21.15.40:0/2106408903 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490406f830 con 0x7f49040bebb0 2024-09-13T15:34:51.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f49027fc640 1 -- 172.21.15.40:0/2106408903 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086092750 0 0) 0x7f49041515b0 con 0x7f49040b4010 2024-09-13T15:34:51.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f49037fe640 1 --2- 172.21.15.40:0/2106408903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040bebb0 0x7f49040a4d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f48f40097f0 tx=0x7f48f401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bd25fae91fe6ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:51.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f49027fc640 1 -- 172.21.15.40:0/2106408903 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f49040b6bc0 con 0x7f49040bebb0 2024-09-13T15:34:51.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f49027fc640 1 -- 172.21.15.40:0/2106408903 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f40a7050 con 0x7f49040bebb0 2024-09-13T15:34:51.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f49027fc640 1 -- 172.21.15.40:0/2106408903 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48f40ab680 con 0x7f49040bebb0 2024-09-13T15:34:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f4909ce3640 1 -- 172.21.15.40:0/2106408903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040bebb0 msgr2=0x7f49040a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f4909ce3640 1 --2- 172.21.15.40:0/2106408903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040bebb0 0x7f49040a4d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f48f40097f0 tx=0x7f48f401c4e0 comp rx=0 tx=0).stop 2024-09-13T15:34:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f4909ce3640 1 -- 172.21.15.40:0/2106408903 shutdown_connections 2024-09-13T15:34:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f4909ce3640 1 --2- 172.21.15.40:0/2106408903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040bebb0 0x7f49040a4d70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f4909ce3640 1 -- 172.21.15.40:0/2106408903 >> 172.21.15.40:0/2106408903 conn(0x7f490406a540 msgr2=0x7f49040a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f4909ce3640 1 -- 172.21.15.40:0/2106408903 shutdown_connections 2024-09-13T15:34:51.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.839+0000 7f4909ce3640 1 -- 172.21.15.40:0/2106408903 wait complete. 2024-09-13T15:34:51.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f4909ce3640 1 Processor -- start 2024-09-13T15:34:51.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f4909ce3640 1 -- start start 2024-09-13T15:34:51.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f4909ce3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040b4010 0x7f4904070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:51.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f4909ce3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490415f5c0 con 0x7f49040b4010 2024-09-13T15:34:51.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f49037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040b4010 0x7f4904070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:51.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f49037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040b4010 0x7f4904070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47742/0 (socket says 172.21.15.40:47742) 2024-09-13T15:34:51.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f49037fe640 1 -- 172.21.15.40:0/2823062359 learned_addr learned my addr 172.21.15.40:0/2823062359 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:51.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f49037fe640 1 -- 172.21.15.40:0/2823062359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f40094d0 con 0x7f49040b4010 2024-09-13T15:34:51.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f49037fe640 1 --2- 172.21.15.40:0/2823062359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040b4010 0x7f4904070c90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f48f401a110 tx=0x7f48f401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:51.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f48ebfff640 1 -- 172.21.15.40:0/2823062359 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48f40b6550 con 0x7f49040b4010 2024-09-13T15:34:51.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f48ebfff640 1 -- 172.21.15.40:0/2823062359 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f40b66b0 con 0x7f49040b4010 2024-09-13T15:34:51.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f4909ce3640 1 -- 172.21.15.40:0/2823062359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49040bfc80 con 0x7f49040b4010 2024-09-13T15:34:51.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f48ebfff640 1 -- 172.21.15.40:0/2823062359 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48f40b6970 con 0x7f49040b4010 2024-09-13T15:34:51.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f4909ce3640 1 -- 172.21.15.40:0/2823062359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49040bf970 con 0x7f49040b4010 2024-09-13T15:34:51.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f48ebfff640 1 -- 172.21.15.40:0/2823062359 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f48f40b2040 con 0x7f49040b4010 2024-09-13T15:34:51.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f4909ce3640 1 -- 172.21.15.40:0/2823062359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490414f900 con 0x7f49040b4010 2024-09-13T15:34:51.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f48ebfff640 1 --2- 172.21.15.40:0/2823062359 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f48f0035450 0x7f48f0037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:51.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f48ebfff640 1 -- 172.21.15.40:0/2823062359 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f48f40e20b0 con 0x7f49040b4010 2024-09-13T15:34:51.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f4902ffd640 1 --2- 172.21.15.40:0/2823062359 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f48f0035450 0x7f48f0037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:51.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.843+0000 7f4902ffd640 1 --2- 172.21.15.40:0/2823062359 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f48f0035450 0x7f48f0037910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48f8007fd0 tx=0x7f48f8007940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:51.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.847+0000 7f48ebfff640 1 -- 172.21.15.40:0/2823062359 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f48f40b6ad0 con 0x7f49040b4010 2024-09-13T15:34:52.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:51.999+0000 7f4909ce3640 1 -- 172.21.15.40:0/2823062359 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49040a4d70 con 0x7f49040b4010 2024-09-13T15:34:52.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.003+0000 7f48ebfff640 1 -- 172.21.15.40:0/2823062359 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v16) v1 ==== 104+0+11 (secure 0 0 0) 0x7f48f40b00a0 con 0x7f49040b4010 2024-09-13T15:34:52.006 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:34:52.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.003+0000 7f4909ce3640 1 -- 172.21.15.40:0/2823062359 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f48f0035450 msgr2=0x7f48f0037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.003+0000 7f4909ce3640 1 --2- 172.21.15.40:0/2823062359 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f48f0035450 0x7f48f0037910 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48f8007fd0 tx=0x7f48f8007940 comp rx=0 tx=0).stop 2024-09-13T15:34:52.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.003+0000 7f4909ce3640 1 -- 172.21.15.40:0/2823062359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040b4010 msgr2=0x7f4904070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.003+0000 7f4909ce3640 1 --2- 172.21.15.40:0/2823062359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040b4010 0x7f4904070c90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f48f401a110 tx=0x7f48f401ad20 comp rx=0 tx=0).stop 2024-09-13T15:34:52.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.003+0000 7f4909ce3640 1 -- 172.21.15.40:0/2823062359 shutdown_connections 2024-09-13T15:34:52.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.003+0000 7f4909ce3640 1 --2- 172.21.15.40:0/2823062359 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f48f0035450 0x7f48f0037910 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:52.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.003+0000 7f4909ce3640 1 --2- 172.21.15.40:0/2823062359 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49040b4010 0x7f4904070c90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:52.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.003+0000 7f4909ce3640 1 -- 172.21.15.40:0/2823062359 >> 172.21.15.40:0/2823062359 conn(0x7f490406a540 msgr2=0x7f49040b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:52.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.003+0000 7f4909ce3640 1 -- 172.21.15.40:0/2823062359 shutdown_connections 2024-09-13T15:34:52.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.003+0000 7f4909ce3640 1 -- 172.21.15.40:0/2823062359 wait complete. 2024-09-13T15:34:52.021 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:34:52.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.147+0000 7f45be6d7640 1 Processor -- start 2024-09-13T15:34:52.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.147+0000 7f45be6d7640 1 -- start start 2024-09-13T15:34:52.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.147+0000 7f45be6d7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45b80bebb0 0x7f45b80a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:52.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.147+0000 7f45be6d7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b81515b0 con 0x7f45b80b4010 2024-09-13T15:34:52.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.147+0000 7f45be6d7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b814e2c0 con 0x7f45b80bebb0 2024-09-13T15:34:52.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.147+0000 7f45b7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45b80bebb0 0x7f45b80a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:52.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.147+0000 7f45b77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f45b80b4010 0x7f45b806e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38874/0 (socket says 172.21.15.40:38874) 2024-09-13T15:34:52.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.147+0000 7f45b77fe640 1 -- 172.21.15.40:0/3306370016 learned_addr learned my addr 172.21.15.40:0/3306370016 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:52.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.147+0000 7f45b7fff640 1 -- 172.21.15.40:0/3306370016 >> v1:172.21.15.40:6789/0 conn(0x7f45b80b4010 legacy=0x7f45b806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.147+0000 7f45b6ffd640 1 -- 172.21.15.40:0/3306370016 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114340509 0 0) 0x7f45b81515b0 con 0x7f45b80b4010 2024-09-13T15:34:52.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.147+0000 7f45b7fff640 1 -- 172.21.15.40:0/3306370016 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b806f830 con 0x7f45b80bebb0 2024-09-13T15:34:52.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45b7fff640 1 --2- 172.21.15.40:0/3306370016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45b80bebb0 0x7f45b80a4d70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009740 tx=0x7f45a801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49aab0cea3d2195a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:52.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45b6ffd640 1 -- 172.21.15.40:0/3306370016 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45b80b6bc0 con 0x7f45b80bebb0 2024-09-13T15:34:52.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45b6ffd640 1 -- 172.21.15.40:0/3306370016 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a80a7050 con 0x7f45b80bebb0 2024-09-13T15:34:52.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45b6ffd640 1 -- 172.21.15.40:0/3306370016 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45a80ab680 con 0x7f45b80bebb0 2024-09-13T15:34:52.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45be6d7640 1 -- 172.21.15.40:0/3306370016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45b80bebb0 msgr2=0x7f45b80a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45be6d7640 1 --2- 172.21.15.40:0/3306370016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45b80bebb0 0x7f45b80a4d70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009740 tx=0x7f45a801c420 comp rx=0 tx=0).stop 2024-09-13T15:34:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45be6d7640 1 -- 172.21.15.40:0/3306370016 shutdown_connections 2024-09-13T15:34:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45be6d7640 1 --2- 172.21.15.40:0/3306370016 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45b80bebb0 0x7f45b80a4d70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45be6d7640 1 -- 172.21.15.40:0/3306370016 >> 172.21.15.40:0/3306370016 conn(0x7f45b806a540 msgr2=0x7f45b80a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45be6d7640 1 -- 172.21.15.40:0/3306370016 shutdown_connections 2024-09-13T15:34:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45be6d7640 1 -- 172.21.15.40:0/3306370016 wait complete. 2024-09-13T15:34:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45be6d7640 1 Processor -- start 2024-09-13T15:34:52.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45be6d7640 1 -- start start 2024-09-13T15:34:52.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45be6d7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45b80b4010 0x7f45b8146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:52.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45be6d7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b809a980 con 0x7f45b80b4010 2024-09-13T15:34:52.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45b7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45b80b4010 0x7f45b8146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:52.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45b7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45b80b4010 0x7f45b8146610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47758/0 (socket says 172.21.15.40:47758) 2024-09-13T15:34:52.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.151+0000 7f45b7fff640 1 -- 172.21.15.40:0/3784883981 learned_addr learned my addr 172.21.15.40:0/3784883981 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:52.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45b7fff640 1 -- 172.21.15.40:0/3784883981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a8009420 con 0x7f45b80b4010 2024-09-13T15:34:52.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45b7fff640 1 --2- 172.21.15.40:0/3784883981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45b80b4010 0x7f45b8146610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45a80ae040 tx=0x7f45a801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:52.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45b4ff9640 1 -- 172.21.15.40:0/3784883981 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45a80b7580 con 0x7f45b80b4010 2024-09-13T15:34:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45b4ff9640 1 -- 172.21.15.40:0/3784883981 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a80b76e0 con 0x7f45b80b4010 2024-09-13T15:34:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45be6d7640 1 -- 172.21.15.40:0/3784883981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b80c0460 con 0x7f45b80b4010 2024-09-13T15:34:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45b4ff9640 1 -- 172.21.15.40:0/3784883981 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45a80b79c0 con 0x7f45b80b4010 2024-09-13T15:34:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45be6d7640 1 -- 172.21.15.40:0/3784883981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b814ed90 con 0x7f45b80b4010 2024-09-13T15:34:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45b4ff9640 1 -- 172.21.15.40:0/3784883981 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f45a80b7b20 con 0x7f45b80b4010 2024-09-13T15:34:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45be6d7640 1 -- 172.21.15.40:0/3784883981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b80c05f0 con 0x7f45b80b4010 2024-09-13T15:34:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45b4ff9640 1 --2- 172.21.15.40:0/3784883981 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f45980354a0 0x7f4598037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45b4ff9640 1 -- 172.21.15.40:0/3784883981 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f45a80e22c0 con 0x7f45b80b4010 2024-09-13T15:34:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45b77fe640 1 --2- 172.21.15.40:0/3784883981 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f45980354a0 0x7f4598037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.155+0000 7f45b77fe640 1 --2- 172.21.15.40:0/3784883981 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f45980354a0 0x7f4598037960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f45a0007fd0 tx=0x7f45a0007940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:52.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.159+0000 7f45b4ff9640 1 -- 172.21.15.40:0/3784883981 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f45b80c05f0 con 0x7f45b80b4010 2024-09-13T15:34:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.319+0000 7f45be6d7640 1 -- 172.21.15.40:0/3784883981 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f45b80c05f0 con 0x7f45b80b4010 2024-09-13T15:34:52.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.319+0000 7f45b4ff9640 1 -- 172.21.15.40:0/3784883981 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v16) v1 ==== 100+0+11 (secure 0 0 0) 0x7f45b80c05f0 con 0x7f45b80b4010 2024-09-13T15:34:52.320 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-09-13T15:34:52.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.319+0000 7f45be6d7640 1 -- 172.21.15.40:0/3784883981 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f45980354a0 msgr2=0x7f4598037960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.319+0000 7f45be6d7640 1 --2- 172.21.15.40:0/3784883981 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f45980354a0 0x7f4598037960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f45a0007fd0 tx=0x7f45a0007940 comp rx=0 tx=0).stop 2024-09-13T15:34:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.319+0000 7f45be6d7640 1 -- 172.21.15.40:0/3784883981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45b80b4010 msgr2=0x7f45b8146610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.319+0000 7f45be6d7640 1 --2- 172.21.15.40:0/3784883981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45b80b4010 0x7f45b8146610 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45a80ae040 tx=0x7f45a801ac60 comp rx=0 tx=0).stop 2024-09-13T15:34:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.319+0000 7f45be6d7640 1 -- 172.21.15.40:0/3784883981 shutdown_connections 2024-09-13T15:34:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.319+0000 7f45be6d7640 1 --2- 172.21.15.40:0/3784883981 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f45980354a0 0x7f4598037960 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.319+0000 7f45be6d7640 1 --2- 172.21.15.40:0/3784883981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45b80b4010 0x7f45b8146610 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.319+0000 7f45be6d7640 1 -- 172.21.15.40:0/3784883981 >> 172.21.15.40:0/3784883981 conn(0x7f45b806a540 msgr2=0x7f45b80b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.319+0000 7f45be6d7640 1 -- 172.21.15.40:0/3784883981 shutdown_connections 2024-09-13T15:34:52.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.319+0000 7f45be6d7640 1 -- 172.21.15.40:0/3784883981 wait complete. 2024-09-13T15:34:52.339 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:34:52.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.459+0000 7f02f65f8640 1 Processor -- start 2024-09-13T15:34:52.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.459+0000 7f02f65f8640 1 -- start start 2024-09-13T15:34:52.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.459+0000 7f02f65f8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02f00b4600 0x7f02f014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:52.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.459+0000 7f02f65f8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f00c1130 con 0x7f02f014e280 2024-09-13T15:34:52.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.459+0000 7f02f65f8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f014e780 con 0x7f02f00b4600 2024-09-13T15:34:52.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.459+0000 7f02effff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02f00b4600 0x7f02f014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:52.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.459+0000 7f02effff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02f00b4600 0x7f02f014dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47772/0 (socket says 172.21.15.40:47772) 2024-09-13T15:34:52.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.459+0000 7f02ef7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f02f014e280 0x7f02f00bf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38878/0 (socket says 172.21.15.40:38878) 2024-09-13T15:34:52.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.459+0000 7f02effff640 1 -- 172.21.15.40:0/1356341861 learned_addr learned my addr 172.21.15.40:0/1356341861 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:52.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.459+0000 7f02effff640 1 -- 172.21.15.40:0/1356341861 >> v1:172.21.15.40:6789/0 conn(0x7f02f014e280 legacy=0x7f02f00bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.459+0000 7f02effff640 1 -- 172.21.15.40:0/1356341861 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f00b59f0 con 0x7f02f00b4600 2024-09-13T15:34:52.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.459+0000 7f02eeffd640 1 -- 172.21.15.40:0/1356341861 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695759063 0 0) 0x7f02f00c1130 con 0x7f02f014e280 2024-09-13T15:34:52.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02effff640 1 --2- 172.21.15.40:0/1356341861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f00b4600 0x7f02f014dd40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f02e00097f0 tx=0x7f02e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacfd36df947c852 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:52.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02eeffd640 1 -- 172.21.15.40:0/1356341861 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02e00ab530 con 0x7f02f00b4600 2024-09-13T15:34:52.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02eeffd640 1 -- 172.21.15.40:0/1356341861 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e00a7050 con 0x7f02f00b4600 2024-09-13T15:34:52.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02eeffd640 1 -- 172.21.15.40:0/1356341861 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02e00ab7e0 con 0x7f02f00b4600 2024-09-13T15:34:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02f65f8640 1 -- 172.21.15.40:0/1356341861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f00b4600 msgr2=0x7f02f014dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02f65f8640 1 --2- 172.21.15.40:0/1356341861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f00b4600 0x7f02f014dd40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f02e00097f0 tx=0x7f02e001c450 comp rx=0 tx=0).stop 2024-09-13T15:34:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02f65f8640 1 -- 172.21.15.40:0/1356341861 shutdown_connections 2024-09-13T15:34:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02f65f8640 1 --2- 172.21.15.40:0/1356341861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f00b4600 0x7f02f014dd40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:52.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02f65f8640 1 -- 172.21.15.40:0/1356341861 >> 172.21.15.40:0/1356341861 conn(0x7f02f006a540 msgr2=0x7f02f00a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:52.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02f65f8640 1 -- 172.21.15.40:0/1356341861 shutdown_connections 2024-09-13T15:34:52.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02f65f8640 1 -- 172.21.15.40:0/1356341861 wait complete. 2024-09-13T15:34:52.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02f65f8640 1 Processor -- start 2024-09-13T15:34:52.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02f65f8640 1 -- start start 2024-09-13T15:34:52.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02f65f8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f00b4600 0x7f02f015f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:52.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02f65f8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00b6620 con 0x7f02f00b4600 2024-09-13T15:34:52.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02effff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f00b4600 0x7f02f015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:52.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02effff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f00b4600 0x7f02f015f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47776/0 (socket says 172.21.15.40:47776) 2024-09-13T15:34:52.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02effff640 1 -- 172.21.15.40:0/186977276 learned_addr learned my addr 172.21.15.40:0/186977276 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.463+0000 7f02effff640 1 -- 172.21.15.40:0/186977276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e00094d0 con 0x7f02f00b4600 2024-09-13T15:34:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.467+0000 7f02effff640 1 --2- 172.21.15.40:0/186977276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f00b4600 0x7f02f015f270 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f02e0019060 tx=0x7f02e001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.467+0000 7f02ecff9640 1 -- 172.21.15.40:0/186977276 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02e0004020 con 0x7f02f00b4600 2024-09-13T15:34:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.467+0000 7f02ecff9640 1 -- 172.21.15.40:0/186977276 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0004180 con 0x7f02f00b4600 2024-09-13T15:34:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.467+0000 7f02f65f8640 1 -- 172.21.15.40:0/186977276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f015cdf0 con 0x7f02f00b4600 2024-09-13T15:34:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.467+0000 7f02ecff9640 1 -- 172.21.15.40:0/186977276 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f02e0004420 con 0x7f02f00b4600 2024-09-13T15:34:52.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.467+0000 7f02f65f8640 1 -- 172.21.15.40:0/186977276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f0146e60 con 0x7f02f00b4600 2024-09-13T15:34:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.467+0000 7f02ecff9640 1 -- 172.21.15.40:0/186977276 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f02e00b2040 con 0x7f02f00b4600 2024-09-13T15:34:52.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.467+0000 7f02f65f8640 1 -- 172.21.15.40:0/186977276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f015e340 con 0x7f02f00b4600 2024-09-13T15:34:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.467+0000 7f02ecff9640 1 --2- 172.21.15.40:0/186977276 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f02dc035400 0x7f02dc0378c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.467+0000 7f02ecff9640 1 -- 172.21.15.40:0/186977276 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f02e00e16f0 con 0x7f02f00b4600 2024-09-13T15:34:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.467+0000 7f02ef7fe640 1 --2- 172.21.15.40:0/186977276 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f02dc035400 0x7f02dc0378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.467+0000 7f02ef7fe640 1 --2- 172.21.15.40:0/186977276 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f02dc035400 0x7f02dc0378c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f02e4007fd0 tx=0x7f02e4007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:52.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.471+0000 7f02ecff9640 1 -- 172.21.15.40:0/186977276 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f02e00c6710 con 0x7f02f00b4600 2024-09-13T15:34:52.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.663+0000 7f02f65f8640 1 -- 172.21.15.40:0/186977276 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02f014dd40 con 0x7f02f00b4600 2024-09-13T15:34:52.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.663+0000 7f02ecff9640 1 -- 172.21.15.40:0/186977276 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5484 (secure 0 0 0) 0x7f02e00b0020 con 0x7f02f00b4600 2024-09-13T15:34:52.667 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:52.668 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4148,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6827/1054435232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1054435232},{"type":"v1","addr":"172.21.15.40:6827","nonce":1054435232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6829/3516561034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3516561034},{"type":"v1","addr":"172.21.15.40:6829","nonce":3516561034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6832/3545499514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6831","nonce":3545499514},{"type":"v1","addr":"172.21.15.40:6832","nonce":3545499514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4151,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3266942466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3266942466},{"type":"v1","addr":"172.21.15.40:6833","nonce":3266942466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:34:35.292383+0000","modified":"2024-09-13T15:34:38.300209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4153":{"gid":4153,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3668838086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3668838086},{"type":"v1","addr":"172.21.15.40:6835","nonce":3668838086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:34:52.668 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-13T15:34:52.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.667+0000 7f02f65f8640 1 -- 172.21.15.40:0/186977276 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f02dc035400 msgr2=0x7f02dc0378c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.667+0000 7f02f65f8640 1 --2- 172.21.15.40:0/186977276 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f02dc035400 0x7f02dc0378c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f02e4007fd0 tx=0x7f02e4007920 comp rx=0 tx=0).stop 2024-09-13T15:34:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.667+0000 7f02f65f8640 1 -- 172.21.15.40:0/186977276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f00b4600 msgr2=0x7f02f015f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.667+0000 7f02f65f8640 1 --2- 172.21.15.40:0/186977276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f00b4600 0x7f02f015f270 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f02e0019060 tx=0x7f02e001ac90 comp rx=0 tx=0).stop 2024-09-13T15:34:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.667+0000 7f02f65f8640 1 -- 172.21.15.40:0/186977276 shutdown_connections 2024-09-13T15:34:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.667+0000 7f02f65f8640 1 --2- 172.21.15.40:0/186977276 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f02dc035400 0x7f02dc0378c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.667+0000 7f02f65f8640 1 --2- 172.21.15.40:0/186977276 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f00b4600 0x7f02f015f270 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.667+0000 7f02f65f8640 1 -- 172.21.15.40:0/186977276 >> 172.21.15.40:0/186977276 conn(0x7f02f006a540 msgr2=0x7f02f00b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.667+0000 7f02f65f8640 1 -- 172.21.15.40:0/186977276 shutdown_connections 2024-09-13T15:34:52.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.667+0000 7f02f65f8640 1 -- 172.21.15.40:0/186977276 wait complete. 2024-09-13T15:34:52.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:34:52.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.807+0000 7f298e49c640 1 Processor -- start 2024-09-13T15:34:52.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.807+0000 7f298e49c640 1 -- start start 2024-09-13T15:34:52.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.811+0000 7f298e49c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f298806c280 0x7f298806b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:52.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.811+0000 7f298e49c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29880b5d60 con 0x7f298806c660 2024-09-13T15:34:52.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.811+0000 7f298e49c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298814ece0 con 0x7f298806c280 2024-09-13T15:34:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.811+0000 7f2987fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f298806c280 0x7f298806b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.811+0000 7f297ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f298806c660 0x7f29880b6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38890/0 (socket says 172.21.15.40:38890) 2024-09-13T15:34:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.811+0000 7f297ffff640 1 -- 172.21.15.40:0/2631925213 learned_addr learned my addr 172.21.15.40:0/2631925213 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.811+0000 7f2987fff640 1 -- 172.21.15.40:0/2631925213 >> v1:172.21.15.40:6789/0 conn(0x7f298806c660 legacy=0x7f29880b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.811+0000 7f2987fff640 1 -- 172.21.15.40:0/2631925213 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988150970 con 0x7f298806c280 2024-09-13T15:34:52.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.811+0000 7f2987fff640 1 --2- 172.21.15.40:0/2631925213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f298806c280 0x7f298806b780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2978009740 tx=0x7f297801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c96167d70ecb8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f29877fe640 1 -- 172.21.15.40:0/2631925213 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29780ab530 con 0x7f298806c280 2024-09-13T15:34:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f29877fe640 1 -- 172.21.15.40:0/2631925213 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29780a7050 con 0x7f298806c280 2024-09-13T15:34:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f29877fe640 1 -- 172.21.15.40:0/2631925213 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29780ab7e0 con 0x7f298806c280 2024-09-13T15:34:52.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 -- 172.21.15.40:0/2631925213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f298806c280 msgr2=0x7f298806b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 --2- 172.21.15.40:0/2631925213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f298806c280 0x7f298806b780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2978009740 tx=0x7f297801c390 comp rx=0 tx=0).stop 2024-09-13T15:34:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 -- 172.21.15.40:0/2631925213 shutdown_connections 2024-09-13T15:34:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 --2- 172.21.15.40:0/2631925213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f298806c280 0x7f298806b780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 -- 172.21.15.40:0/2631925213 >> 172.21.15.40:0/2631925213 conn(0x7f29880a5440 msgr2=0x7f298806b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 -- 172.21.15.40:0/2631925213 shutdown_connections 2024-09-13T15:34:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 -- 172.21.15.40:0/2631925213 wait complete. 2024-09-13T15:34:52.817 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 Processor -- start 2024-09-13T15:34:52.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 -- start start 2024-09-13T15:34:52.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f298806c280 0x7f29880bba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:52.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298815c990 con 0x7f298806c280 2024-09-13T15:34:52.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f2987fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f298806c280 0x7f29880bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:52.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f2987fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f298806c280 0x7f29880bba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47796/0 (socket says 172.21.15.40:47796) 2024-09-13T15:34:52.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f2987fff640 1 -- 172.21.15.40:0/537811322 learned_addr learned my addr 172.21.15.40:0/537811322 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:52.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f2987fff640 1 -- 172.21.15.40:0/537811322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978009420 con 0x7f298806c280 2024-09-13T15:34:52.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f2987fff640 1 --2- 172.21.15.40:0/537811322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f298806c280 0x7f29880bba10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f29780ae040 tx=0x7f2978019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f29857fa640 1 -- 172.21.15.40:0/537811322 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29780b4540 con 0x7f298806c280 2024-09-13T15:34:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f29857fa640 1 -- 172.21.15.40:0/537811322 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29780b46a0 con 0x7f298806c280 2024-09-13T15:34:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f29857fa640 1 -- 172.21.15.40:0/537811322 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29780b4980 con 0x7f298806c280 2024-09-13T15:34:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 -- 172.21.15.40:0/537811322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29880bc050 con 0x7f298806c280 2024-09-13T15:34:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.815+0000 7f298e49c640 1 -- 172.21.15.40:0/537811322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2988146fc0 con 0x7f298806c280 2024-09-13T15:34:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.819+0000 7f29857fa640 1 -- 172.21.15.40:0/537811322 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f29780b2040 con 0x7f298806c280 2024-09-13T15:34:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.819+0000 7f298e49c640 1 -- 172.21.15.40:0/537811322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298806b780 con 0x7f298806c280 2024-09-13T15:34:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.819+0000 7f29857fa640 1 --2- 172.21.15.40:0/537811322 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f29680354a0 0x7f2968037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.819+0000 7f29857fa640 1 -- 172.21.15.40:0/537811322 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f29780e1b30 con 0x7f298806c280 2024-09-13T15:34:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.819+0000 7f297ffff640 1 --2- 172.21.15.40:0/537811322 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f29680354a0 0x7f2968037960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:52.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.819+0000 7f297ffff640 1 --2- 172.21.15.40:0/537811322 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f29680354a0 0x7f2968037960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f29880a5870 tx=0x7f2970007ad0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:52.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.823+0000 7f29857fa640 1 -- 172.21.15.40:0/537811322 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f29780b4e60 con 0x7f298806c280 2024-09-13T15:34:52.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.983+0000 7f298e49c640 1 -- 172.21.15.40:0/537811322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2988073450 con 0x7f298806c280 2024-09-13T15:34:52.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.983+0000 7f29857fa640 1 -- 172.21.15.40:0/537811322 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+10503 (secure 0 0 0) 0x7f29780b0020 con 0x7f298806c280 2024-09-13T15:34:52.986 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:52.987 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":16,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:34:36.294490+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3600000143051147,"score_stable":1.3600000143051147,"optimal_score":1,"raw_score_acting":1.3600000143051147,"raw_score_stable":1.3600000143051147,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:34:52.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.987+0000 7f298e49c640 1 -- 172.21.15.40:0/537811322 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f29680354a0 msgr2=0x7f2968037960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.987+0000 7f298e49c640 1 --2- 172.21.15.40:0/537811322 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f29680354a0 0x7f2968037960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f29880a5870 tx=0x7f2970007ad0 comp rx=0 tx=0).stop 2024-09-13T15:34:52.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.987+0000 7f298e49c640 1 -- 172.21.15.40:0/537811322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f298806c280 msgr2=0x7f29880bba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:52.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.987+0000 7f298e49c640 1 --2- 172.21.15.40:0/537811322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f298806c280 0x7f29880bba10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f29780ae040 tx=0x7f2978019130 comp rx=0 tx=0).stop 2024-09-13T15:34:52.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.987+0000 7f298e49c640 1 -- 172.21.15.40:0/537811322 shutdown_connections 2024-09-13T15:34:52.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.987+0000 7f298e49c640 1 --2- 172.21.15.40:0/537811322 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f29680354a0 0x7f2968037960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:52.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.987+0000 7f298e49c640 1 --2- 172.21.15.40:0/537811322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f298806c280 0x7f29880bba10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:52.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.987+0000 7f298e49c640 1 -- 172.21.15.40:0/537811322 >> 172.21.15.40:0/537811322 conn(0x7f29880a5440 msgr2=0x7f29880c1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:52.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.987+0000 7f298e49c640 1 -- 172.21.15.40:0/537811322 shutdown_connections 2024-09-13T15:34:52.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:52.987+0000 7f298e49c640 1 -- 172.21.15.40:0/537811322 wait complete. 2024-09-13T15:34:53.005 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:34:53.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.115+0000 7f50e786d640 1 Processor -- start 2024-09-13T15:34:53.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.115+0000 7f50e786d640 1 -- start start 2024-09-13T15:34:53.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.115+0000 7f50e786d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50e0151380 0x7f50e006a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:53.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.115+0000 7f50e786d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e00b6d60 con 0x7f50e0069f20 2024-09-13T15:34:53.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.115+0000 7f50e786d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e00b7b60 con 0x7f50e0151380 2024-09-13T15:34:53.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.115+0000 7f50e4e08640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50e0151380 0x7f50e006a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:53.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.115+0000 7f50e5609640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f50e0069f20 0x7f50e00b62b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38898/0 (socket says 172.21.15.40:38898) 2024-09-13T15:34:53.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.115+0000 7f50e4e08640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50e0151380 0x7f50e006a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47804/0 (socket says 172.21.15.40:47804) 2024-09-13T15:34:53.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.115+0000 7f50e5609640 1 -- 172.21.15.40:0/1797184079 learned_addr learned my addr 172.21.15.40:0/1797184079 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:53.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.115+0000 7f50e4e08640 1 -- 172.21.15.40:0/1797184079 >> v1:172.21.15.40:6789/0 conn(0x7f50e0069f20 legacy=0x7f50e00b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:53.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.115+0000 7f50e4e08640 1 -- 172.21.15.40:0/1797184079 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e00bda80 con 0x7f50e0151380 2024-09-13T15:34:53.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e4e08640 1 --2- 172.21.15.40:0/1797184079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e0151380 0x7f50e006a300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009740 tx=0x7f50dc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a047152eb4659c89 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:53.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50d7fff640 1 -- 172.21.15.40:0/1797184079 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50dc0ab530 con 0x7f50e0151380 2024-09-13T15:34:53.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50d7fff640 1 -- 172.21.15.40:0/1797184079 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc0a7050 con 0x7f50e0151380 2024-09-13T15:34:53.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50d7fff640 1 -- 172.21.15.40:0/1797184079 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50dc0ab7e0 con 0x7f50e0151380 2024-09-13T15:34:53.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 -- 172.21.15.40:0/1797184079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e0151380 msgr2=0x7f50e006a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:53.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 --2- 172.21.15.40:0/1797184079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e0151380 0x7f50e006a300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f50dc009740 tx=0x7f50dc01c390 comp rx=0 tx=0).stop 2024-09-13T15:34:53.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 -- 172.21.15.40:0/1797184079 shutdown_connections 2024-09-13T15:34:53.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 --2- 172.21.15.40:0/1797184079 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e0151380 0x7f50e006a300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:53.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 -- 172.21.15.40:0/1797184079 >> 172.21.15.40:0/1797184079 conn(0x7f50e006b200 msgr2=0x7f50e006b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:53.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 -- 172.21.15.40:0/1797184079 shutdown_connections 2024-09-13T15:34:53.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 -- 172.21.15.40:0/1797184079 wait complete. 2024-09-13T15:34:53.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 Processor -- start 2024-09-13T15:34:53.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 -- start start 2024-09-13T15:34:53.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e0069f20 0x7f50e0146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:53.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e0147890 con 0x7f50e0069f20 2024-09-13T15:34:53.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e5609640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e0069f20 0x7f50e0146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:53.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e5609640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e0069f20 0x7f50e0146fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:47820/0 (socket says 172.21.15.40:47820) 2024-09-13T15:34:53.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e5609640 1 -- 172.21.15.40:0/3795337616 learned_addr learned my addr 172.21.15.40:0/3795337616 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:53.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e5609640 1 -- 172.21.15.40:0/3795337616 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc009420 con 0x7f50e0069f20 2024-09-13T15:34:53.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e5609640 1 --2- 172.21.15.40:0/3795337616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e0069f20 0x7f50e0146fa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f50d000c480 tx=0x7f50d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:53.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50d5ffb640 1 -- 172.21.15.40:0/3795337616 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50d0005c20 con 0x7f50e0069f20 2024-09-13T15:34:53.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50d5ffb640 1 -- 172.21.15.40:0/3795337616 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d0005d80 con 0x7f50e0069f20 2024-09-13T15:34:53.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50d5ffb640 1 -- 172.21.15.40:0/3795337616 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50d00071a0 con 0x7f50e0069f20 2024-09-13T15:34:53.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 -- 172.21.15.40:0/3795337616 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e0147e70 con 0x7f50e0069f20 2024-09-13T15:34:53.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.119+0000 7f50e786d640 1 -- 172.21.15.40:0/3795337616 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e00bf160 con 0x7f50e0069f20 2024-09-13T15:34:53.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.123+0000 7f50d5ffb640 1 -- 172.21.15.40:0/3795337616 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f50d0007300 con 0x7f50e0069f20 2024-09-13T15:34:53.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.123+0000 7f50d5ffb640 1 --2- 172.21.15.40:0/3795337616 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f50c4035400 0x7f50c40378c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:53.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.123+0000 7f50e786d640 1 -- 172.21.15.40:0/3795337616 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e006a300 con 0x7f50e0069f20 2024-09-13T15:34:53.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.123+0000 7f50d5ffb640 1 -- 172.21.15.40:0/3795337616 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f50d00469a0 con 0x7f50e0069f20 2024-09-13T15:34:53.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.123+0000 7f50e4e08640 1 --2- 172.21.15.40:0/3795337616 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f50c4035400 0x7f50c40378c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:53.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.123+0000 7f50e4e08640 1 --2- 172.21.15.40:0/3795337616 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f50c4035400 0x7f50c40378c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0ad000 tx=0x7f50dc0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:53.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.127+0000 7f50d5ffb640 1 -- 172.21.15.40:0/3795337616 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50d0010300 con 0x7f50e0069f20 2024-09-13T15:34:53.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.311+0000 7f50e786d640 1 -- 172.21.15.40:0/3795337616 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50e00b5b60 con 0x7f50e0069f20 2024-09-13T15:34:53.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.315+0000 7f50d5ffb640 1 -- 172.21.15.40:0/3795337616 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5484 (secure 0 0 0) 0x7f50d0010300 con 0x7f50e0069f20 2024-09-13T15:34:53.316 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:34:53.317 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4148,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6827/1054435232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1054435232},{"type":"v1","addr":"172.21.15.40:6827","nonce":1054435232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6829/3516561034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3516561034},{"type":"v1","addr":"172.21.15.40:6829","nonce":3516561034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6832/3545499514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6831","nonce":3545499514},{"type":"v1","addr":"172.21.15.40:6832","nonce":3545499514}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4151,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/3266942466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":3266942466},{"type":"v1","addr":"172.21.15.40:6833","nonce":3266942466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:34:35.292383+0000","modified":"2024-09-13T15:34:38.300209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4153":{"gid":4153,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3668838086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3668838086},{"type":"v1","addr":"172.21.15.40:6835","nonce":3668838086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:34:53.317 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 8 2024-09-13T15:34:53.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.315+0000 7f50e786d640 1 -- 172.21.15.40:0/3795337616 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f50c4035400 msgr2=0x7f50c40378c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:53.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.315+0000 7f50e786d640 1 --2- 172.21.15.40:0/3795337616 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f50c4035400 0x7f50c40378c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f50dc0ad000 tx=0x7f50dc0a6000 comp rx=0 tx=0).stop 2024-09-13T15:34:53.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.315+0000 7f50e786d640 1 -- 172.21.15.40:0/3795337616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e0069f20 msgr2=0x7f50e0146fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.315+0000 7f50e786d640 1 --2- 172.21.15.40:0/3795337616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e0069f20 0x7f50e0146fa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f50d000c480 tx=0x7f50d000c940 comp rx=0 tx=0).stop 2024-09-13T15:34:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.315+0000 7f50e786d640 1 -- 172.21.15.40:0/3795337616 shutdown_connections 2024-09-13T15:34:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.315+0000 7f50e786d640 1 --2- 172.21.15.40:0/3795337616 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f50c4035400 0x7f50c40378c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.315+0000 7f50e786d640 1 --2- 172.21.15.40:0/3795337616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50e0069f20 0x7f50e0146fa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.315+0000 7f50e786d640 1 -- 172.21.15.40:0/3795337616 >> 172.21.15.40:0/3795337616 conn(0x7f50e006b200 msgr2=0x7f50e00c0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.315+0000 7f50e786d640 1 -- 172.21.15.40:0/3795337616 shutdown_connections 2024-09-13T15:34:53.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.315+0000 7f50e786d640 1 -- 172.21.15.40:0/3795337616 wait complete. 2024-09-13T15:34:53.837 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:34:35.292383+0000', 'modified': '2024-09-13T15:34:38.300209+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4153}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4153': {'gid': 4153, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.40:6835/3668838086', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6834', 'nonce': 3668838086}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 3668838086}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:34:53.837 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:34:53.838 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-09-13T15:34:53.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.975+0000 7f6fa2611640 1 Processor -- start 2024-09-13T15:34:53.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.975+0000 7f6fa2611640 1 -- start start 2024-09-13T15:34:53.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.975+0000 7f6fa2611640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f9c0b3f70 0x7f6f9c0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:53.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.975+0000 7f6fa2611640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f9c0bec50 con 0x7f6f9c06b6a0 2024-09-13T15:34:53.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.975+0000 7f6fa2611640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9c0bf080 con 0x7f6f9c0b3f70 2024-09-13T15:34:53.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.975+0000 7f6f9bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6f9c06b6a0 0x7f6f9c0bdf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47642/0 (socket says 172.21.15.40:47642) 2024-09-13T15:34:53.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.975+0000 7f6f9bfff640 1 -- 172.21.15.40:0/2333358220 learned_addr learned my addr 172.21.15.40:0/2333358220 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:53.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.975+0000 7f6f9b7fe640 1 --2- 172.21.15.40:0/2333358220 >> v2:172.21.15.40:3300/0 conn(0x7f6f9c0b3f70 0x7f6f9c0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:53.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.975+0000 7f6f9affd640 1 -- 172.21.15.40:0/2333358220 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302975976 0 0) 0x7f6f9c0bec50 con 0x7f6f9c06b6a0 2024-09-13T15:34:53.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.975+0000 7f6f9affd640 1 -- 172.21.15.40:0/2333358220 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f84003530 con 0x7f6f9c06b6a0 2024-09-13T15:34:53.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.975+0000 7f6f9b7fe640 1 -- 172.21.15.40:0/2333358220 >> v1:172.21.15.40:6789/0 conn(0x7f6f9c06b6a0 legacy=0x7f6f9c0bdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:53.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.975+0000 7f6f9b7fe640 1 -- 172.21.15.40:0/2333358220 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9c0b63d0 con 0x7f6f9c0b3f70 2024-09-13T15:34:53.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.979+0000 7f6f9b7fe640 1 --2- 172.21.15.40:0/2333358220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f9c0b3f70 0x7f6f9c0b5330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009740 tx=0x7f6f9001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0f5155270dbab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:53.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.979+0000 7f6f9affd640 1 -- 172.21.15.40:0/2333358220 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f900ab570 con 0x7f6f9c0b3f70 2024-09-13T15:34:53.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.979+0000 7f6f9affd640 1 -- 172.21.15.40:0/2333358220 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f900a7070 con 0x7f6f9c0b3f70 2024-09-13T15:34:53.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.979+0000 7f6f9affd640 1 -- 172.21.15.40:0/2333358220 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f900ab820 con 0x7f6f9c0b3f70 2024-09-13T15:34:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.979+0000 7f6fa2611640 1 -- 172.21.15.40:0/2333358220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f9c0b3f70 msgr2=0x7f6f9c0b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.979+0000 7f6fa2611640 1 --2- 172.21.15.40:0/2333358220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f9c0b3f70 0x7f6f9c0b5330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009740 tx=0x7f6f9001c420 comp rx=0 tx=0).stop 2024-09-13T15:34:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.979+0000 7f6fa2611640 1 -- 172.21.15.40:0/2333358220 shutdown_connections 2024-09-13T15:34:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.979+0000 7f6fa2611640 1 --2- 172.21.15.40:0/2333358220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f9c0b3f70 0x7f6f9c0b5330 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.979+0000 7f6fa2611640 1 -- 172.21.15.40:0/2333358220 >> 172.21.15.40:0/2333358220 conn(0x7f6f9c06a370 msgr2=0x7f6f9c06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.979+0000 7f6fa2611640 1 -- 172.21.15.40:0/2333358220 shutdown_connections 2024-09-13T15:34:53.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.979+0000 7f6fa2611640 1 -- 172.21.15.40:0/2333358220 wait complete. 2024-09-13T15:34:53.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6fa2611640 1 Processor -- start 2024-09-13T15:34:53.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6fa2611640 1 -- start start 2024-09-13T15:34:53.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6fa2611640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f9c06b6a0 0x7f6f9c15c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:53.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6fa2611640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9c0b6ee0 con 0x7f6f9c06b6a0 2024-09-13T15:34:53.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6f9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f9c06b6a0 0x7f6f9c15c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:53.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6f9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f9c06b6a0 0x7f6f9c15c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56658/0 (socket says 172.21.15.40:56658) 2024-09-13T15:34:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6f9bfff640 1 -- 172.21.15.40:0/184463036 learned_addr learned my addr 172.21.15.40:0/184463036 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6f9bfff640 1 -- 172.21.15.40:0/184463036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f90009420 con 0x7f6f9c06b6a0 2024-09-13T15:34:53.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6f9bfff640 1 --2- 172.21.15.40:0/184463036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f9c06b6a0 0x7f6f9c15c000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00c450 tx=0x7f6f8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:53.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6f98ff9640 1 -- 172.21.15.40:0/184463036 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f8c005c20 con 0x7f6f9c06b6a0 2024-09-13T15:34:53.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6f98ff9640 1 -- 172.21.15.40:0/184463036 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c005d80 con 0x7f6f9c06b6a0 2024-09-13T15:34:53.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6f98ff9640 1 -- 172.21.15.40:0/184463036 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f8c0071a0 con 0x7f6f9c06b6a0 2024-09-13T15:34:53.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6fa2611640 1 -- 172.21.15.40:0/184463036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f9c15c620 con 0x7f6f9c06b6a0 2024-09-13T15:34:53.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6fa2611640 1 -- 172.21.15.40:0/184463036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c15b1a0 con 0x7f6f9c06b6a0 2024-09-13T15:34:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6f98ff9640 1 -- 172.21.15.40:0/184463036 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f6f8c007300 con 0x7f6f9c06b6a0 2024-09-13T15:34:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6f98ff9640 1 --2- 172.21.15.40:0/184463036 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6f88035450 0x7f6f88037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6f98ff9640 1 -- 172.21.15.40:0/184463036 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f6f8c046b30 con 0x7f6f9c06b6a0 2024-09-13T15:34:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.983+0000 7f6f9b7fe640 1 --2- 172.21.15.40:0/184463036 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6f88035450 0x7f6f88037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:53.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6f9b7fe640 1 --2- 172.21.15.40:0/184463036 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6f88035450 0x7f6f88037910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6f900af000 tx=0x7f6f900a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 Processor -- start 2024-09-13T15:34:53.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 -- start start 2024-09-13T15:34:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3889bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f374be80 con 0x55a5f38897d0 2024-09-13T15:34:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6f9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3889bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6f9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3889bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56662/0 (socket says 172.21.15.40:56662) 2024-09-13T15:34:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6f9bfff640 1 -- 172.21.15.40:0/1383721668 learned_addr learned my addr 172.21.15.40:0/1383721668 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6f9bfff640 1 -- 172.21.15.40:0/1383721668 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5f33ce890 con 0x55a5f38897d0 2024-09-13T15:34:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6f9bfff640 1 --2- 172.21.15.40:0/1383721668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3889bb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0108e0 tx=0x7f6f8c0127e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01fa5d09b02619e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:53.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6f81ffb640 1 -- 172.21.15.40:0/1383721668 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f8c011c80 con 0x55a5f38897d0 2024-09-13T15:34:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6f81ffb640 1 -- 172.21.15.40:0/1383721668 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c011de0 con 0x55a5f38897d0 2024-09-13T15:34:53.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6f81ffb640 1 -- 172.21.15.40:0/1383721668 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f8c01aba0 con 0x55a5f38897d0 2024-09-13T15:34:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 -- 172.21.15.40:0/1383721668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 msgr2=0x55a5f3889bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 --2- 172.21.15.40:0/1383721668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3889bb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0108e0 tx=0x7f6f8c0127e0 comp rx=0 tx=0).stop 2024-09-13T15:34:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 -- 172.21.15.40:0/1383721668 shutdown_connections 2024-09-13T15:34:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 --2- 172.21.15.40:0/1383721668 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3889bb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 -- 172.21.15.40:0/1383721668 >> 172.21.15.40:0/1383721668 conn(0x55a5f388a500 msgr2=0x55a5f38821f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:53.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 -- 172.21.15.40:0/1383721668 shutdown_connections 2024-09-13T15:34:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 -- 172.21.15.40:0/1383721668 wait complete. 2024-09-13T15:34:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 -- start start 2024-09-13T15:34:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.987+0000 7f6fa575a000 1 Processor -- start 2024-09-13T15:34:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3888960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f36d9af0 con 0x55a5f38897d0 2024-09-13T15:34:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 10 client.0 _ll_register_callbacks cb 0x55a5f386fae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:34:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3888960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3888960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56664/0 (socket says 172.21.15.40:56664) 2024-09-13T15:34:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f9bfff640 1 -- 172.21.15.40:0/951998769 learned_addr learned my addr 172.21.15.40:0/951998769 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f9bfff640 1 -- 172.21.15.40:0/951998769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9c15b1a0 con 0x55a5f38897d0 2024-09-13T15:34:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f9bfff640 1 --2- 172.21.15.40:0/951998769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3888960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c010fd0 tx=0x7f6f8c007ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde1eb1a9e9fe8d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:53.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f7affd640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f7affd640 1 -- 172.21.15.40:0/951998769 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f8c01a490 con 0x55a5f38897d0 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f7affd640 1 -- 172.21.15.40:0/951998769 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f6f8c01a5f0 con 0x55a5f38897d0 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 -- 172.21.15.40:0/951998769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5f368f5f0 con 0x55a5f38897d0 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f7affd640 1 -- 172.21.15.40:0/951998769 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f8c01a7f0 con 0x55a5f38897d0 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 10 client.4312 fetch_fsmap learned FSMap version 8 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 -- 172.21.15.40:0/951998769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a5f3697ab0 con 0x55a5f38897d0 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f7affd640 1 -- 172.21.15.40:0/951998769 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5f368f5f0 con 0x55a5f38897d0 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f7affd640 1 -- 172.21.15.40:0/951998769 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) v1 ==== 3659+0+0 (secure 0 0 0) 0x7f6f8c028020 con 0x55a5f38897d0 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 10 client.4312 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 10 client.4312 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 20 client.4312 populate_metadata read hostname 'smithi040' 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 --2- 172.21.15.40:0/951998769 >> [v2:172.21.15.40:6834/3668838086,v1:172.21.15.40:6835/3668838086] conn(0x55a5f388f480 0x55a5f388f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:53.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 4 client.4312 mds_command: new command op to 4153 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 -- 172.21.15.40:0/951998769 --> [v2:172.21.15.40:6834/3668838086,v1:172.21.15.40:6835/3668838086] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5f36cf790 con 0x55a5f388f480 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f9b7fe640 1 --2- 172.21.15.40:0/951998769 >> [v2:172.21.15.40:6834/3668838086,v1:172.21.15.40:6835/3668838086] conn(0x55a5f388f480 0x55a5f388f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f9b7fe640 1 --2- 172.21.15.40:0/951998769 >> [v2:172.21.15.40:6834/3668838086,v1:172.21.15.40:6835/3668838086] conn(0x55a5f388f480 0x55a5f388f860 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e58a8ae23f47be9 server_cookie=4135a4e6cce4e79d in_seq=0 out_seq=0 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f7affd640 10 client.4312 ms_handle_connect on v2:172.21.15.40:6834/3668838086 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f7affd640 1 -- 172.21.15.40:0/951998769 <== mds.0 v2:172.21.15.40:6834/3668838086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a5f36cf790 con 0x55a5f388f480 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f7affd640 10 client.4312 handle_command_reply: tid=0 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 client.4312 shutdown 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 -- 172.21.15.40:0/951998769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 msgr2=0x55a5f3888960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 --2- 172.21.15.40:0/951998769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3888960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c010fd0 tx=0x7f6f8c007ae0 comp rx=0 tx=0).stop 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 -- 172.21.15.40:0/951998769 shutdown_connections 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 --2- 172.21.15.40:0/951998769 >> [v2:172.21.15.40:6834/3668838086,v1:172.21.15.40:6835/3668838086] conn(0x55a5f388f480 0x55a5f388f860 crc :-1 s=READY pgs=6 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 --2- 172.21.15.40:0/951998769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3888960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 -- 172.21.15.40:0/951998769 >> 172.21.15.40:0/951998769 conn(0x55a5f388a500 msgr2=0x55a5f38828f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:53.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6f7affd640 0 client.4312 ms_handle_reset on v2:172.21.15.40:6834/3668838086 2024-09-13T15:34:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 -- 172.21.15.40:0/951998769 shutdown_connections 2024-09-13T15:34:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 1 -- 172.21.15.40:0/951998769 wait complete. 2024-09-13T15:34:53.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:53.991+0000 7f6fa575a000 20 client.4312 trim_cache size 0 max 16384 2024-09-13T15:34:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.007+0000 7f6fa575a000 1 Processor -- start 2024-09-13T15:34:54.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.007+0000 7f6fa575a000 1 -- start start 2024-09-13T15:34:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.007+0000 7f6fa575a000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3925ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.007+0000 7f6fa575a000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f36d70c0 con 0x55a5f38897d0 2024-09-13T15:34:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.007+0000 7f6f9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3925ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.007+0000 7f6f9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3925ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56674/0 (socket says 172.21.15.40:56674) 2024-09-13T15:34:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.007+0000 7f6f9bfff640 1 -- 172.21.15.40:0/527078773 learned_addr learned my addr 172.21.15.40:0/527078773 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.007+0000 7f6f9bfff640 1 -- 172.21.15.40:0/527078773 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5f367dc00 con 0x55a5f38897d0 2024-09-13T15:34:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f9bfff640 1 --2- 172.21.15.40:0/527078773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3925ec0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c010d40 tx=0x7f6f8c03f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c89f585d885f041 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f827fc640 1 -- 172.21.15.40:0/527078773 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f8c0075b0 con 0x55a5f38897d0 2024-09-13T15:34:54.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f827fc640 1 -- 172.21.15.40:0/527078773 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c00e040 con 0x55a5f38897d0 2024-09-13T15:34:54.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f827fc640 1 -- 172.21.15.40:0/527078773 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f8c01aa70 con 0x55a5f38897d0 2024-09-13T15:34:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 -- 172.21.15.40:0/527078773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 msgr2=0x55a5f3925ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 --2- 172.21.15.40:0/527078773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3925ec0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c010d40 tx=0x7f6f8c03f000 comp rx=0 tx=0).stop 2024-09-13T15:34:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 -- 172.21.15.40:0/527078773 shutdown_connections 2024-09-13T15:34:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 --2- 172.21.15.40:0/527078773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3925ec0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:54.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 -- 172.21.15.40:0/527078773 >> 172.21.15.40:0/527078773 conn(0x55a5f388a500 msgr2=0x55a5f3882ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 -- 172.21.15.40:0/527078773 shutdown_connections 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 -- 172.21.15.40:0/527078773 wait complete. 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 -- start start 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 Processor -- start 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3926be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5f36d29b0 con 0x55a5f38897d0 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 10 client.0 _ll_register_callbacks cb 0x7f6f8c015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3926be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f9bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3926be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56686/0 (socket says 172.21.15.40:56686) 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f9bfff640 1 -- 172.21.15.40:0/1273892513 learned_addr learned my addr 172.21.15.40:0/1273892513 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f9bfff640 1 -- 172.21.15.40:0/1273892513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5f3697ab0 con 0x55a5f38897d0 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f9bfff640 1 --2- 172.21.15.40:0/1273892513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3926be0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00ce60 tx=0x7f6f8c010870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc50c49143f31b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:54.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f7affd640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f7affd640 1 -- 172.21.15.40:0/1273892513 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f8c00e040 con 0x55a5f38897d0 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f7affd640 1 -- 172.21.15.40:0/1273892513 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7f6f8c01a360 con 0x55a5f38897d0 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 -- 172.21.15.40:0/1273892513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5f369b9c0 con 0x55a5f38897d0 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f7affd640 1 -- 172.21.15.40:0/1273892513 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f8c01a560 con 0x55a5f38897d0 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 10 client.4314 fetch_fsmap learned FSMap version 8 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 -- 172.21.15.40:0/1273892513 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55a5f33cecc0 con 0x55a5f38897d0 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f7affd640 1 -- 172.21.15.40:0/1273892513 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5f369b9c0 con 0x55a5f38897d0 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f7affd640 1 -- 172.21.15.40:0/1273892513 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 8) v1 ==== 3659+0+0 (secure 0 0 0) 0x7f6f8c04c020 con 0x55a5f38897d0 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 10 client.4314 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 10 client.4314 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 20 client.4314 populate_metadata read hostname 'smithi040' 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 --2- 172.21.15.40:0/1273892513 >> [v2:172.21.15.40:6834/3668838086,v1:172.21.15.40:6835/3668838086] conn(0x55a5f3927630 0x55a5f3927a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:54.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 4 client.4314 mds_command: new command op to 4153 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6fa575a000 1 -- 172.21.15.40:0/1273892513 --> [v2:172.21.15.40:6834/3668838086,v1:172.21.15.40:6835/3668838086] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a5f36cb470 con 0x55a5f3927630 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f9b7fe640 1 --2- 172.21.15.40:0/1273892513 >> [v2:172.21.15.40:6834/3668838086,v1:172.21.15.40:6835/3668838086] conn(0x55a5f3927630 0x55a5f3927a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f7affd640 10 client.4314 ms_handle_connect on v2:172.21.15.40:6834/3668838086 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.011+0000 7f6f9b7fe640 1 --2- 172.21.15.40:0/1273892513 >> [v2:172.21.15.40:6834/3668838086,v1:172.21.15.40:6835/3668838086] conn(0x55a5f3927630 0x55a5f3927a10 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99624df824531c36 server_cookie=ab5e452dc6a9049f in_seq=0 out_seq=0 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6f7affd640 1 -- 172.21.15.40:0/1273892513 <== mds.0 v2:172.21.15.40:6834/3668838086 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55a5f36cb470 con 0x55a5f3927630 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6f7affd640 10 client.4314 handle_command_reply: tid=0 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa575a000 1 client.4314 shutdown 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa575a000 1 -- 172.21.15.40:0/1273892513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 msgr2=0x55a5f3926be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa575a000 1 --2- 172.21.15.40:0/1273892513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3926be0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00ce60 tx=0x7f6f8c010870 comp rx=0 tx=0).stop 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa575a000 1 -- 172.21.15.40:0/1273892513 shutdown_connections 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa575a000 1 --2- 172.21.15.40:0/1273892513 >> [v2:172.21.15.40:6834/3668838086,v1:172.21.15.40:6835/3668838086] conn(0x55a5f3927630 0x55a5f3927a10 crc :-1 s=READY pgs=7 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa575a000 1 --2- 172.21.15.40:0/1273892513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55a5f38897d0 0x55a5f3926be0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa575a000 1 -- 172.21.15.40:0/1273892513 >> 172.21.15.40:0/1273892513 conn(0x55a5f388a500 msgr2=0x55a5f38831c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:54.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6f7affd640 0 client.4314 ms_handle_reset on v2:172.21.15.40:6834/3668838086 2024-09-13T15:34:54.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa575a000 1 -- 172.21.15.40:0/1273892513 shutdown_connections 2024-09-13T15:34:54.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa575a000 1 -- 172.21.15.40:0/1273892513 wait complete. 2024-09-13T15:34:54.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa575a000 20 client.4314 trim_cache size 0 max 16384 2024-09-13T15:34:54.020 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-13T15:34:54.020 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "0a577d39-ad8f-45a9-8f50-4745653ec5d3", 2024-09-13T15:34:54.020 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-09-13T15:34:54.021 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4153, 2024-09-13T15:34:54.021 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-09-13T15:34:54.021 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-09-13T15:34:54.021 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-09-13T15:34:54.021 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 18.721326069, 2024-09-13T15:34:54.021 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 8, 2024-09-13T15:34:54.021 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 16, 2024-09-13T15:34:54.021 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 16, 2024-09-13T15:34:54.021 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 24.668973137999998 2024-09-13T15:34:54.021 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-13T15:34:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa2611640 1 -- 172.21.15.40:0/184463036 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6f88035450 msgr2=0x7f6f88037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa2611640 1 --2- 172.21.15.40:0/184463036 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6f88035450 0x7f6f88037910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6f900af000 tx=0x7f6f900a7000 comp rx=0 tx=0).stop 2024-09-13T15:34:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa2611640 1 -- 172.21.15.40:0/184463036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f9c06b6a0 msgr2=0x7f6f9c15c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa2611640 1 --2- 172.21.15.40:0/184463036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f9c06b6a0 0x7f6f9c15c000 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00c450 tx=0x7f6f8c00c910 comp rx=0 tx=0).stop 2024-09-13T15:34:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa2611640 1 -- 172.21.15.40:0/184463036 shutdown_connections 2024-09-13T15:34:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa2611640 1 --2- 172.21.15.40:0/184463036 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f6f88035450 0x7f6f88037910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:54.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa2611640 1 --2- 172.21.15.40:0/184463036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f9c06b6a0 0x7f6f9c15c000 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:54.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa2611640 1 -- 172.21.15.40:0/184463036 >> 172.21.15.40:0/184463036 conn(0x7f6f9c06a370 msgr2=0x7f6f9c06a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:54.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa2611640 1 -- 172.21.15.40:0/184463036 shutdown_connections 2024-09-13T15:34:54.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.015+0000 7f6fa2611640 1 -- 172.21.15.40:0/184463036 wait complete. 2024-09-13T15:34:54.033 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T15:34:54.046 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T15:34:54.046 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T15:34:54.046 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T15:34:54.046 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T15:34:54.091 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T15:34:54.091 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:34:54.091 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs volume create dc' 2024-09-13T15:34:54.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.211+0000 7fc0ac63c640 1 Processor -- start 2024-09-13T15:34:54.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.211+0000 7fc0ac63c640 1 -- start start 2024-09-13T15:34:54.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0ac63c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0a406e800 0x7fc0a40bcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:54.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0ac63c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a40c14d0 con 0x7fc0a406ebe0 2024-09-13T15:34:54.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0ac63c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a40b44a0 con 0x7fc0a406e800 2024-09-13T15:34:54.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0aa3d8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0a406e800 0x7fc0a40bcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:54.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0aa3d8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0a406e800 0x7fc0a40bcf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56692/0 (socket says 172.21.15.40:56692) 2024-09-13T15:34:54.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0aa3d8640 1 -- 172.21.15.40:0/1733695478 learned_addr learned my addr 172.21.15.40:0/1733695478 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:54.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0a9bd7640 1 --1- 172.21.15.40:0/1733695478 >> v1:172.21.15.40:6789/0 conn(0x7fc0a406ebe0 0x7fc0a40bd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47648/0 (socket says 172.21.15.40:47648) 2024-09-13T15:34:54.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0aa3d8640 1 -- 172.21.15.40:0/1733695478 >> v1:172.21.15.40:6789/0 conn(0x7fc0a406ebe0 legacy=0x7fc0a40bd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:54.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0aa3d8640 1 -- 172.21.15.40:0/1733695478 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a406f890 con 0x7fc0a406e800 2024-09-13T15:34:54.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0a93d6640 1 -- 172.21.15.40:0/1733695478 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709122503 0 0) 0x7fc0a40c14d0 con 0x7fc0a406ebe0 2024-09-13T15:34:54.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0aa3d8640 1 --2- 172.21.15.40:0/1733695478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0a406e800 0x7fc0a40bcf20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00097f0 tx=0x7fc0a001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eafbbd34beaed5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:54.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0a93d6640 1 -- 172.21.15.40:0/1733695478 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a00ad5b0 con 0x7fc0a406e800 2024-09-13T15:34:54.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0a93d6640 1 -- 172.21.15.40:0/1733695478 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a00ad710 con 0x7fc0a406e800 2024-09-13T15:34:54.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.215+0000 7fc0a93d6640 1 -- 172.21.15.40:0/1733695478 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a00ad9d0 con 0x7fc0a406e800 2024-09-13T15:34:54.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 -- 172.21.15.40:0/1733695478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0a406e800 msgr2=0x7fc0a40bcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:54.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 --2- 172.21.15.40:0/1733695478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0a406e800 0x7fc0a40bcf20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00097f0 tx=0x7fc0a001c410 comp rx=0 tx=0).stop 2024-09-13T15:34:54.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 -- 172.21.15.40:0/1733695478 shutdown_connections 2024-09-13T15:34:54.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 --2- 172.21.15.40:0/1733695478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0a406e800 0x7fc0a40bcf20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:54.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 -- 172.21.15.40:0/1733695478 >> 172.21.15.40:0/1733695478 conn(0x7fc0a406a5a0 msgr2=0x7fc0a40a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:54.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 -- 172.21.15.40:0/1733695478 shutdown_connections 2024-09-13T15:34:54.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 -- 172.21.15.40:0/1733695478 wait complete. 2024-09-13T15:34:54.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 Processor -- start 2024-09-13T15:34:54.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 -- start start 2024-09-13T15:34:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0a406e800 0x7fc0a4152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41eb920 con 0x7fc0a406e800 2024-09-13T15:34:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0aa3d8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0a406e800 0x7fc0a4152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0aa3d8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0a406e800 0x7fc0a4152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56708/0 (socket says 172.21.15.40:56708) 2024-09-13T15:34:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0aa3d8640 1 -- 172.21.15.40:0/4097790316 learned_addr learned my addr 172.21.15.40:0/4097790316 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0aa3d8640 1 -- 172.21.15.40:0/4097790316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a00094d0 con 0x7fc0a406e800 2024-09-13T15:34:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0aa3d8640 1 --2- 172.21.15.40:0/4097790316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0a406e800 0x7fc0a4152ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00097f0 tx=0x7fc0a001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc09affd640 1 -- 172.21.15.40:0/4097790316 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a00add30 con 0x7fc0a406e800 2024-09-13T15:34:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc09affd640 1 -- 172.21.15.40:0/4097790316 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a00ade90 con 0x7fc0a406e800 2024-09-13T15:34:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 -- 172.21.15.40:0/4097790316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a415e270 con 0x7fc0a406e800 2024-09-13T15:34:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc09affd640 1 -- 172.21.15.40:0/4097790316 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0a00b8570 con 0x7fc0a406e800 2024-09-13T15:34:54.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.219+0000 7fc0ac63c640 1 -- 172.21.15.40:0/4097790316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a41ebe40 con 0x7fc0a406e800 2024-09-13T15:34:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.223+0000 7fc0ac63c640 1 -- 172.21.15.40:0/4097790316 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a414c8d0 con 0x7fc0a406e800 2024-09-13T15:34:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.223+0000 7fc09affd640 1 -- 172.21.15.40:0/4097790316 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fc0a00b4040 con 0x7fc0a406e800 2024-09-13T15:34:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.223+0000 7fc09affd640 1 --2- 172.21.15.40:0/4097790316 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc088035450 0x7fc088037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.223+0000 7fc09affd640 1 -- 172.21.15.40:0/4097790316 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3439+0+0 (secure 0 0 0) 0x7fc0a00e1b90 con 0x7fc0a406e800 2024-09-13T15:34:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.223+0000 7fc0a9bd7640 1 --2- 172.21.15.40:0/4097790316 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc088035450 0x7fc088037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:54.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.223+0000 7fc0a9bd7640 1 --2- 172.21.15.40:0/4097790316 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc088035450 0x7fc088037910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc094007fd0 tx=0x7fc094007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:54.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.227+0000 7fc09affd640 1 -- 172.21.15.40:0/4097790316 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc0a00ace40 con 0x7fc0a406e800 2024-09-13T15:34:54.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:54.411+0000 7fc0ac63c640 1 -- 172.21.15.40:0/4097790316 --> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "dc", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0a4150420 con 0x7fc088035450 2024-09-13T15:34:56.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.183+0000 7fc09affd640 1 -- 172.21.15.40:0/4097790316 <== mgr.4099 v2:172.21.15.40:6824/3185150828 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7fc094007170 con 0x7fc088035450 2024-09-13T15:34:56.184 INFO:teuthology.orchestra.run.smithi040.stderr:Volume created successfully (no MDS daemons created) 2024-09-13T15:34:56.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.187+0000 7fc0ac63c640 1 -- 172.21.15.40:0/4097790316 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc088035450 msgr2=0x7fc088037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:56.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.187+0000 7fc0ac63c640 1 --2- 172.21.15.40:0/4097790316 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc088035450 0x7fc088037910 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc094007fd0 tx=0x7fc094007920 comp rx=0 tx=0).stop 2024-09-13T15:34:56.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.187+0000 7fc0ac63c640 1 -- 172.21.15.40:0/4097790316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0a406e800 msgr2=0x7fc0a4152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:56.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.187+0000 7fc0ac63c640 1 --2- 172.21.15.40:0/4097790316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0a406e800 0x7fc0a4152ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00097f0 tx=0x7fc0a001ac50 comp rx=0 tx=0).stop 2024-09-13T15:34:56.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.187+0000 7fc0ac63c640 1 -- 172.21.15.40:0/4097790316 shutdown_connections 2024-09-13T15:34:56.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.187+0000 7fc0ac63c640 1 --2- 172.21.15.40:0/4097790316 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fc088035450 0x7fc088037910 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:56.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.187+0000 7fc0ac63c640 1 --2- 172.21.15.40:0/4097790316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0a406e800 0x7fc0a4152ac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:56.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.187+0000 7fc0ac63c640 1 -- 172.21.15.40:0/4097790316 >> 172.21.15.40:0/4097790316 conn(0x7fc0a406a5a0 msgr2=0x7fc0a4157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:56.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.187+0000 7fc0ac63c640 1 -- 172.21.15.40:0/4097790316 shutdown_connections 2024-09-13T15:34:56.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.187+0000 7fc0ac63c640 1 -- 172.21.15.40:0/4097790316 wait complete. 2024-09-13T15:34:56.221 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs volume create dc-backup' 2024-09-13T15:34:56.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.339+0000 7f1e5b4b4640 1 Processor -- start 2024-09-13T15:34:56.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.339+0000 7f1e5b4b4640 1 -- start start 2024-09-13T15:34:56.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.339+0000 7f1e5b4b4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e5406ac90 0x7f1e540a6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:56.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.339+0000 7f1e5b4b4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e540a7180 con 0x7f1e5406a8b0 2024-09-13T15:34:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.339+0000 7f1e5b4b4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e540a73b0 con 0x7f1e5406ac90 2024-09-13T15:34:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.339+0000 7f1e58a4f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e5406ac90 0x7f1e540a6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.339+0000 7f1e58a4f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e5406ac90 0x7f1e540a6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56724/0 (socket says 172.21.15.40:56724) 2024-09-13T15:34:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.339+0000 7f1e58a4f640 1 -- 172.21.15.40:0/2427398433 learned_addr learned my addr 172.21.15.40:0/2427398433 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.339+0000 7f1e58a4f640 1 -- 172.21.15.40:0/2427398433 >> v1:172.21.15.40:6789/0 conn(0x7f1e5406a8b0 legacy=0x7f1e540c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.339+0000 7f1e4bfff640 1 -- 172.21.15.40:0/2427398433 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170581271 0 0) 0x7f1e540a7180 con 0x7f1e5406a8b0 2024-09-13T15:34:56.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.343+0000 7f1e58a4f640 1 -- 172.21.15.40:0/2427398433 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5408c0f0 con 0x7f1e5406ac90 2024-09-13T15:34:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.343+0000 7f1e58a4f640 1 --2- 172.21.15.40:0/2427398433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5406ac90 0x7f1e540a6c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1e440097f0 tx=0x7f1e4401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4373b29933d73703 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:56.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.343+0000 7f1e4bfff640 1 -- 172.21.15.40:0/2427398433 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e440ab520 con 0x7f1e5406ac90 2024-09-13T15:34:56.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.343+0000 7f1e4bfff640 1 -- 172.21.15.40:0/2427398433 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e440ab680 con 0x7f1e5406ac90 2024-09-13T15:34:56.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.343+0000 7f1e4bfff640 1 -- 172.21.15.40:0/2427398433 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e440ab940 con 0x7f1e5406ac90 2024-09-13T15:34:56.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.343+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/2427398433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5406ac90 msgr2=0x7f1e540a6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:56.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.343+0000 7f1e5b4b4640 1 --2- 172.21.15.40:0/2427398433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5406ac90 0x7f1e540a6c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1e440097f0 tx=0x7f1e4401c4e0 comp rx=0 tx=0).stop 2024-09-13T15:34:56.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.343+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/2427398433 shutdown_connections 2024-09-13T15:34:56.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.343+0000 7f1e5b4b4640 1 --2- 172.21.15.40:0/2427398433 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5406ac90 0x7f1e540a6c40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:56.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.343+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/2427398433 >> 172.21.15.40:0/2427398433 conn(0x7f1e540a8500 msgr2=0x7f1e540a8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:56.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.343+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/2427398433 shutdown_connections 2024-09-13T15:34:56.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.343+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/2427398433 wait complete. 2024-09-13T15:34:56.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e5b4b4640 1 Processor -- start 2024-09-13T15:34:56.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e5b4b4640 1 -- start start 2024-09-13T15:34:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e5b4b4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5406a8b0 0x7f1e540bd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:56.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e5b4b4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540bf560 con 0x7f1e5406a8b0 2024-09-13T15:34:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e59250640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5406a8b0 0x7f1e540bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e59250640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5406a8b0 0x7f1e540bd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56728/0 (socket says 172.21.15.40:56728) 2024-09-13T15:34:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e59250640 1 -- 172.21.15.40:0/3261314447 learned_addr learned my addr 172.21.15.40:0/3261314447 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e59250640 1 -- 172.21.15.40:0/3261314447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e440094d0 con 0x7f1e5406a8b0 2024-09-13T15:34:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e59250640 1 --2- 172.21.15.40:0/3261314447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5406a8b0 0x7f1e540bd620 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000c400 tx=0x7f1e5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e49ffb640 1 -- 172.21.15.40:0/3261314447 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e500054d0 con 0x7f1e5406a8b0 2024-09-13T15:34:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e49ffb640 1 -- 172.21.15.40:0/3261314447 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e50003600 con 0x7f1e5406a8b0 2024-09-13T15:34:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e49ffb640 1 -- 172.21.15.40:0/3261314447 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e50003960 con 0x7f1e5406a8b0 2024-09-13T15:34:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/3261314447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e540ba030 con 0x7f1e5406a8b0 2024-09-13T15:34:56.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/3261314447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e540bf270 con 0x7f1e5406a8b0 2024-09-13T15:34:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/3261314447 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5408bc80 con 0x7f1e5406a8b0 2024-09-13T15:34:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e49ffb640 1 -- 172.21.15.40:0/3261314447 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f1e50003ac0 con 0x7f1e5406a8b0 2024-09-13T15:34:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e49ffb640 1 --2- 172.21.15.40:0/3261314447 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f1e38035450 0x7f1e38037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e49ffb640 1 -- 172.21.15.40:0/3261314447 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4253+0+0 (secure 0 0 0) 0x7f1e50046fc0 con 0x7f1e5406a8b0 2024-09-13T15:34:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e58a4f640 1 --2- 172.21.15.40:0/3261314447 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f1e38035450 0x7f1e38037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:56.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.347+0000 7f1e58a4f640 1 --2- 172.21.15.40:0/3261314447 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f1e38035450 0x7f1e38037910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e440af000 tx=0x7f1e44008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:56.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.355+0000 7f1e49ffb640 1 -- 172.21.15.40:0/3261314447 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1e50078db0 con 0x7f1e5406a8b0 2024-09-13T15:34:56.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:56.535+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/3261314447 --> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "dc-backup", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e54154090 con 0x7f1e38035450 2024-09-13T15:34:57.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:34:58.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.211+0000 7f1e49ffb640 1 -- 172.21.15.40:0/3261314447 <== mgr.4099 v2:172.21.15.40:6824/3185150828 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f1e440ba0a0 con 0x7f1e38035450 2024-09-13T15:34:58.216 INFO:teuthology.orchestra.run.smithi040.stderr:Volume created successfully (no MDS daemons created) 2024-09-13T15:34:58.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.223+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/3261314447 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f1e38035450 msgr2=0x7f1e38037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:58.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.223+0000 7f1e5b4b4640 1 --2- 172.21.15.40:0/3261314447 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f1e38035450 0x7f1e38037910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1e440af000 tx=0x7f1e44008040 comp rx=0 tx=0).stop 2024-09-13T15:34:58.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.223+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/3261314447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5406a8b0 msgr2=0x7f1e540bd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:58.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.223+0000 7f1e5b4b4640 1 --2- 172.21.15.40:0/3261314447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5406a8b0 0x7f1e540bd620 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1e5000c400 tx=0x7f1e5000c8c0 comp rx=0 tx=0).stop 2024-09-13T15:34:58.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.223+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/3261314447 shutdown_connections 2024-09-13T15:34:58.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.223+0000 7f1e5b4b4640 1 --2- 172.21.15.40:0/3261314447 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f1e38035450 0x7f1e38037910 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:58.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.223+0000 7f1e5b4b4640 1 --2- 172.21.15.40:0/3261314447 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e5406a8b0 0x7f1e540bd620 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:58.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.223+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/3261314447 >> 172.21.15.40:0/3261314447 conn(0x7f1e540a8500 msgr2=0x7f1e540a6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:58.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.223+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/3261314447 shutdown_connections 2024-09-13T15:34:58.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.223+0000 7f1e5b4b4640 1 -- 172.21.15.40:0/3261314447 wait complete. 2024-09-13T15:34:58.262 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-13T15:34:58.272 INFO:teuthology.run_tasks:Running task cephfs-mirror... 2024-09-13T15:34:58.298 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:34:58.299 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:34:58.301 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:34:58.301 INFO:teuthology.run_tasks:Running task cephfs-mirror... 2024-09-13T15:34:58.330 INFO:tasks.cephfs_mirror.client.mirror2:Restarting daemon 2024-09-13T15:34:58.330 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground 2024-09-13T15:34:58.332 INFO:tasks.cephfs_mirror.client.mirror2:Started 2024-09-13T15:34:58.332 INFO:teuthology.run_tasks:Running task cephfs-mirror... 2024-09-13T15:34:58.364 INFO:tasks.cephfs_mirror.client.mirror3:Restarting daemon 2024-09-13T15:34:58.365 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground 2024-09-13T15:34:58.366 INFO:tasks.cephfs_mirror.client.mirror3:Started 2024-09-13T15:34:58.367 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T15:34:58.396 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T15:34:58.397 INFO:teuthology.task.exec:Running commands on role client.1 host ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:34:58.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph auth caps client.0 mon '"'"'allow r'"'"' mds '"'"'allow rwps'"'"' osd '"'"'allow rw tag cephfs *=*'"'"' mgr '"'"'allow r'"'"'' 2024-09-13T15:34:58.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.527+0000 7fe22d26b640 1 Processor -- start 2024-09-13T15:34:58.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.527+0000 7fe22d26b640 1 -- start start 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.527+0000 7fe22d26b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2280b4100 0x7fe2280b6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.527+0000 7fe22d26b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2280bcc40 con 0x7fe2280bc860 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.527+0000 7fe22d26b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe228151720 con 0x7fe2280b4100 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe226ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe2280bc860 0x7fe22806e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47694/0 (socket says 172.21.15.40:47694) 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe226ffd640 1 -- 172.21.15.40:0/107748074 learned_addr learned my addr 172.21.15.40:0/107748074 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe21ffff640 1 --2- 172.21.15.40:0/107748074 >> v2:172.21.15.40:3300/0 conn(0x7fe2280b4100 0x7fe2280b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe2267fc640 1 -- 172.21.15.40:0/107748074 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096845821 0 0) 0x7fe2280bcc40 con 0x7fe2280bc860 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe2267fc640 1 -- 172.21.15.40:0/107748074 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe214003530 con 0x7fe2280bc860 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe21ffff640 1 -- 172.21.15.40:0/107748074 >> v1:172.21.15.40:6789/0 conn(0x7fe2280bc860 legacy=0x7fe22806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe21ffff640 1 -- 172.21.15.40:0/107748074 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22806fb40 con 0x7fe2280b4100 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe21ffff640 1 --2- 172.21.15.40:0/107748074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2280b4100 0x7fe2280b6450 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe210009740 tx=0x7fe21001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc9198198304e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe2267fc640 1 -- 172.21.15.40:0/107748074 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2100ac570 con 0x7fe2280b4100 2024-09-13T15:34:58.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe2267fc640 1 -- 172.21.15.40:0/107748074 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2100ac6d0 con 0x7fe2280b4100 2024-09-13T15:34:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe2267fc640 1 -- 172.21.15.40:0/107748074 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2100ac990 con 0x7fe2280b4100 2024-09-13T15:34:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe22d26b640 1 -- 172.21.15.40:0/107748074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2280b4100 msgr2=0x7fe2280b6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe22d26b640 1 --2- 172.21.15.40:0/107748074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2280b4100 0x7fe2280b6450 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe210009740 tx=0x7fe21001c420 comp rx=0 tx=0).stop 2024-09-13T15:34:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe22d26b640 1 -- 172.21.15.40:0/107748074 shutdown_connections 2024-09-13T15:34:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe22d26b640 1 --2- 172.21.15.40:0/107748074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2280b4100 0x7fe2280b6450 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe22d26b640 1 -- 172.21.15.40:0/107748074 >> 172.21.15.40:0/107748074 conn(0x7fe22806b4a0 msgr2=0x7fe22806b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe22d26b640 1 -- 172.21.15.40:0/107748074 shutdown_connections 2024-09-13T15:34:58.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.531+0000 7fe22d26b640 1 -- 172.21.15.40:0/107748074 wait complete. 2024-09-13T15:34:58.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe22d26b640 1 Processor -- start 2024-09-13T15:34:58.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe22d26b640 1 -- start start 2024-09-13T15:34:58.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe22d26b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2280b4100 0x7fe228099d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:58.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe22d26b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22809a5b0 con 0x7fe2280b4100 2024-09-13T15:34:58.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe226ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2280b4100 0x7fe228099d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:58.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe226ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2280b4100 0x7fe228099d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56826/0 (socket says 172.21.15.40:56826) 2024-09-13T15:34:58.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe226ffd640 1 -- 172.21.15.40:0/3467350864 learned_addr learned my addr 172.21.15.40:0/3467350864 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:58.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe226ffd640 1 -- 172.21.15.40:0/3467350864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe210009420 con 0x7fe2280b4100 2024-09-13T15:34:58.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe226ffd640 1 --2- 172.21.15.40:0/3467350864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2280b4100 0x7fe228099d20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe21800c470 tx=0x7fe21800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:58.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe21f7fe640 1 -- 172.21.15.40:0/3467350864 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe218005c20 con 0x7fe2280b4100 2024-09-13T15:34:58.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe21f7fe640 1 -- 172.21.15.40:0/3467350864 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe218005d80 con 0x7fe2280b4100 2024-09-13T15:34:58.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe21f7fe640 1 -- 172.21.15.40:0/3467350864 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe2180071e0 con 0x7fe2280b4100 2024-09-13T15:34:58.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe22d26b640 1 -- 172.21.15.40:0/3467350864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22809d9b0 con 0x7fe2280b4100 2024-09-13T15:34:58.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe22d26b640 1 -- 172.21.15.40:0/3467350864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22809a260 con 0x7fe2280b4100 2024-09-13T15:34:58.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.535+0000 7fe21f7fe640 1 -- 172.21.15.40:0/3467350864 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7fe218007340 con 0x7fe2280b4100 2024-09-13T15:34:58.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.539+0000 7fe22d26b640 1 -- 172.21.15.40:0/3467350864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2280c04f0 con 0x7fe2280b4100 2024-09-13T15:34:58.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.539+0000 7fe21f7fe640 1 --2- 172.21.15.40:0/3467350864 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fe208035450 0x7fe208037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:58.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.539+0000 7fe21f7fe640 1 -- 172.21.15.40:0/3467350864 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5095+0+0 (secure 0 0 0) 0x7fe218047350 con 0x7fe2280b4100 2024-09-13T15:34:58.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.539+0000 7fe21ffff640 1 --2- 172.21.15.40:0/3467350864 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fe208035450 0x7fe208037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:58.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.539+0000 7fe21ffff640 1 --2- 172.21.15.40:0/3467350864 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fe208035450 0x7fe208037910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe2100ae000 tx=0x7fe210008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:58.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.543+0000 7fe21f7fe640 1 -- 172.21.15.40:0/3467350864 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe218019b40 con 0x7fe2280b4100 2024-09-13T15:34:58.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.759+0000 7fe22d26b640 1 -- 172.21.15.40:0/3467350864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "mds", "allow rwps", "osd", "allow rw tag cephfs *=*", "mgr", "allow r"]} v 0) v1 -- 0x7fe22814e190 con 0x7fe2280b4100 2024-09-13T15:34:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.763+0000 7fe21f7fe640 1 -- 172.21.15.40:0/3467350864 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "mds", "allow rwps", "osd", "allow rw tag cephfs *=*", "mgr", "allow r"]}]=0 updated caps for client.0 v3) v1 ==== 205+0+0 (secure 0 0 0) 0x7fe21801ae40 con 0x7fe2280b4100 2024-09-13T15:34:58.767 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2024-09-13T15:34:58.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.767+0000 7fe22d26b640 1 -- 172.21.15.40:0/3467350864 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fe208035450 msgr2=0x7fe208037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:58.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.767+0000 7fe22d26b640 1 --2- 172.21.15.40:0/3467350864 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fe208035450 0x7fe208037910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe2100ae000 tx=0x7fe210008040 comp rx=0 tx=0).stop 2024-09-13T15:34:58.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.767+0000 7fe22d26b640 1 -- 172.21.15.40:0/3467350864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2280b4100 msgr2=0x7fe228099d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:58.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.767+0000 7fe22d26b640 1 --2- 172.21.15.40:0/3467350864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2280b4100 0x7fe228099d20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe21800c470 tx=0x7fe21800c930 comp rx=0 tx=0).stop 2024-09-13T15:34:58.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.767+0000 7fe22d26b640 1 -- 172.21.15.40:0/3467350864 shutdown_connections 2024-09-13T15:34:58.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.767+0000 7fe22d26b640 1 --2- 172.21.15.40:0/3467350864 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fe208035450 0x7fe208037910 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:58.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.767+0000 7fe22d26b640 1 --2- 172.21.15.40:0/3467350864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2280b4100 0x7fe228099d20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:58.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.767+0000 7fe22d26b640 1 -- 172.21.15.40:0/3467350864 >> 172.21.15.40:0/3467350864 conn(0x7fe22806b4a0 msgr2=0x7fe22806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:58.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.767+0000 7fe22d26b640 1 -- 172.21.15.40:0/3467350864 shutdown_connections 2024-09-13T15:34:58.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.767+0000 7fe22d26b640 1 -- 172.21.15.40:0/3467350864 wait complete. 2024-09-13T15:34:58.787 INFO:teuthology.task.exec:Running commands on role client.2 host ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:34:58.788 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph auth caps client.1 mon '"'"'allow r'"'"' mds '"'"'allow rwps'"'"' osd '"'"'allow rw tag cephfs *=*'"'"' mgr '"'"'allow r'"'"'' 2024-09-13T15:34:58.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.927+0000 7f7d05744640 1 Processor -- start 2024-09-13T15:34:58.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.927+0000 7f7d05744640 1 -- start start 2024-09-13T15:34:58.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.927+0000 7f7d05744640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d0006e800 0x7f7d000b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:58.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.927+0000 7f7d05744640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0006f290 con 0x7f7d0006ebe0 2024-09-13T15:34:58.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.927+0000 7f7d05744640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d000bdc30 con 0x7f7d0006e800 2024-09-13T15:34:58.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.927+0000 7f7cfeffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d0006e800 0x7f7d000b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:58.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.927+0000 7f7cfeffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d0006e800 0x7f7d000b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56832/0 (socket says 172.21.15.40:56832) 2024-09-13T15:34:58.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.927+0000 7f7cfeffd640 1 -- 172.21.15.40:0/3711898279 learned_addr learned my addr 172.21.15.40:0/3711898279 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:58.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.927+0000 7f7cfeffd640 1 -- 172.21.15.40:0/3711898279 >> v1:172.21.15.40:6789/0 conn(0x7f7d0006ebe0 legacy=0x7f7d0015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:58.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.927+0000 7f7cfeffd640 1 -- 172.21.15.40:0/3711898279 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d000a5000 con 0x7f7d0006e800 2024-09-13T15:34:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7cfeffd640 1 --2- 172.21.15.40:0/3711898279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0006e800 0x7f7d000b3fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00097f0 tx=0x7f7cf001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef772f91b5cefc53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7cfdffb640 1 -- 172.21.15.40:0/3711898279 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cf00ab520 con 0x7f7d0006e800 2024-09-13T15:34:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7cfdffb640 1 -- 172.21.15.40:0/3711898279 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf00ab680 con 0x7f7d0006e800 2024-09-13T15:34:58.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7cfdffb640 1 -- 172.21.15.40:0/3711898279 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cf00ab940 con 0x7f7d0006e800 2024-09-13T15:34:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7d05744640 1 -- 172.21.15.40:0/3711898279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0006e800 msgr2=0x7f7d000b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7d05744640 1 --2- 172.21.15.40:0/3711898279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0006e800 0x7f7d000b3fd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7cf00097f0 tx=0x7f7cf001c4e0 comp rx=0 tx=0).stop 2024-09-13T15:34:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7d05744640 1 -- 172.21.15.40:0/3711898279 shutdown_connections 2024-09-13T15:34:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7d05744640 1 --2- 172.21.15.40:0/3711898279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0006e800 0x7f7d000b3fd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:58.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7d05744640 1 -- 172.21.15.40:0/3711898279 >> 172.21.15.40:0/3711898279 conn(0x7f7d0006a5a0 msgr2=0x7f7d000a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:58.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7d05744640 1 -- 172.21.15.40:0/3711898279 shutdown_connections 2024-09-13T15:34:58.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7d05744640 1 -- 172.21.15.40:0/3711898279 wait complete. 2024-09-13T15:34:58.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7d05744640 1 Processor -- start 2024-09-13T15:34:58.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7d05744640 1 -- start start 2024-09-13T15:34:58.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7d05744640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0006e800 0x7f7d00154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:58.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7d05744640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d00154ac0 con 0x7f7d0006e800 2024-09-13T15:34:58.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7cfeffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0006e800 0x7f7d00154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:58.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7cfeffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0006e800 0x7f7d00154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56840/0 (socket says 172.21.15.40:56840) 2024-09-13T15:34:58.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.931+0000 7f7cfeffd640 1 -- 172.21.15.40:0/1556720581 learned_addr learned my addr 172.21.15.40:0/1556720581 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:58.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7cfeffd640 1 -- 172.21.15.40:0/1556720581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf00094d0 con 0x7f7d0006e800 2024-09-13T15:34:58.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7cfeffd640 1 --2- 172.21.15.40:0/1556720581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0006e800 0x7f7d00154480 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7cf001a110 tx=0x7f7cf001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:58.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7ce77fe640 1 -- 172.21.15.40:0/1556720581 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cf00ab4f0 con 0x7f7d0006e800 2024-09-13T15:34:58.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7ce77fe640 1 -- 172.21.15.40:0/1556720581 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf00b4600 con 0x7f7d0006e800 2024-09-13T15:34:58.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7d05744640 1 -- 172.21.15.40:0/1556720581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d000c08b0 con 0x7f7d0006e800 2024-09-13T15:34:58.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7ce77fe640 1 -- 172.21.15.40:0/1556720581 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cf00b48a0 con 0x7f7d0006e800 2024-09-13T15:34:58.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7d05744640 1 -- 172.21.15.40:0/1556720581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d00154fa0 con 0x7f7d0006e800 2024-09-13T15:34:58.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7ce77fe640 1 -- 172.21.15.40:0/1556720581 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f7cf00b4a00 con 0x7f7d0006e800 2024-09-13T15:34:58.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7d05744640 1 -- 172.21.15.40:0/1556720581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d00155190 con 0x7f7d0006e800 2024-09-13T15:34:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7ce77fe640 1 --2- 172.21.15.40:0/1556720581 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7cec035450 0x7f7cec037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7ce77fe640 1 -- 172.21.15.40:0/1556720581 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5095+0+0 (secure 0 0 0) 0x7f7cf00a8050 con 0x7f7d0006e800 2024-09-13T15:34:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7cfe7fc640 1 --2- 172.21.15.40:0/1556720581 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7cec035450 0x7f7cec037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.935+0000 7f7cfe7fc640 1 --2- 172.21.15.40:0/1556720581 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7cec035450 0x7f7cec037910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4007fd0 tx=0x7f7cf4007de0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:58.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:58.939+0000 7f7ce77fe640 1 -- 172.21.15.40:0/1556720581 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7cf00bcd70 con 0x7f7d0006e800 2024-09-13T15:34:59.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.163+0000 7f7d05744640 1 -- 172.21.15.40:0/1556720581 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "mds", "allow rwps", "osd", "allow rw tag cephfs *=*", "mgr", "allow r"]} v 0) v1 -- 0x7f7d000b3fd0 con 0x7f7d0006e800 2024-09-13T15:34:59.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.167+0000 7f7ce77fe640 1 -- 172.21.15.40:0/1556720581 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "mds", "allow rwps", "osd", "allow rw tag cephfs *=*", "mgr", "allow r"]}]=0 updated caps for client.1 v4) v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cf00bc340 con 0x7f7d0006e800 2024-09-13T15:34:59.169 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.1 2024-09-13T15:34:59.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.167+0000 7f7d05744640 1 -- 172.21.15.40:0/1556720581 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7cec035450 msgr2=0x7f7cec037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:59.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.167+0000 7f7d05744640 1 --2- 172.21.15.40:0/1556720581 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7cec035450 0x7f7cec037910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4007fd0 tx=0x7f7cf4007de0 comp rx=0 tx=0).stop 2024-09-13T15:34:59.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.167+0000 7f7d05744640 1 -- 172.21.15.40:0/1556720581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0006e800 msgr2=0x7f7d00154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:59.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.167+0000 7f7d05744640 1 --2- 172.21.15.40:0/1556720581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0006e800 0x7f7d00154480 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7cf001a110 tx=0x7f7cf001ad20 comp rx=0 tx=0).stop 2024-09-13T15:34:59.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.167+0000 7f7d05744640 1 -- 172.21.15.40:0/1556720581 shutdown_connections 2024-09-13T15:34:59.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.167+0000 7f7d05744640 1 --2- 172.21.15.40:0/1556720581 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7cec035450 0x7f7cec037910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:59.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.167+0000 7f7d05744640 1 --2- 172.21.15.40:0/1556720581 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d0006e800 0x7f7d00154480 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:59.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.167+0000 7f7d05744640 1 -- 172.21.15.40:0/1556720581 >> 172.21.15.40:0/1556720581 conn(0x7f7d0006a5a0 msgr2=0x7f7d00150b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:59.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.167+0000 7f7d05744640 1 -- 172.21.15.40:0/1556720581 shutdown_connections 2024-09-13T15:34:59.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.167+0000 7f7d05744640 1 -- 172.21.15.40:0/1556720581 wait complete. 2024-09-13T15:34:59.187 INFO:teuthology.task.exec:Running commands on role client.mirror1 host ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:34:59.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph auth caps client.mirror1 mon '"'"'profile cephfs-mirror'"'"' mds '"'"'allow r'"'"' osd '"'"'allow rw tag cephfs metadata=*, allow r tag cephfs data=*'"'"' mgr '"'"'allow r'"'"'' 2024-09-13T15:34:59.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.339+0000 7f2bd6dc7640 1 Processor -- start 2024-09-13T15:34:59.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.339+0000 7f2bd6dc7640 1 -- start start 2024-09-13T15:34:59.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd6dc7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2bd00c2bf0 0x7f2bd00b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:59.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd6dc7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd00a7ce0 con 0x7f2bd008ba30 2024-09-13T15:34:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd6dc7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd01539d0 con 0x7f2bd00c2bf0 2024-09-13T15:34:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd4b63640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2bd00c2bf0 0x7f2bd00b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd4b63640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2bd00c2bf0 0x7f2bd00b7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56854/0 (socket says 172.21.15.40:56854) 2024-09-13T15:34:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd4b63640 1 -- 172.21.15.40:0/631120073 learned_addr learned my addr 172.21.15.40:0/631120073 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bcffff640 1 --1- 172.21.15.40:0/631120073 >> v1:172.21.15.40:6789/0 conn(0x7f2bd008ba30 0x7f2bd00a50a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47720/0 (socket says 172.21.15.40:47720) 2024-09-13T15:34:59.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd4b63640 1 -- 172.21.15.40:0/631120073 >> v1:172.21.15.40:6789/0 conn(0x7f2bd008ba30 legacy=0x7f2bd00a50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:59.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd4b63640 1 -- 172.21.15.40:0/631120073 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd01525e0 con 0x7f2bd00c2bf0 2024-09-13T15:34:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd4b63640 1 --2- 172.21.15.40:0/631120073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bd00c2bf0 0x7f2bd00b7c80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40097f0 tx=0x7f2bc401c190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1f98942c38320e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bcf7fe640 1 -- 172.21.15.40:0/631120073 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bc40ab400 con 0x7f2bd00c2bf0 2024-09-13T15:34:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bcf7fe640 1 -- 172.21.15.40:0/631120073 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc40a7050 con 0x7f2bd00c2bf0 2024-09-13T15:34:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bcf7fe640 1 -- 172.21.15.40:0/631120073 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bc40ab6b0 con 0x7f2bd00c2bf0 2024-09-13T15:34:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/631120073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bd00c2bf0 msgr2=0x7f2bd00b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd6dc7640 1 --2- 172.21.15.40:0/631120073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bd00c2bf0 0x7f2bd00b7c80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40097f0 tx=0x7f2bc401c190 comp rx=0 tx=0).stop 2024-09-13T15:34:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/631120073 shutdown_connections 2024-09-13T15:34:59.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd6dc7640 1 --2- 172.21.15.40:0/631120073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bd00c2bf0 0x7f2bd00b7c80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:59.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.343+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/631120073 >> 172.21.15.40:0/631120073 conn(0x7f2bd00a8980 msgr2=0x7f2bd0065bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:59.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/631120073 shutdown_connections 2024-09-13T15:34:59.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/631120073 wait complete. 2024-09-13T15:34:59.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd6dc7640 1 Processor -- start 2024-09-13T15:34:59.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd6dc7640 1 -- start start 2024-09-13T15:34:59.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd6dc7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bd008ba30 0x7f2bd009cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:59.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd6dc7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd0149540 con 0x7f2bd008ba30 2024-09-13T15:34:59.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd4b63640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bd008ba30 0x7f2bd009cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:59.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd4b63640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bd008ba30 0x7f2bd009cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56856/0 (socket says 172.21.15.40:56856) 2024-09-13T15:34:59.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd4b63640 1 -- 172.21.15.40:0/1222532286 learned_addr learned my addr 172.21.15.40:0/1222532286 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:59.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd4b63640 1 -- 172.21.15.40:0/1222532286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc40094d0 con 0x7f2bd008ba30 2024-09-13T15:34:59.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd4b63640 1 --2- 172.21.15.40:0/1222532286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bd008ba30 0x7f2bd009cc80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4019dc0 tx=0x7f2bc401a9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:59.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bcd7fa640 1 -- 172.21.15.40:0/1222532286 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bc40abea0 con 0x7f2bd008ba30 2024-09-13T15:34:59.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bcd7fa640 1 -- 172.21.15.40:0/1222532286 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc40b6420 con 0x7f2bd008ba30 2024-09-13T15:34:59.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bcd7fa640 1 -- 172.21.15.40:0/1222532286 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2bc40b66e0 con 0x7f2bd008ba30 2024-09-13T15:34:59.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/1222532286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd0149770 con 0x7f2bd008ba30 2024-09-13T15:34:59.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/1222532286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd009d1c0 con 0x7f2bd008ba30 2024-09-13T15:34:59.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.347+0000 7f2bcd7fa640 1 -- 172.21.15.40:0/1222532286 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f2bc40b2040 con 0x7f2bd008ba30 2024-09-13T15:34:59.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.351+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/1222532286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd0151ed0 con 0x7f2bd008ba30 2024-09-13T15:34:59.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.351+0000 7f2bcd7fa640 1 --2- 172.21.15.40:0/1222532286 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2bb4035450 0x7f2bb4037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:59.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.351+0000 7f2bcd7fa640 1 -- 172.21.15.40:0/1222532286 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5095+0+0 (secure 0 0 0) 0x7f2bc40a4e40 con 0x7f2bd008ba30 2024-09-13T15:34:59.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.351+0000 7f2bcffff640 1 --2- 172.21.15.40:0/1222532286 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2bb4035450 0x7f2bb4037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:59.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.351+0000 7f2bcffff640 1 --2- 172.21.15.40:0/1222532286 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2bb4035450 0x7f2bb4037910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2bd008be10 tx=0x7f2bbc007a50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:59.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.355+0000 7f2bcd7fa640 1 -- 172.21.15.40:0/1222532286 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2bc4113db0 con 0x7f2bd008ba30 2024-09-13T15:34:59.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.571+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/1222532286 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.mirror1", "caps": ["mon", "profile cephfs-mirror", "mds", "allow r", "osd", "allow rw tag cephfs metadata=*, allow r tag cephfs data=*", "mgr", "allow r"]} v 0) v1 -- 0x7f2bd00a5540 con 0x7f2bd008ba30 2024-09-13T15:34:59.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.579+0000 7f2bcd7fa640 1 -- 172.21.15.40:0/1222532286 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.mirror1", "caps": ["mon", "profile cephfs-mirror", "mds", "allow r", "osd", "allow rw tag cephfs metadata=*, allow r tag cephfs data=*", "mgr", "allow r"]}]=0 updated caps for client.mirror1 v5) v1 ==== 262+0+0 (secure 0 0 0) 0x7f2bc40b0020 con 0x7f2bd008ba30 2024-09-13T15:34:59.581 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.mirror1 2024-09-13T15:34:59.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.579+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/1222532286 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2bb4035450 msgr2=0x7f2bb4037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:59.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.579+0000 7f2bd6dc7640 1 --2- 172.21.15.40:0/1222532286 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2bb4035450 0x7f2bb4037910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2bd008be10 tx=0x7f2bbc007a50 comp rx=0 tx=0).stop 2024-09-13T15:34:59.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.579+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/1222532286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bd008ba30 msgr2=0x7f2bd009cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:59.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.579+0000 7f2bd6dc7640 1 --2- 172.21.15.40:0/1222532286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bd008ba30 0x7f2bd009cc80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4019dc0 tx=0x7f2bc401a9d0 comp rx=0 tx=0).stop 2024-09-13T15:34:59.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.579+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/1222532286 shutdown_connections 2024-09-13T15:34:59.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.583+0000 7f2bd6dc7640 1 --2- 172.21.15.40:0/1222532286 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f2bb4035450 0x7f2bb4037910 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:59.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.583+0000 7f2bd6dc7640 1 --2- 172.21.15.40:0/1222532286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bd008ba30 0x7f2bd009cc80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:59.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.583+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/1222532286 >> 172.21.15.40:0/1222532286 conn(0x7f2bd00a8980 msgr2=0x7f2bd0161ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:59.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.583+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/1222532286 shutdown_connections 2024-09-13T15:34:59.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.583+0000 7f2bd6dc7640 1 -- 172.21.15.40:0/1222532286 wait complete. 2024-09-13T15:34:59.601 INFO:teuthology.task.exec:Running commands on role client.mirror2 host ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:34:59.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph auth caps client.mirror2 mon '"'"'profile cephfs-mirror'"'"' mds '"'"'allow r'"'"' osd '"'"'allow rw tag cephfs metadata=*, allow r tag cephfs data=*'"'"' mgr '"'"'allow r'"'"'' 2024-09-13T15:34:59.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.743+0000 7f8c6614e640 1 Processor -- start 2024-09-13T15:34:59.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.743+0000 7f8c6614e640 1 -- start start 2024-09-13T15:34:59.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.743+0000 7f8c6614e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c600bc750 0x7f8c600bcb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:59.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.743+0000 7f8c6614e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c600c01a0 con 0x7f8c600bfd10 2024-09-13T15:34:59.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.743+0000 7f8c6614e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c600a4a80 con 0x7f8c600bc750 2024-09-13T15:34:59.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.743+0000 7f8c5f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c600bc750 0x7f8c600bcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:59.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.743+0000 7f8c5effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8c600bfd10 0x7f8c600bd070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47726/0 (socket says 172.21.15.40:47726) 2024-09-13T15:34:59.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.743+0000 7f8c5effd640 1 -- 172.21.15.40:0/2623728901 learned_addr learned my addr 172.21.15.40:0/2623728901 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:34:59.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.743+0000 7f8c5f7fe640 1 -- 172.21.15.40:0/2623728901 >> v1:172.21.15.40:6789/0 conn(0x7f8c600bfd10 legacy=0x7f8c600bd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:59.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.743+0000 7f8c5f7fe640 1 -- 172.21.15.40:0/2623728901 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c600a4bf0 con 0x7f8c600bc750 2024-09-13T15:34:59.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.743+0000 7f8c5e7fc640 1 -- 172.21.15.40:0/2623728901 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462478980 0 0) 0x7f8c600c01a0 con 0x7f8c600bfd10 2024-09-13T15:34:59.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c5f7fe640 1 --2- 172.21.15.40:0/2623728901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c600bc750 0x7f8c600bcb30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009740 tx=0x7f8c5001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314b795bdeebde75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:59.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c5e7fc640 1 -- 172.21.15.40:0/2623728901 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c500ab530 con 0x7f8c600bc750 2024-09-13T15:34:59.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c5e7fc640 1 -- 172.21.15.40:0/2623728901 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c500a7050 con 0x7f8c600bc750 2024-09-13T15:34:59.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c5e7fc640 1 -- 172.21.15.40:0/2623728901 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c500ab7e0 con 0x7f8c600bc750 2024-09-13T15:34:59.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c6614e640 1 -- 172.21.15.40:0/2623728901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c600bc750 msgr2=0x7f8c600bcb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:59.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c6614e640 1 --2- 172.21.15.40:0/2623728901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c600bc750 0x7f8c600bcb30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8c50009740 tx=0x7f8c5001c420 comp rx=0 tx=0).stop 2024-09-13T15:34:59.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c6614e640 1 -- 172.21.15.40:0/2623728901 shutdown_connections 2024-09-13T15:34:59.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c6614e640 1 --2- 172.21.15.40:0/2623728901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c600bc750 0x7f8c600bcb30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:59.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c6614e640 1 -- 172.21.15.40:0/2623728901 >> 172.21.15.40:0/2623728901 conn(0x7f8c6006a5a0 msgr2=0x7f8c600a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:59.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c6614e640 1 -- 172.21.15.40:0/2623728901 shutdown_connections 2024-09-13T15:34:59.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c6614e640 1 -- 172.21.15.40:0/2623728901 wait complete. 2024-09-13T15:34:59.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c6614e640 1 Processor -- start 2024-09-13T15:34:59.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c6614e640 1 -- start start 2024-09-13T15:34:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c6614e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c600bc750 0x7f8c60161f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c6614e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c60162440 con 0x7f8c600bc750 2024-09-13T15:34:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c5f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c600bc750 0x7f8c60161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c5f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c600bc750 0x7f8c60161f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56886/0 (socket says 172.21.15.40:56886) 2024-09-13T15:34:59.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c5f7fe640 1 -- 172.21.15.40:0/30174148 learned_addr learned my addr 172.21.15.40:0/30174148 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:34:59.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c5f7fe640 1 -- 172.21.15.40:0/30174148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c50009420 con 0x7f8c600bc750 2024-09-13T15:34:59.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.747+0000 7f8c5f7fe640 1 --2- 172.21.15.40:0/30174148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c600bc750 0x7f8c60161f00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8c5001a050 tx=0x7f8c5001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:59.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.751+0000 7f8c47fff640 1 -- 172.21.15.40:0/30174148 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c500b7450 con 0x7f8c600bc750 2024-09-13T15:34:59.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.751+0000 7f8c47fff640 1 -- 172.21.15.40:0/30174148 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c500b75b0 con 0x7f8c600bc750 2024-09-13T15:34:59.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.751+0000 7f8c6614e640 1 -- 172.21.15.40:0/30174148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c601fa210 con 0x7f8c600bc750 2024-09-13T15:34:59.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.751+0000 7f8c47fff640 1 -- 172.21.15.40:0/30174148 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c500b7870 con 0x7f8c600bc750 2024-09-13T15:34:59.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.751+0000 7f8c6614e640 1 -- 172.21.15.40:0/30174148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6014d8c0 con 0x7f8c600bc750 2024-09-13T15:34:59.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.751+0000 7f8c6614e640 1 -- 172.21.15.40:0/30174148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c60161d50 con 0x7f8c600bc750 2024-09-13T15:34:59.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.751+0000 7f8c47fff640 1 -- 172.21.15.40:0/30174148 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f8c500b79d0 con 0x7f8c600bc750 2024-09-13T15:34:59.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.751+0000 7f8c47fff640 1 --2- 172.21.15.40:0/30174148 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8c4c035450 0x7f8c4c037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:34:59.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.751+0000 7f8c47fff640 1 -- 172.21.15.40:0/30174148 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5095+0+0 (secure 0 0 0) 0x7f8c500e2520 con 0x7f8c600bc750 2024-09-13T15:34:59.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.751+0000 7f8c5effd640 1 --2- 172.21.15.40:0/30174148 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8c4c035450 0x7f8c4c037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:34:59.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.751+0000 7f8c5effd640 1 --2- 172.21.15.40:0/30174148 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8c4c035450 0x7f8c4c037910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c54007fd0 tx=0x7f8c54007920 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:34:59.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.755+0000 7f8c47fff640 1 -- 172.21.15.40:0/30174148 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c500c76c0 con 0x7f8c600bc750 2024-09-13T15:34:59.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.975+0000 7f8c6614e640 1 -- 172.21.15.40:0/30174148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.mirror2", "caps": ["mon", "profile cephfs-mirror", "mds", "allow r", "osd", "allow rw tag cephfs metadata=*, allow r tag cephfs data=*", "mgr", "allow r"]} v 0) v1 -- 0x7f8c6015f840 con 0x7f8c600bc750 2024-09-13T15:34:59.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.983+0000 7f8c47fff640 1 -- 172.21.15.40:0/30174148 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.mirror2", "caps": ["mon", "profile cephfs-mirror", "mds", "allow r", "osd", "allow rw tag cephfs metadata=*, allow r tag cephfs data=*", "mgr", "allow r"]}]=0 updated caps for client.mirror2 v6) v1 ==== 262+0+0 (secure 0 0 0) 0x7f8c500bb120 con 0x7f8c600bc750 2024-09-13T15:34:59.984 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.mirror2 2024-09-13T15:34:59.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.983+0000 7f8c6614e640 1 -- 172.21.15.40:0/30174148 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8c4c035450 msgr2=0x7f8c4c037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:59.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.983+0000 7f8c6614e640 1 --2- 172.21.15.40:0/30174148 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8c4c035450 0x7f8c4c037910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8c54007fd0 tx=0x7f8c54007920 comp rx=0 tx=0).stop 2024-09-13T15:34:59.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.983+0000 7f8c6614e640 1 -- 172.21.15.40:0/30174148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c600bc750 msgr2=0x7f8c60161f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:34:59.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.983+0000 7f8c6614e640 1 --2- 172.21.15.40:0/30174148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c600bc750 0x7f8c60161f00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8c5001a050 tx=0x7f8c5001ac60 comp rx=0 tx=0).stop 2024-09-13T15:34:59.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.983+0000 7f8c6614e640 1 -- 172.21.15.40:0/30174148 shutdown_connections 2024-09-13T15:34:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.983+0000 7f8c6614e640 1 --2- 172.21.15.40:0/30174148 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8c4c035450 0x7f8c4c037910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.983+0000 7f8c6614e640 1 --2- 172.21.15.40:0/30174148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c600bc750 0x7f8c60161f00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:34:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.983+0000 7f8c6614e640 1 -- 172.21.15.40:0/30174148 >> 172.21.15.40:0/30174148 conn(0x7f8c6006a5a0 msgr2=0x7f8c601480d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:34:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.983+0000 7f8c6614e640 1 -- 172.21.15.40:0/30174148 shutdown_connections 2024-09-13T15:34:59.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:34:59.983+0000 7f8c6614e640 1 -- 172.21.15.40:0/30174148 wait complete. 2024-09-13T15:35:00.003 INFO:teuthology.task.exec:Running commands on role client.mirror3 host ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:35:00.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph auth caps client.mirror3 mon '"'"'profile cephfs-mirror'"'"' mds '"'"'allow r'"'"' osd '"'"'allow rw tag cephfs metadata=*, allow r tag cephfs data=*'"'"' mgr '"'"'allow r'"'"'' 2024-09-13T15:35:00.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.135+0000 7f8c5094d640 1 Processor -- start 2024-09-13T15:35:00.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.135+0000 7f8c5094d640 1 -- start start 2024-09-13T15:35:00.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.135+0000 7f8c5094d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c4c0a5310 0x7f8c4c08c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:35:00.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.135+0000 7f8c5094d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4c153de0 con 0x7f8c4c0a56f0 2024-09-13T15:35:00.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.135+0000 7f8c5094d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4c0a78d0 con 0x7f8c4c0a5310 2024-09-13T15:35:00.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.135+0000 7f8c4a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c4c0a5310 0x7f8c4c08c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:35:00.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.135+0000 7f8c43fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8c4c0a56f0 0x7f8c4c08b070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:47732/0 (socket says 172.21.15.40:47732) 2024-09-13T15:35:00.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.135+0000 7f8c4a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c4c0a5310 0x7f8c4c08c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56898/0 (socket says 172.21.15.40:56898) 2024-09-13T15:35:00.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.135+0000 7f8c43fff640 1 -- 172.21.15.40:0/4062676479 learned_addr learned my addr 172.21.15.40:0/4062676479 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:35:00.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.135+0000 7f8c4a59c640 1 -- 172.21.15.40:0/4062676479 >> v1:172.21.15.40:6789/0 conn(0x7f8c4c0a56f0 legacy=0x7f8c4c08b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:00.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.135+0000 7f8c4a59c640 1 -- 172.21.15.40:0/4062676479 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c152550 con 0x7f8c4c0a5310 2024-09-13T15:35:00.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.135+0000 7f8c4a59c640 1 --2- 172.21.15.40:0/4062676479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c4c0a5310 0x7f8c4c08c100 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009740 tx=0x7f8c3c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cb6668a236e1f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:35:00.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c49d9b640 1 -- 172.21.15.40:0/4062676479 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c3c0ac540 con 0x7f8c4c0a5310 2024-09-13T15:35:00.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c49d9b640 1 -- 172.21.15.40:0/4062676479 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c0ac6a0 con 0x7f8c4c0a5310 2024-09-13T15:35:00.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c49d9b640 1 -- 172.21.15.40:0/4062676479 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c3c0ac960 con 0x7f8c4c0a5310 2024-09-13T15:35:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 -- 172.21.15.40:0/4062676479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c4c0a5310 msgr2=0x7f8c4c08c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 --2- 172.21.15.40:0/4062676479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c4c0a5310 0x7f8c4c08c100 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c009740 tx=0x7f8c3c01c390 comp rx=0 tx=0).stop 2024-09-13T15:35:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 -- 172.21.15.40:0/4062676479 shutdown_connections 2024-09-13T15:35:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 --2- 172.21.15.40:0/4062676479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c4c0a5310 0x7f8c4c08c100 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:35:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 -- 172.21.15.40:0/4062676479 >> 172.21.15.40:0/4062676479 conn(0x7f8c4c0a87a0 msgr2=0x7f8c4c065bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:35:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 -- 172.21.15.40:0/4062676479 shutdown_connections 2024-09-13T15:35:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 -- 172.21.15.40:0/4062676479 wait complete. 2024-09-13T15:35:00.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 Processor -- start 2024-09-13T15:35:00.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 -- start start 2024-09-13T15:35:00.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c4c0a5310 0x7f8c4c13cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:35:00.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c156be0 con 0x7f8c4c0a5310 2024-09-13T15:35:00.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c4a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c4c0a5310 0x7f8c4c13cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:35:00.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c4a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c4c0a5310 0x7f8c4c13cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56914/0 (socket says 172.21.15.40:56914) 2024-09-13T15:35:00.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c4a59c640 1 -- 172.21.15.40:0/3914909670 learned_addr learned my addr 172.21.15.40:0/3914909670 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:35:00.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c4a59c640 1 -- 172.21.15.40:0/3914909670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c009420 con 0x7f8c4c0a5310 2024-09-13T15:35:00.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c4a59c640 1 --2- 172.21.15.40:0/3914909670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c4c0a5310 0x7f8c4c13cbf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c019fc0 tx=0x7f8c3c01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:35:00.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c42ffd640 1 -- 172.21.15.40:0/3914909670 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c3c0b8580 con 0x7f8c4c0a5310 2024-09-13T15:35:00.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c42ffd640 1 -- 172.21.15.40:0/3914909670 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c0b86e0 con 0x7f8c4c0a5310 2024-09-13T15:35:00.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 -- 172.21.15.40:0/3914909670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4c15fa00 con 0x7f8c4c0a5310 2024-09-13T15:35:00.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c42ffd640 1 -- 172.21.15.40:0/3914909670 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c3c0b89a0 con 0x7f8c4c0a5310 2024-09-13T15:35:00.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.139+0000 7f8c5094d640 1 -- 172.21.15.40:0/3914909670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4c14c390 con 0x7f8c4c0a5310 2024-09-13T15:35:00.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.143+0000 7f8c42ffd640 1 -- 172.21.15.40:0/3914909670 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f8c3c0b8b00 con 0x7f8c4c0a5310 2024-09-13T15:35:00.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.143+0000 7f8c5094d640 1 -- 172.21.15.40:0/3914909670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4c08c100 con 0x7f8c4c0a5310 2024-09-13T15:35:00.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.143+0000 7f8c42ffd640 1 --2- 172.21.15.40:0/3914909670 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8c2c035450 0x7f8c2c037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:35:00.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.143+0000 7f8c42ffd640 1 -- 172.21.15.40:0/3914909670 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5095+0+0 (secure 0 0 0) 0x7f8c3c0e2790 con 0x7f8c4c0a5310 2024-09-13T15:35:00.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.143+0000 7f8c43fff640 1 --2- 172.21.15.40:0/3914909670 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8c2c035450 0x7f8c2c037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:35:00.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.147+0000 7f8c43fff640 1 --2- 172.21.15.40:0/3914909670 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8c2c035450 0x7f8c2c037910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8c34005890 tx=0x7f8c34007a90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:35:00.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.147+0000 7f8c42ffd640 1 -- 172.21.15.40:0/3914909670 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8c3c0b8db0 con 0x7f8c4c0a5310 2024-09-13T15:35:00.345 INFO:tasks.ceph.mds.c.smithi040.stderr:2024-09-13T15:35:00.343+0000 7fc3b0716640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:35:00.346 INFO:tasks.ceph.mds.a.smithi040.stderr:2024-09-13T15:35:00.343+0000 7ff7379b1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:35:00.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.371+0000 7f8c5094d640 1 -- 172.21.15.40:0/3914909670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.mirror3", "caps": ["mon", "profile cephfs-mirror", "mds", "allow r", "osd", "allow rw tag cephfs metadata=*, allow r tag cephfs data=*", "mgr", "allow r"]} v 0) v1 -- 0x7f8c4c0a6d50 con 0x7f8c4c0a5310 2024-09-13T15:35:00.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.379+0000 7f8c42ffd640 1 -- 172.21.15.40:0/3914909670 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.mirror3", "caps": ["mon", "profile cephfs-mirror", "mds", "allow r", "osd", "allow rw tag cephfs metadata=*, allow r tag cephfs data=*", "mgr", "allow r"]}]=0 updated caps for client.mirror3 v7) v1 ==== 262+0+0 (secure 0 0 0) 0x7f8c3c0b1120 con 0x7f8c4c0a5310 2024-09-13T15:35:00.382 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.mirror3 2024-09-13T15:35:00.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.383+0000 7f8c5094d640 1 -- 172.21.15.40:0/3914909670 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8c2c035450 msgr2=0x7f8c2c037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:00.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.383+0000 7f8c5094d640 1 --2- 172.21.15.40:0/3914909670 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8c2c035450 0x7f8c2c037910 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8c34005890 tx=0x7f8c34007a90 comp rx=0 tx=0).stop 2024-09-13T15:35:00.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.383+0000 7f8c5094d640 1 -- 172.21.15.40:0/3914909670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c4c0a5310 msgr2=0x7f8c4c13cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:00.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.383+0000 7f8c5094d640 1 --2- 172.21.15.40:0/3914909670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c4c0a5310 0x7f8c4c13cbf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c019fc0 tx=0x7f8c3c01abd0 comp rx=0 tx=0).stop 2024-09-13T15:35:00.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.383+0000 7f8c5094d640 1 -- 172.21.15.40:0/3914909670 shutdown_connections 2024-09-13T15:35:00.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.383+0000 7f8c5094d640 1 --2- 172.21.15.40:0/3914909670 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f8c2c035450 0x7f8c2c037910 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:35:00.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.383+0000 7f8c5094d640 1 --2- 172.21.15.40:0/3914909670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c4c0a5310 0x7f8c4c13cbf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:35:00.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.383+0000 7f8c5094d640 1 -- 172.21.15.40:0/3914909670 >> 172.21.15.40:0/3914909670 conn(0x7f8c4c0a87a0 msgr2=0x7f8c4c150720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:35:00.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.383+0000 7f8c5094d640 1 -- 172.21.15.40:0/3914909670 shutdown_connections 2024-09-13T15:35:00.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.383+0000 7f8c5094d640 1 -- 172.21.15.40:0/3914909670 wait complete. 2024-09-13T15:35:00.400 INFO:teuthology.task.exec:Running commands on role client.mirror_remote host ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:35:00.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph auth caps client.mirror_remote mon '"'"'allow r'"'"' mds '"'"'allow rwps'"'"' osd '"'"'allow rw tag cephfs *=*'"'"' mgr '"'"'allow r'"'"'' 2024-09-13T15:35:00.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.527+0000 7f7f0006f640 1 Processor -- start 2024-09-13T15:35:00.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.527+0000 7f7f0006f640 1 -- start start 2024-09-13T15:35:00.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.527+0000 7f7f0006f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ef806ebe0 0x7f7ef80b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:35:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.527+0000 7f7f0006f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef80b46e0 con 0x7f7ef806e800 2024-09-13T15:35:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.527+0000 7f7f0006f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef806f290 con 0x7f7ef806ebe0 2024-09-13T15:35:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.527+0000 7f7efd60a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ef806ebe0 0x7f7ef80b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:35:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.527+0000 7f7efd60a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ef806ebe0 0x7f7ef80b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56922/0 (socket says 172.21.15.40:56922) 2024-09-13T15:35:00.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.527+0000 7f7efd60a640 1 -- 172.21.15.40:0/3232748499 learned_addr learned my addr 172.21.15.40:0/3232748499 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:35:00.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.527+0000 7f7efd60a640 1 -- 172.21.15.40:0/3232748499 >> v1:172.21.15.40:6789/0 conn(0x7f7ef806e800 legacy=0x7f7ef80b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:00.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.527+0000 7f7efd60a640 1 -- 172.21.15.40:0/3232748499 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80bdc30 con 0x7f7ef806ebe0 2024-09-13T15:35:00.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7efd60a640 1 --2- 172.21.15.40:0/3232748499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef806ebe0 0x7f7ef80b54a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0097f0 tx=0x7f7eec01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57c9254b4e692ec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:35:00.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7efce09640 1 -- 172.21.15.40:0/3232748499 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7eec0ab530 con 0x7f7ef806ebe0 2024-09-13T15:35:00.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7efce09640 1 -- 172.21.15.40:0/3232748499 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec0a7050 con 0x7f7ef806ebe0 2024-09-13T15:35:00.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7efce09640 1 -- 172.21.15.40:0/3232748499 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7eec0ab7e0 con 0x7f7ef806ebe0 2024-09-13T15:35:00.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 -- 172.21.15.40:0/3232748499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef806ebe0 msgr2=0x7f7ef80b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:00.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 --2- 172.21.15.40:0/3232748499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef806ebe0 0x7f7ef80b54a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0097f0 tx=0x7f7eec01c4e0 comp rx=0 tx=0).stop 2024-09-13T15:35:00.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 -- 172.21.15.40:0/3232748499 shutdown_connections 2024-09-13T15:35:00.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 --2- 172.21.15.40:0/3232748499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef806ebe0 0x7f7ef80b54a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:35:00.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 -- 172.21.15.40:0/3232748499 >> 172.21.15.40:0/3232748499 conn(0x7f7ef806a5a0 msgr2=0x7f7ef80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:35:00.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 -- 172.21.15.40:0/3232748499 shutdown_connections 2024-09-13T15:35:00.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 -- 172.21.15.40:0/3232748499 wait complete. 2024-09-13T15:35:00.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 Processor -- start 2024-09-13T15:35:00.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 -- start start 2024-09-13T15:35:00.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef806e800 0x7f7ef815e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:35:00.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef815eec0 con 0x7f7ef806e800 2024-09-13T15:35:00.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7efde0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef806e800 0x7f7ef815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:35:00.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7efde0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef806e800 0x7f7ef815e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56932/0 (socket says 172.21.15.40:56932) 2024-09-13T15:35:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7efde0b640 1 -- 172.21.15.40:0/3545913000 learned_addr learned my addr 172.21.15.40:0/3545913000 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:35:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7efde0b640 1 -- 172.21.15.40:0/3545913000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec0094d0 con 0x7f7ef806e800 2024-09-13T15:35:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7efde0b640 1 --2- 172.21.15.40:0/3545913000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef806e800 0x7f7ef815e920 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000c7f0 tx=0x7f7ef000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:35:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7ef67fc640 1 -- 172.21.15.40:0/3545913000 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ef0006c90 con 0x7f7ef806e800 2024-09-13T15:35:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7ef67fc640 1 -- 172.21.15.40:0/3545913000 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef0006e10 con 0x7f7ef806e800 2024-09-13T15:35:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 -- 172.21.15.40:0/3545913000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef814c770 con 0x7f7ef806e800 2024-09-13T15:35:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7ef67fc640 1 -- 172.21.15.40:0/3545913000 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ef000a960 con 0x7f7ef806e800 2024-09-13T15:35:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.531+0000 7f7f0006f640 1 -- 172.21.15.40:0/3545913000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef8160360 con 0x7f7ef806e800 2024-09-13T15:35:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.535+0000 7f7f0006f640 1 -- 172.21.15.40:0/3545913000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef80b54a0 con 0x7f7ef806e800 2024-09-13T15:35:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.535+0000 7f7ef67fc640 1 -- 172.21.15.40:0/3545913000 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f7ef000aac0 con 0x7f7ef806e800 2024-09-13T15:35:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.535+0000 7f7ef67fc640 1 --2- 172.21.15.40:0/3545913000 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7ee4035450 0x7f7ee4037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:35:00.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.535+0000 7f7ef67fc640 1 -- 172.21.15.40:0/3545913000 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5095+0+0 (secure 0 0 0) 0x7f7ef0047540 con 0x7f7ef806e800 2024-09-13T15:35:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.535+0000 7f7efd60a640 1 --2- 172.21.15.40:0/3545913000 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7ee4035450 0x7f7ee4037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:35:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.535+0000 7f7efd60a640 1 --2- 172.21.15.40:0/3545913000 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7ee4035450 0x7f7ee4037910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0ad000 tx=0x7f7eec0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:35:00.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.539+0000 7f7ef67fc640 1 -- 172.21.15.40:0/3545913000 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ef0019310 con 0x7f7ef806e800 2024-09-13T15:35:00.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.747+0000 7f7f0006f640 1 -- 172.21.15.40:0/3545913000 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.mirror_remote", "caps": ["mon", "allow r", "mds", "allow rwps", "osd", "allow rw tag cephfs *=*", "mgr", "allow r"]} v 0) v1 -- 0x7f7ef815f2e0 con 0x7f7ef806e800 2024-09-13T15:35:00.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.755+0000 7f7ef67fc640 1 -- 172.21.15.40:0/3545913000 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.mirror_remote", "caps": ["mon", "allow r", "mds", "allow rwps", "osd", "allow rw tag cephfs *=*", "mgr", "allow r"]}]=0 updated caps for client.mirror_remote v8) v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ef0016070 con 0x7f7ef806e800 2024-09-13T15:35:00.758 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.mirror_remote 2024-09-13T15:35:00.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.759+0000 7f7f0006f640 1 -- 172.21.15.40:0/3545913000 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7ee4035450 msgr2=0x7f7ee4037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:00.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.759+0000 7f7f0006f640 1 --2- 172.21.15.40:0/3545913000 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7ee4035450 0x7f7ee4037910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0ad000 tx=0x7f7eec0a6000 comp rx=0 tx=0).stop 2024-09-13T15:35:00.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.759+0000 7f7f0006f640 1 -- 172.21.15.40:0/3545913000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef806e800 msgr2=0x7f7ef815e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:00.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.759+0000 7f7f0006f640 1 --2- 172.21.15.40:0/3545913000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef806e800 0x7f7ef815e920 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000c7f0 tx=0x7f7ef000ccb0 comp rx=0 tx=0).stop 2024-09-13T15:35:00.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.759+0000 7f7f0006f640 1 -- 172.21.15.40:0/3545913000 shutdown_connections 2024-09-13T15:35:00.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.759+0000 7f7f0006f640 1 --2- 172.21.15.40:0/3545913000 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f7ee4035450 0x7f7ee4037910 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:35:00.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.759+0000 7f7f0006f640 1 --2- 172.21.15.40:0/3545913000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ef806e800 0x7f7ef815e920 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:35:00.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.759+0000 7f7f0006f640 1 -- 172.21.15.40:0/3545913000 >> 172.21.15.40:0/3545913000 conn(0x7f7ef806a5a0 msgr2=0x7f7ef815b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:35:00.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.759+0000 7f7f0006f640 1 -- 172.21.15.40:0/3545913000 shutdown_connections 2024-09-13T15:35:00.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:00.759+0000 7f7f0006f640 1 -- 172.21.15.40:0/3545913000 wait complete. 2024-09-13T15:35:00.776 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T15:35:00.810 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T15:35:00.810 INFO:tasks.ceph_fuse:config is {'client.1': {'cephfs_name': 'dc'}, 'client.2': {'cephfs_name': 'dc-backup'}} 2024-09-13T15:35:00.811 INFO:tasks.ceph_fuse:client.1 config is {'cephfs_name': 'dc'} 2024-09-13T15:35:00.811 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T15:35:00.811 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T15:35:00.811 INFO:tasks.ceph_fuse:client.2 config is {'cephfs_name': 'dc-backup'} 2024-09-13T15:35:00.811 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T15:35:00.811 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T15:35:00.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:00.812 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-13T15:35:00.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:00.819 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-09-13T15:35:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-09-13T15:35:00.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:35:00.876 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T15:35:00.876 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T15:35:00.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:35:01.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.043+0000 7f75cb993640 1 Processor -- start 2024-09-13T15:35:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.043+0000 7f75cb993640 1 -- start start 2024-09-13T15:35:01.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.043+0000 7f75cb993640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75c4153f60 0x7f75c40c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:35:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.043+0000 7f75cb993640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c40a7850 con 0x7f75c40b7bd0 2024-09-13T15:35:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.043+0000 7f75cb993640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c408c4f0 con 0x7f75c4153f60 2024-09-13T15:35:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.043+0000 7f75c972f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75c4153f60 0x7f75c40c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:35:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.043+0000 7f75c972f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75c4153f60 0x7f75c40c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56940/0 (socket says 172.21.15.40:56940) 2024-09-13T15:35:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.043+0000 7f75c972f640 1 -- 172.21.15.40:0/1218711759 learned_addr learned my addr 172.21.15.40:0/1218711759 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:35:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.043+0000 7f75c972f640 1 -- 172.21.15.40:0/1218711759 >> v1:172.21.15.40:6789/0 conn(0x7f75c40b7bd0 legacy=0x7f75c40c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:01.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.043+0000 7f75c972f640 1 -- 172.21.15.40:0/1218711759 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c408bdb0 con 0x7f75c4153f60 2024-09-13T15:35:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75c972f640 1 --2- 172.21.15.40:0/1218711759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75c4153f60 0x7f75c40c4b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009820 tx=0x7f75b401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7befafc37a63a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:35:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75bbfff640 1 -- 172.21.15.40:0/1218711759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b40a8050 con 0x7f75c4153f60 2024-09-13T15:35:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75bbfff640 1 -- 172.21.15.40:0/1218711759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b40ac520 con 0x7f75c4153f60 2024-09-13T15:35:01.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75bbfff640 1 -- 172.21.15.40:0/1218711759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b40ac7e0 con 0x7f75c4153f60 2024-09-13T15:35:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 -- 172.21.15.40:0/1218711759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75c4153f60 msgr2=0x7f75c40c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 --2- 172.21.15.40:0/1218711759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75c4153f60 0x7f75c40c4b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f75b4009820 tx=0x7f75b401c4c0 comp rx=0 tx=0).stop 2024-09-13T15:35:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 -- 172.21.15.40:0/1218711759 shutdown_connections 2024-09-13T15:35:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 --2- 172.21.15.40:0/1218711759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75c4153f60 0x7f75c40c4b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:35:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 -- 172.21.15.40:0/1218711759 >> 172.21.15.40:0/1218711759 conn(0x7f75c40a8640 msgr2=0x7f75c4065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:35:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 -- 172.21.15.40:0/1218711759 shutdown_connections 2024-09-13T15:35:01.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 -- 172.21.15.40:0/1218711759 wait complete. 2024-09-13T15:35:01.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 Processor -- start 2024-09-13T15:35:01.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 -- start start 2024-09-13T15:35:01.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75c40b7bd0 0x7f75c4154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:35:01.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c41618c0 con 0x7f75c40b7bd0 2024-09-13T15:35:01.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75c972f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75c40b7bd0 0x7f75c4154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:35:01.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75c972f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75c40b7bd0 0x7f75c4154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56950/0 (socket says 172.21.15.40:56950) 2024-09-13T15:35:01.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75c972f640 1 -- 172.21.15.40:0/70509263 learned_addr learned my addr 172.21.15.40:0/70509263 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:35:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75c972f640 1 -- 172.21.15.40:0/70509263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b40094d0 con 0x7f75c40b7bd0 2024-09-13T15:35:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75c972f640 1 --2- 172.21.15.40:0/70509263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75c40b7bd0 0x7f75c4154590 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f75b401ab70 tx=0x7f75b401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:35:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75b9ffb640 1 -- 172.21.15.40:0/70509263 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b40b7630 con 0x7f75c40b7bd0 2024-09-13T15:35:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75b9ffb640 1 -- 172.21.15.40:0/70509263 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b40b7790 con 0x7f75c40b7bd0 2024-09-13T15:35:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 -- 172.21.15.40:0/70509263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c41613e0 con 0x7f75c40b7bd0 2024-09-13T15:35:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75b9ffb640 1 -- 172.21.15.40:0/70509263 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75b40b7a50 con 0x7f75c40b7bd0 2024-09-13T15:35:01.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.047+0000 7f75cb993640 1 -- 172.21.15.40:0/70509263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c41eb8b0 con 0x7f75c40b7bd0 2024-09-13T15:35:01.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.051+0000 7f75b9ffb640 1 -- 172.21.15.40:0/70509263 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f75b40b3040 con 0x7f75c40b7bd0 2024-09-13T15:35:01.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.051+0000 7f75b9ffb640 1 --2- 172.21.15.40:0/70509263 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f75a8035450 0x7f75a8037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:35:01.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.051+0000 7f75cb993640 1 -- 172.21.15.40:0/70509263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c4067510 con 0x7f75c40b7bd0 2024-09-13T15:35:01.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.051+0000 7f75b9ffb640 1 -- 172.21.15.40:0/70509263 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5095+0+0 (secure 0 0 0) 0x7f75b40e2430 con 0x7f75c40b7bd0 2024-09-13T15:35:01.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.051+0000 7f75c8f2e640 1 --2- 172.21.15.40:0/70509263 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f75a8035450 0x7f75a8037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:35:01.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.051+0000 7f75c8f2e640 1 --2- 172.21.15.40:0/70509263 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f75a8035450 0x7f75a8037910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f75c0000f70 tx=0x7f75c0007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:35:01.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.055+0000 7f75b9ffb640 1 -- 172.21.15.40:0/70509263 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f75b4110db0 con 0x7f75c40b7bd0 2024-09-13T15:35:01.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.247+0000 7f75cb993640 1 -- 172.21.15.40:0/70509263 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f75c415d600 con 0x7f75c40b7bd0 2024-09-13T15:35:01.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.247+0000 7f75b9ffb640 1 -- 172.21.15.40:0/70509263 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+236 (secure 0 0 0) 0x7f75b40bb070 con 0x7f75c40b7bd0 2024-09-13T15:35:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:35:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:name: dc, metadata pool: cephfs.dc.meta, data pools: [cephfs.dc.data ] 2024-09-13T15:35:01.251 INFO:teuthology.orchestra.run.smithi040.stdout:name: dc-backup, metadata pool: cephfs.dc-backup.meta, data pools: [cephfs.dc-backup.data ] 2024-09-13T15:35:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.251+0000 7f75cb993640 1 -- 172.21.15.40:0/70509263 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f75a8035450 msgr2=0x7f75a8037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.251+0000 7f75cb993640 1 --2- 172.21.15.40:0/70509263 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f75a8035450 0x7f75a8037910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f75c0000f70 tx=0x7f75c0007a40 comp rx=0 tx=0).stop 2024-09-13T15:35:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.251+0000 7f75cb993640 1 -- 172.21.15.40:0/70509263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75c40b7bd0 msgr2=0x7f75c4154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.251+0000 7f75cb993640 1 --2- 172.21.15.40:0/70509263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75c40b7bd0 0x7f75c4154590 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f75b401ab70 tx=0x7f75b401ad00 comp rx=0 tx=0).stop 2024-09-13T15:35:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.251+0000 7f75cb993640 1 -- 172.21.15.40:0/70509263 shutdown_connections 2024-09-13T15:35:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.251+0000 7f75cb993640 1 --2- 172.21.15.40:0/70509263 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f75a8035450 0x7f75a8037910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:35:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.251+0000 7f75cb993640 1 --2- 172.21.15.40:0/70509263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75c40b7bd0 0x7f75c4154590 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:35:01.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.251+0000 7f75cb993640 1 -- 172.21.15.40:0/70509263 >> 172.21.15.40:0/70509263 conn(0x7f75c40a8640 msgr2=0x7f75c40a4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:35:01.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.251+0000 7f75cb993640 1 -- 172.21.15.40:0/70509263 shutdown_connections 2024-09-13T15:35:01.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:01.251+0000 7f75cb993640 1 -- 172.21.15.40:0/70509263 wait complete. 2024-09-13T15:35:01.268 INFO:tasks.cephfs.mount:Mounting Ceph FS dc; just confirmed its presence on cluster 2024-09-13T15:35:01.268 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:35:01.268 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-09-13T15:35:01.268 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T15:35:01.268 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T15:35:01.268 INFO:tasks.cephfs.mount:self.cephfs_name = dc 2024-09-13T15:35:01.268 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T15:35:01.269 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:35:01.269 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:35:01.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:01.269 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-09-13T15:35:01.273 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:35:01.274 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:35:01.274 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:35:01.274 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:01.274 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-13T15:35:01.274 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:01.274 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:35:01.274 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:35:01.274 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-09-13T15:35:01.274 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:35:01.274 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:35:01.274 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-09-13T15:35:01.274 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42516sec preferred_lft 42516sec 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:14:03:fe:3a brd ff:ff:ff:ff:ff:ff 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:35:01.275 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:01.276 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T15:35:01.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:01.277 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2024-09-13T15:35:01.277 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-13T15:35:01.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2024-09-13T15:35:01.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2024-09-13T15:35:01.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2024-09-13T15:35:01.277 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T15:35:01.277 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-13T15:35:01.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:01.353 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:35:01.405 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-09-13T15:35:01.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:01.406 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-09-13T15:35:01.471 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-09-13T15:35:01.472 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:35:01.472 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:35:01.472 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:35:01.472 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:35:01.472 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:35:01.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:01.472 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2024-09-13T15:35:01.473 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-13T15:35:01.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:35:01.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:35:01.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:35:01.473 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-13T15:35:01.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:01.551 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-13T15:35:01.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:01.601 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-09-13T15:35:01.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:01.649 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2024-09-13T15:35:01.649 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-13T15:35:01.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:35:01.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T15:35:01.649 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-13T15:35:01.716 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T15:35:01.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:01.716 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2024-09-13T15:35:01.716 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-13T15:35:01.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T15:35:01.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T15:35:01.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T15:35:01.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T15:35:01.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T15:35:01.717 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-13T15:35:01.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:01.828 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2024-09-13T15:35:01.828 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-13T15:35:01.828 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-09-13T15:35:01.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T15:35:01.829 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-13T15:35:01.847 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {'cephfs_name': 'dc'} 2024-09-13T15:35:01.847 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:35:01.847 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T15:35:01.896 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T15:35:01.897 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:35:01.897 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:35:01.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-13T15:35:01.999 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:35:02.000 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:35:02.056 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:35:02.057 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:35:02.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:02.058 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-13T15:35:02.104 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T15:35:02.105 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=dc) 2024-09-13T15:35:02.153 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-13T15:35:02.167 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:35:02.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:35:02.222 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:35:02.223 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:35:02.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:02.223 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-13T15:35:02.237 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi040.stderr:2024-09-13T15:35:02.235+0000 7f3af08ce580 -1 init, newargv = 0x55cd9f970d40 newargc=15 2024-09-13T15:35:02.238 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi040.stderr:ceph-fuse[34128]: starting ceph client 2024-09-13T15:35:02.243 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi040.stderr:ceph-fuse[34128]: starting fuse 2024-09-13T15:35:03.343 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-13T15:35:03.359 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:35:03.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:35:03.420 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:35:03.421 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:35:03.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:03.421 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-13T15:35:03.469 INFO:teuthology.orchestra.run.smithi040.stdout:45 2024-09-13T15:35:03.469 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-09-13T15:35:03.469 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T15:35:03.469 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2024-09-13T15:35:03.469 DEBUG:teuthology.orchestra.run.smithi040:> import re 2024-09-13T15:35:03.469 DEBUG:teuthology.orchestra.run.smithi040:> import os 2024-09-13T15:35:03.469 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2024-09-13T15:35:03.470 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T15:35:03.471 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T15:35:03.471 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T15:35:03.471 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2024-09-13T15:35:03.471 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2024-09-13T15:35:03.471 DEBUG:teuthology.orchestra.run.smithi040:> return f 2024-09-13T15:35:03.471 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T15:35:03.471 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-13T15:35:03.471 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.1")) 2024-09-13T15:35:03.471 DEBUG:teuthology.orchestra.run.smithi040:> ' 2024-09-13T15:35:03.593 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.1.34128.asok 2024-09-13T15:35:03.775 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.34128.asok 2024-09-13T15:35:03.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:03.775 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.34128.asok status 2024-09-13T15:35:03.935 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-13T15:35:03.935 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2024-09-13T15:35:03.935 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "50bbe7f395997dcd871813949c49addbbf630361", 2024-09-13T15:35:03.935 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T15:35:03.935 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "1", 2024-09-13T15:35:03.935 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2024-09-13T15:35:03.935 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-13T15:35:03.935 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "34128", 2024-09-13T15:35:03.935 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2024-09-13T15:35:03.935 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-13T15:35:03.936 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2024-09-13T15:35:03.936 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2024-09-13T15:35:03.936 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4359, 2024-09-13T15:35:03.936 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2024-09-13T15:35:03.936 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2024-09-13T15:35:03.936 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2024-09-13T15:35:03.936 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4359 2024-09-13T15:35:03.936 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-13T15:35:03.936 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-09-13T15:35:03.936 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-13T15:35:03.936 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2024-09-13T15:35:03.937 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 997328347 2024-09-13T15:35:03.937 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-13T15:35:03.937 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-13T15:35:03.937 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-09-13T15:35:03.937 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-13T15:35:03.937 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2024-09-13T15:35:03.937 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 997328347 2024-09-13T15:35:03.937 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-13T15:35:03.937 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4359 192.168.0.1:0/997328347", 2024-09-13T15:35:03.937 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/997328347", 2024-09-13T15:35:03.937 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2024-09-13T15:35:03.937 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 10, 2024-09-13T15:35:03.938 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 24, 2024-09-13T15:35:03.938 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2024-09-13T15:35:03.938 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2024-09-13T15:35:03.938 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "dc" 2024-09-13T15:35:03.938 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-13T15:35:03.949 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T15:35:03.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:35:04.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.075+0000 7f316913e640 1 Processor -- start 2024-09-13T15:35:04.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.075+0000 7f316913e640 1 -- start start 2024-09-13T15:35:04.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.075+0000 7f316913e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3164070de0 0x7f3164150210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:35:04.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.075+0000 7f316913e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3164071370 con 0x7f3164070a00 2024-09-13T15:35:04.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.075+0000 7f316913e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31640b6720 con 0x7f3164070de0 2024-09-13T15:35:04.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.075+0000 7f316259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3164070de0 0x7f3164150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:35:04.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.075+0000 7f3162d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3164070a00 0x7f316414fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35306/0 (socket says 172.21.15.40:35306) 2024-09-13T15:35:04.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.075+0000 7f3162d9d640 1 -- 172.21.15.40:0/908275320 learned_addr learned my addr 172.21.15.40:0/908275320 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:35:04.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.075+0000 7f3161d9b640 1 -- 172.21.15.40:0/908275320 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517953136 0 0) 0x7f3164071370 con 0x7f3164070a00 2024-09-13T15:35:04.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.075+0000 7f3161d9b640 1 -- 172.21.15.40:0/908275320 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3150003530 con 0x7f3164070a00 2024-09-13T15:35:04.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.075+0000 7f316259c640 1 -- 172.21.15.40:0/908275320 >> v1:172.21.15.40:6789/0 conn(0x7f3164070a00 legacy=0x7f316414fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:04.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.075+0000 7f316259c640 1 -- 172.21.15.40:0/908275320 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31641508c0 con 0x7f3164070de0 2024-09-13T15:35:04.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.079+0000 7f316259c640 1 --2- 172.21.15.40:0/908275320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3164070de0 0x7f3164150210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3154009d90 tx=0x7f315401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7cd62991af8232 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:35:04.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.079+0000 7f3161d9b640 1 -- 172.21.15.40:0/908275320 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31540a5870 con 0x7f3164070de0 2024-09-13T15:35:04.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.079+0000 7f3161d9b640 1 -- 172.21.15.40:0/908275320 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31640c3a60 con 0x7f3164070de0 2024-09-13T15:35:04.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.079+0000 7f3161d9b640 1 -- 172.21.15.40:0/908275320 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31540a5b20 con 0x7f3164070de0 2024-09-13T15:35:04.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.079+0000 7f316913e640 1 -- 172.21.15.40:0/908275320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3164070de0 msgr2=0x7f3164150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:04.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.079+0000 7f316913e640 1 --2- 172.21.15.40:0/908275320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3164070de0 0x7f3164150210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3154009d90 tx=0x7f315401c8e0 comp rx=0 tx=0).stop 2024-09-13T15:35:04.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.079+0000 7f316913e640 1 -- 172.21.15.40:0/908275320 shutdown_connections 2024-09-13T15:35:04.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.079+0000 7f316913e640 1 --2- 172.21.15.40:0/908275320 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3164070de0 0x7f3164150210 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:35:04.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.079+0000 7f316913e640 1 -- 172.21.15.40:0/908275320 >> 172.21.15.40:0/908275320 conn(0x7f3164065d40 msgr2=0x7f3164066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:35:04.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.079+0000 7f316913e640 1 -- 172.21.15.40:0/908275320 shutdown_connections 2024-09-13T15:35:04.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.079+0000 7f316913e640 1 -- 172.21.15.40:0/908275320 wait complete. 2024-09-13T15:35:04.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f316913e640 1 Processor -- start 2024-09-13T15:35:04.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f316913e640 1 -- start start 2024-09-13T15:35:04.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f316913e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3164070a00 0x7f3164155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:35:04.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f316913e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31641562c0 con 0x7f3164070a00 2024-09-13T15:35:04.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f3162d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3164070a00 0x7f3164155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:35:04.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f3162d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3164070a00 0x7f3164155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45374/0 (socket says 172.21.15.40:45374) 2024-09-13T15:35:04.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f3162d9d640 1 -- 172.21.15.40:0/1167331194 learned_addr learned my addr 172.21.15.40:0/1167331194 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:35:04.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f3162d9d640 1 -- 172.21.15.40:0/1167331194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154009a70 con 0x7f3164070a00 2024-09-13T15:35:04.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f3162d9d640 1 --2- 172.21.15.40:0/1167331194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3164070a00 0x7f3164155d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c3a0 tx=0x7f314c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:35:04.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f315b7fe640 1 -- 172.21.15.40:0/1167331194 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f314c005c20 con 0x7f3164070a00 2024-09-13T15:35:04.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f315b7fe640 1 -- 172.21.15.40:0/1167331194 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c005d80 con 0x7f3164070a00 2024-09-13T15:35:04.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f315b7fe640 1 -- 172.21.15.40:0/1167331194 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f314c007220 con 0x7f3164070a00 2024-09-13T15:35:04.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f316913e640 1 -- 172.21.15.40:0/1167331194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3164156560 con 0x7f3164070a00 2024-09-13T15:35:04.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f316913e640 1 -- 172.21.15.40:0/1167331194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316413e170 con 0x7f3164070a00 2024-09-13T15:35:04.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f315b7fe640 1 -- 172.21.15.40:0/1167331194 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f314c007380 con 0x7f3164070a00 2024-09-13T15:35:04.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f315b7fe640 1 --2- 172.21.15.40:0/1167331194 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3144035450 0x7f3144037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:35:04.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f315b7fe640 1 -- 172.21.15.40:0/1167331194 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5095+0+0 (secure 0 0 0) 0x7f314c0472c0 con 0x7f3164070a00 2024-09-13T15:35:04.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.083+0000 7f316913e640 1 -- 172.21.15.40:0/1167331194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316414fb00 con 0x7f3164070a00 2024-09-13T15:35:04.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.087+0000 7f316259c640 1 --2- 172.21.15.40:0/1167331194 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3144035450 0x7f3144037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:35:04.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.087+0000 7f316259c640 1 --2- 172.21.15.40:0/1167331194 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3144035450 0x7f3144037910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f31540af000 tx=0x7f31540a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:35:04.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.091+0000 7f315b7fe640 1 -- 172.21.15.40:0/1167331194 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f314c017080 con 0x7f3164070a00 2024-09-13T15:35:04.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.287+0000 7f316913e640 1 -- 172.21.15.40:0/1167331194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3164157a20 con 0x7f3164070a00 2024-09-13T15:35:04.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.287+0000 7f315b7fe640 1 -- 172.21.15.40:0/1167331194 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+236 (secure 0 0 0) 0x7f314c019b40 con 0x7f3164070a00 2024-09-13T15:35:04.302 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T15:35:04.303 INFO:teuthology.orchestra.run.smithi040.stdout:name: dc, metadata pool: cephfs.dc.meta, data pools: [cephfs.dc.data ] 2024-09-13T15:35:04.303 INFO:teuthology.orchestra.run.smithi040.stdout:name: dc-backup, metadata pool: cephfs.dc-backup.meta, data pools: [cephfs.dc-backup.data ] 2024-09-13T15:35:04.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.291+0000 7f316913e640 1 -- 172.21.15.40:0/1167331194 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3144035450 msgr2=0x7f3144037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:04.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.291+0000 7f316913e640 1 --2- 172.21.15.40:0/1167331194 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3144035450 0x7f3144037910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f31540af000 tx=0x7f31540a7070 comp rx=0 tx=0).stop 2024-09-13T15:35:04.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.291+0000 7f316913e640 1 -- 172.21.15.40:0/1167331194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3164070a00 msgr2=0x7f3164155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:35:04.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.291+0000 7f316913e640 1 --2- 172.21.15.40:0/1167331194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3164070a00 0x7f3164155d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f314c00c3a0 tx=0x7f314c00c860 comp rx=0 tx=0).stop 2024-09-13T15:35:04.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.291+0000 7f316913e640 1 -- 172.21.15.40:0/1167331194 shutdown_connections 2024-09-13T15:35:04.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.291+0000 7f316913e640 1 --2- 172.21.15.40:0/1167331194 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f3144035450 0x7f3144037910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:35:04.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.291+0000 7f316913e640 1 --2- 172.21.15.40:0/1167331194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3164070a00 0x7f3164155d80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:35:04.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.291+0000 7f316913e640 1 -- 172.21.15.40:0/1167331194 >> 172.21.15.40:0/1167331194 conn(0x7f3164065d40 msgr2=0x7f316414cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:35:04.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.291+0000 7f316913e640 1 -- 172.21.15.40:0/1167331194 shutdown_connections 2024-09-13T15:35:04.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:35:04.291+0000 7f316913e640 1 -- 172.21.15.40:0/1167331194 wait complete. 2024-09-13T15:35:04.309 INFO:tasks.cephfs.mount:Mounting Ceph FS dc-backup; just confirmed its presence on cluster 2024-09-13T15:35:04.309 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:35:04.309 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-09-13T15:35:04.309 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T15:35:04.309 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T15:35:04.309 INFO:tasks.cephfs.mount:self.cephfs_name = dc-backup 2024-09-13T15:35:04.309 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T15:35:04.309 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:35:04.310 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T15:35:04.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:04.310 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-09-13T15:35:04.315 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:35:04.315 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:35:04.315 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:35:04.315 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.315 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-13T15:35:04.315 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.315 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:35:04.315 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42513sec preferred_lft 42513sec 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:35:04.316 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 02:42:14:03:fe:3a brd ff:ff:ff:ff:ff:ff 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:35:04.317 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-13T15:35:04.318 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:04.318 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:35:04.367 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-09-13T15:35:04.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:04.368 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-09-13T15:35:04.416 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-09-13T15:35:04.417 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:35:04.417 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:35:04.417 INFO:teuthology.orchestra.run.smithi040.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:35:04.417 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:35:04.417 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:35:04.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:04.417 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2024-09-13T15:35:04.417 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-13T15:35:04.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:35:04.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:35:04.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:35:04.418 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-13T15:35:04.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:04.489 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-13T15:35:04.540 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T15:35:04.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:04.541 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-09-13T15:35:04.588 INFO:teuthology.orchestra.run.smithi040.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T15:35:04.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:04.590 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2024-09-13T15:35:04.590 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-13T15:35:04.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T15:35:04.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T15:35:04.590 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-13T15:35:04.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:04.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T15:35:04.712 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:35:04.712 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:35:04.712 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:35:04.712 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.712 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-13T15:35:04.713 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.713 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:35:04.713 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5a:41:5d:04:f0:cf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T15:35:04.713 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T15:35:04.713 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.713 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5841:5dff:fe04:f0cf/64 scope link 2024-09-13T15:35:04.713 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:04.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T15:35:04.768 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:35:04.769 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:35:04.769 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:35:04.769 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.769 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-09-13T15:35:04.769 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.769 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T15:35:04.769 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 5a:41:5d:04:f0:cf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T15:35:04.769 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T15:35:04.769 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.769 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::5841:5dff:fe04:f0cf/64 scope link 2024-09-13T15:35:04.769 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:35:04.770 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T15:35:04.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:04.771 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2024-09-13T15:35:04.771 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-13T15:35:04.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T15:35:04.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T15:35:04.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T15:35:04.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T15:35:04.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T15:35:04.771 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-13T15:35:04.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:04.868 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2024-09-13T15:35:04.868 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-09-13T15:35:04.868 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.1 up 2024-09-13T15:35:04.868 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T15:35:04.868 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-09-13T15:35:04.894 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {'cephfs_name': 'dc-backup'} 2024-09-13T15:35:04.895 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:35:04.895 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T15:35:04.940 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T15:35:04.941 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:35:04.941 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T15:35:04.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-13T15:35:05.046 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:35:05.047 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:35:05.100 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:35:05.101 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:35:05.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:05.101 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-13T15:35:05.149 INFO:teuthology.orchestra.run.smithi040.stdout:45 2024-09-13T15:35:05.149 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-09-13T15:35:05.149 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2 --client_fs=dc-backup) 2024-09-13T15:35:05.194 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-13T15:35:05.209 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:35:05.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:35:05.263 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:35:05.264 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:35:05.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:05.265 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-13T15:35:05.275 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:2024-09-13T15:35:05.271+0000 7f65cc057580 -1 init, newargv = 0x55f0cf735010 newargc=15 2024-09-13T15:35:05.275 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:ceph-fuse[34267]: starting ceph client 2024-09-13T15:35:05.279 INFO:teuthology.orchestra.run.smithi040.stdout:45 2024-09-13T15:35:05.280 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:ceph-fuse[34267]: starting fuse 2024-09-13T15:35:06.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-09-13T15:35:06.398 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:35:06.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:35:06.452 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:35:06.453 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:35:06.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:06.454 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-09-13T15:35:06.502 INFO:teuthology.orchestra.run.smithi040.stdout:45 2024-09-13T15:35:06.502 INFO:teuthology.orchestra.run.smithi040.stdout:46 2024-09-13T15:35:06.502 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> import re 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> import os 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2024-09-13T15:35:06.503 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> return f 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.2")) 2024-09-13T15:35:06.504 DEBUG:teuthology.orchestra.run.smithi040:> ' 2024-09-13T15:35:06.624 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.2.34267.asok 2024-09-13T15:35:06.806 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.34267.asok 2024-09-13T15:35:06.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:06.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.34267.asok status 2024-09-13T15:35:06.969 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-13T15:35:06.969 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "50bbe7f395997dcd871813949c49addbbf630361", 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "2", 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "34267", 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4365, 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2024-09-13T15:35:06.970 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4365 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.2:0", 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2687370040 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.2:0", 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 2687370040 2024-09-13T15:35:06.971 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-09-13T15:35:06.972 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4365 192.168.0.2:0/2687370040", 2024-09-13T15:35:06.972 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.2:0/2687370040", 2024-09-13T15:35:06.972 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2024-09-13T15:35:06.972 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 13, 2024-09-13T15:35:06.972 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 24, 2024-09-13T15:35:06.972 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2024-09-13T15:35:06.972 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2024-09-13T15:35:06.972 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "dc-backup" 2024-09-13T15:35:06.972 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-13T15:35:06.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:06.983 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2024-09-13T15:35:06.984 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-13T15:35:06.990 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2024-09-13T15:35:06.990 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-13T15:35:06.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:06.991 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T15:35:07.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:07.045 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2024-09-13T15:35:07.045 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-13T15:35:07.098 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2024-09-13T15:35:07.098 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-13T15:35:07.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:35:07.098 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T15:35:07.154 INFO:teuthology.run_tasks:Running task cephfs_mirror_thrash... 2024-09-13T15:35:07.190 INFO:tasks.cephfs_mirror_thrash:cephfs_mirror_thrash using random seed: 1726241707 2024-09-13T15:35:07.190 DEBUG:tasks.cephfs_mirror_thrash:Yielding 2024-09-13T15:35:07.190 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T15:35:07.208 INFO:tasks.workunit:Pulling workunits from ref 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:35:07.208 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T15:35:07.208 DEBUG:teuthology.orchestra.run.smithi040:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-13T15:35:07.209 INFO:tasks.cephfs_mirror_thrash:starting thrash for cluster ceph 2024-09-13T15:35:07.209 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:35:07.216 INFO:teuthology.orchestra.run.smithi040.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-13T15:35:07.216 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T15:35:07.216 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-09-13T15:35:07.216 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:35:07.216 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T15:35:07.216 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-13 15:34:56.173533008 +0000 2024-09-13T15:35:07.216 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-13 15:35:07.043300845 +0000 2024-09-13T15:35:07.216 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-09-13T15:35:07.216 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-13T15:35:07.217 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- mirror 2024-09-13T15:35:07.284 INFO:tasks.workunit:timeout=1h 2024-09-13T15:35:07.285 INFO:tasks.workunit:cleanup=False 2024-09-13T15:35:07.285 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:35:07.334 INFO:tasks.workunit.client.1.smithi040.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-13T15:35:17.210 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.38575748186534287) > weight (0.3333333333333333) 2024-09-13T15:35:17.210 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.8096880995205142) > weight (0.3333333333333333) 2024-09-13T15:35:17.210 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.6429348102964069) > weight (0.3333333333333333) 2024-09-13T15:35:17.210 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:35:27.211 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:35:27.211 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:35:27.212 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:35:27.212 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:35:27.210+0000 7fc558ba1640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 33750) UID: 1000 2024-09-13T15:35:27.547 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:35:42.213 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:35:42.213 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:35:42.214 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:35:42.214 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:35:42.214 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:35:42.216 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:35:42.217 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:35:52.217 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.574624675891713) > weight (0.3333333333333333) 2024-09-13T15:35:52.218 INFO:tasks.cephfs_mirror_thrash:kill client.mirror2 2024-09-13T15:35:52.218 INFO:tasks.cephfs_mirror.client.mirror2:Sent signal 15 2024-09-13T15:35:52.218 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:35:52.219 INFO:tasks.cephfs_mirror.client.mirror2.smithi040.stderr:2024-09-13T15:35:52.214+0000 7f4f142b0640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground (PID: 33752) UID: 1000 2024-09-13T15:35:57.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:36:05.977 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 97% (12350/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T15:36:07.091 INFO:tasks.workunit.client.1.smithi040.stderr:Note: switching to '50bbe7f395997dcd871813949c49addbbf630361'. 2024-09-13T15:36:07.092 INFO:tasks.workunit.client.1.smithi040.stderr: 2024-09-13T15:36:07.092 INFO:tasks.workunit.client.1.smithi040.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T15:36:07.092 INFO:tasks.workunit.client.1.smithi040.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T15:36:07.092 INFO:tasks.workunit.client.1.smithi040.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T15:36:07.092 INFO:tasks.workunit.client.1.smithi040.stderr: 2024-09-13T15:36:07.092 INFO:tasks.workunit.client.1.smithi040.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T15:36:07.092 INFO:tasks.workunit.client.1.smithi040.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T15:36:07.092 INFO:tasks.workunit.client.1.smithi040.stderr: 2024-09-13T15:36:07.092 INFO:tasks.workunit.client.1.smithi040.stderr: git switch -c 2024-09-13T15:36:07.092 INFO:tasks.workunit.client.1.smithi040.stderr: 2024-09-13T15:36:07.092 INFO:tasks.workunit.client.1.smithi040.stderr:Or undo this operation with: 2024-09-13T15:36:07.092 INFO:tasks.workunit.client.1.smithi040.stderr: 2024-09-13T15:36:07.093 INFO:tasks.workunit.client.1.smithi040.stderr: git switch - 2024-09-13T15:36:07.093 INFO:tasks.workunit.client.1.smithi040.stderr: 2024-09-13T15:36:07.093 INFO:tasks.workunit.client.1.smithi040.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T15:36:07.093 INFO:tasks.workunit.client.1.smithi040.stderr: 2024-09-13T15:36:07.093 INFO:tasks.workunit.client.1.smithi040.stderr:HEAD is now at 50bbe7f3959 Merge PR #58789 into wip-rishabh-testing-20240910.095512-reef 2024-09-13T15:36:07.100 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-13T15:36:07.107 INFO:tasks.workunit.client.1.smithi040.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T15:36:07.109 INFO:tasks.workunit.client.1.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T15:36:07.109 INFO:tasks.workunit.client.1.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T15:36:07.219 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror2 2024-09-13T15:36:07.219 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:36:07.220 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror2 2024-09-13T15:36:07.220 INFO:tasks.cephfs_mirror.client.mirror2:Restarting daemon 2024-09-13T15:36:07.220 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground 2024-09-13T15:36:07.223 INFO:tasks.cephfs_mirror.client.mirror2:Started 2024-09-13T15:36:07.223 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:36:07.878 INFO:tasks.workunit.client.1.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T15:36:07.967 INFO:tasks.workunit.client.1.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T15:36:08.043 INFO:tasks.workunit.client.1.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T15:36:08.045 INFO:tasks.workunit.client.1.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T15:36:08.045 INFO:tasks.workunit.client.1.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T15:36:08.095 INFO:tasks.workunit.client.1.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T15:36:08.099 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:36:08.099 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-13T15:36:08.146 INFO:tasks.workunit:Running workunits matching fs/cephfs_mirror_ha_gen.sh on client.1... 2024-09-13T15:36:08.147 INFO:tasks.workunit:Running workunit fs/cephfs_mirror_ha_gen.sh... 2024-09-13T15:36:08.147 DEBUG:teuthology.orchestra.run.smithi040:workunit test fs/cephfs_mirror_ha_gen.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/mirror && cd -- /home/ubuntu/cephtest/mnt.1/mirror && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=50bbe7f395997dcd871813949c49addbbf630361 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 1h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/cephfs_mirror_ha_gen.sh 2024-09-13T15:36:08.205 INFO:tasks.workunit.client.1.smithi040.stderr:++ dirname /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/cephfs_mirror_ha_gen.sh 2024-09-13T15:36:08.206 INFO:tasks.workunit.client.1.smithi040.stderr:+ . /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/cephfs_mirror_helpers.sh 2024-09-13T15:36:08.206 INFO:tasks.workunit.client.1.smithi040.stderr:++ PRIMARY_FS=dc 2024-09-13T15:36:08.206 INFO:tasks.workunit.client.1.smithi040.stderr:++ BACKUP_FS=dc-backup 2024-09-13T15:36:08.207 INFO:tasks.workunit.client.1.smithi040.stderr:++ REPO=ceph-qa-suite 2024-09-13T15:36:08.207 INFO:tasks.workunit.client.1.smithi040.stderr:++ REPO_DIR=ceph_repo 2024-09-13T15:36:08.207 INFO:tasks.workunit.client.1.smithi040.stderr:++ REPO_PATH_PFX=ceph_repo/ceph-qa-suite 2024-09-13T15:36:08.207 INFO:tasks.workunit.client.1.smithi040.stderr:++ NR_DIRECTORIES=4 2024-09-13T15:36:08.207 INFO:tasks.workunit.client.1.smithi040.stderr:++ NR_SNAPSHOTS=4 2024-09-13T15:36:08.207 INFO:tasks.workunit.client.1.smithi040.stderr:++ MIRROR_SUBDIR=/mirror 2024-09-13T15:36:08.207 INFO:tasks.workunit.client.1.smithi040.stderr:+ trap cleanup EXIT 2024-09-13T15:36:08.207 INFO:tasks.workunit.client.1.smithi040.stderr:+ unset CEPH_CLI_TEST_DUP_COMMAND 2024-09-13T15:36:08.207 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo 'running generator on prmary file system...' 2024-09-13T15:36:08.207 INFO:tasks.workunit.client.1.smithi040.stdout:running generator on prmary file system... 2024-09-13T15:36:08.208 INFO:tasks.workunit.client.1.smithi040.stderr:+ setup_repos 2024-09-13T15:36:08.208 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo 2024-09-13T15:36:08.210 INFO:tasks.workunit.client.1.smithi040.stderr:++ seq 1 4 2024-09-13T15:36:08.211 INFO:tasks.workunit.client.1.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:36:08.211 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_1 2024-09-13T15:36:08.212 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_1 2024-09-13T15:36:08.214 INFO:tasks.workunit.client.1.smithi040.stderr:+ clone_repo ceph_repo/ceph-qa-suite_1 2024-09-13T15:36:08.214 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_1 2024-09-13T15:36:08.214 INFO:tasks.workunit.client.1.smithi040.stderr:+ git clone --branch giant http://github.com/ceph/ceph-qa-suite ceph_repo/ceph-qa-suite_1 2024-09-13T15:36:08.220 INFO:tasks.workunit.client.1.smithi040.stderr:Cloning into 'ceph_repo/ceph-qa-suite_1'... 2024-09-13T15:36:08.542 INFO:tasks.workunit.client.1.smithi040.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-13T15:36:17.224 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:36:17.224 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:36:17.225 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:36:17.225 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:36:17.222+0000 7f2481cd8640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 34338) UID: 1000 2024-09-13T15:36:23.215 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 10% (144/1398) Updating files: 11% (154/1398) Updating files: 12% (168/1398) Updating files: 13% (182/1398) Updating files: 14% (196/1398) Updating files: 15% (210/1398) Updating files: 16% (224/1398) Updating files: 17% (238/1398) Updating files: 18% (252/1398) Updating files: 19% (266/1398) Updating files: 20% (280/1398) Updating files: 21% (294/1398) Updating files: 22% (308/1398) Updating files: 23% (322/1398) Updating files: 24% (336/1398) Updating files: 25% (350/1398) Updating files: 26% (364/1398) Updating files: 27% (378/1398) Updating files: 28% (392/1398) Updating files: 29% (406/1398) Updating files: 30% (420/1398) Updating files: 31% (434/1398) Updating files: 32% (448/1398) Updating files: 33% (462/1398) Updating files: 34% (476/1398) Updating files: 35% (490/1398) Updating files: 36% (504/1398) Updating files: 37% (518/1398) Updating files: 38% (532/1398) Updating files: 39% (546/1398) Updating files: 40% (560/1398) Updating files: 41% (574/1398) Updating files: 42% (588/1398) Updating files: 43% (602/1398) Updating files: 44% (616/1398) Updating files: 45% (630/1398) Updating files: 45% (643/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 58% (819/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 73% (1028/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 85% (1195/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-13T15:36:23.223 INFO:tasks.workunit.client.1.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:36:23.223 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_2 2024-09-13T15:36:23.223 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_2 2024-09-13T15:36:23.225 INFO:tasks.workunit.client.1.smithi040.stderr:+ clone_repo ceph_repo/ceph-qa-suite_2 2024-09-13T15:36:23.225 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_2 2024-09-13T15:36:23.225 INFO:tasks.workunit.client.1.smithi040.stderr:+ git clone --branch giant http://github.com/ceph/ceph-qa-suite ceph_repo/ceph-qa-suite_2 2024-09-13T15:36:23.228 INFO:tasks.workunit.client.1.smithi040.stderr:Cloning into 'ceph_repo/ceph-qa-suite_2'... 2024-09-13T15:36:23.675 INFO:tasks.workunit.client.1.smithi040.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-13T15:36:27.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:36:32.226 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:36:32.226 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:36:32.226 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:36:32.226 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:36:32.227 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:36:32.228 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:36:32.228 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:36:34.253 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 19% (278/1398) Updating files: 20% (280/1398) Updating files: 21% (294/1398) Updating files: 22% (308/1398) Updating files: 23% (322/1398) Updating files: 24% (336/1398) Updating files: 25% (350/1398) Updating files: 26% (364/1398) Updating files: 27% (378/1398) Updating files: 28% (392/1398) Updating files: 29% (406/1398) Updating files: 30% (420/1398) Updating files: 31% (434/1398) Updating files: 32% (448/1398) Updating files: 33% (462/1398) Updating files: 34% (476/1398) Updating files: 35% (490/1398) Updating files: 36% (504/1398) Updating files: 37% (518/1398) Updating files: 38% (532/1398) Updating files: 39% (546/1398) Updating files: 39% (557/1398) Updating files: 40% (560/1398) Updating files: 41% (574/1398) Updating files: 42% (588/1398) Updating files: 43% (602/1398) Updating files: 44% (616/1398) Updating files: 45% (630/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 59% (831/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 76% (1073/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 90% (1263/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-13T15:36:34.261 INFO:tasks.workunit.client.1.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:36:34.261 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_3 2024-09-13T15:36:34.261 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_3 2024-09-13T15:36:34.263 INFO:tasks.workunit.client.1.smithi040.stderr:+ clone_repo ceph_repo/ceph-qa-suite_3 2024-09-13T15:36:34.263 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_3 2024-09-13T15:36:34.263 INFO:tasks.workunit.client.1.smithi040.stderr:+ git clone --branch giant http://github.com/ceph/ceph-qa-suite ceph_repo/ceph-qa-suite_3 2024-09-13T15:36:34.266 INFO:tasks.workunit.client.1.smithi040.stderr:Cloning into 'ceph_repo/ceph-qa-suite_3'... 2024-09-13T15:36:34.730 INFO:tasks.workunit.client.1.smithi040.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-13T15:36:42.229 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:36:42.230 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:36:42.230 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:36:42.231 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:36:42.226+0000 7fe3c458e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 34507) UID: 1000 2024-09-13T15:36:45.122 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 22% (313/1398) Updating files: 23% (322/1398) Updating files: 24% (336/1398) Updating files: 25% (350/1398) Updating files: 26% (364/1398) Updating files: 27% (378/1398) Updating files: 28% (392/1398) Updating files: 29% (406/1398) Updating files: 30% (420/1398) Updating files: 31% (434/1398) Updating files: 32% (448/1398) Updating files: 33% (462/1398) Updating files: 34% (476/1398) Updating files: 35% (490/1398) Updating files: 36% (504/1398) Updating files: 37% (518/1398) Updating files: 38% (532/1398) Updating files: 39% (546/1398) Updating files: 40% (560/1398) Updating files: 41% (574/1398) Updating files: 42% (588/1398) Updating files: 43% (602/1398) Updating files: 43% (613/1398) Updating files: 44% (616/1398) Updating files: 45% (630/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 60% (840/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 78% (1103/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 91% (1274/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-13T15:36:45.131 INFO:tasks.workunit.client.1.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:36:45.131 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_4 2024-09-13T15:36:45.131 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_4 2024-09-13T15:36:45.132 INFO:tasks.workunit.client.1.smithi040.stderr:+ clone_repo ceph_repo/ceph-qa-suite_4 2024-09-13T15:36:45.132 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_4 2024-09-13T15:36:45.132 INFO:tasks.workunit.client.1.smithi040.stderr:+ git clone --branch giant http://github.com/ceph/ceph-qa-suite ceph_repo/ceph-qa-suite_4 2024-09-13T15:36:45.135 INFO:tasks.workunit.client.1.smithi040.stderr:Cloning into 'ceph_repo/ceph-qa-suite_4'... 2024-09-13T15:36:45.467 INFO:tasks.workunit.client.1.smithi040.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-13T15:36:55.911 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 18% (262/1398) Updating files: 19% (266/1398) Updating files: 20% (280/1398) Updating files: 21% (294/1398) Updating files: 22% (308/1398) Updating files: 23% (322/1398) Updating files: 24% (336/1398) Updating files: 25% (350/1398) Updating files: 26% (364/1398) Updating files: 27% (378/1398) Updating files: 28% (392/1398) Updating files: 29% (406/1398) Updating files: 30% (420/1398) Updating files: 31% (434/1398) Updating files: 32% (448/1398) Updating files: 33% (462/1398) Updating files: 34% (476/1398) Updating files: 34% (481/1398) Updating files: 35% (490/1398) Updating files: 36% (504/1398) Updating files: 37% (518/1398) Updating files: 38% (532/1398) Updating files: 39% (546/1398) Updating files: 40% (560/1398) Updating files: 41% (574/1398) Updating files: 42% (588/1398) Updating files: 43% (602/1398) Updating files: 44% (616/1398) Updating files: 45% (630/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 50% (709/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 70% (983/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 86% (1215/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-13T15:36:55.920 INFO:tasks.workunit.client.1.smithi040.stderr:+ configure_peer 2024-09-13T15:36:55.920 INFO:tasks.workunit.client.1.smithi040.stderr:+ ceph mgr module enable mirroring 2024-09-13T15:36:56.026 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.021+0000 7f7a06f97640 1 Processor -- start 2024-09-13T15:36:56.026 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.021+0000 7f7a06f97640 1 -- start start 2024-09-13T15:36:56.027 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.021+0000 7f7a06f97640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a0006b6d0 0x7f7a000bea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:36:56.027 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.021+0000 7f7a06f97640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0006fdc0 con 0x7f7a0006b2f0 2024-09-13T15:36:56.027 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.021+0000 7f7a06f97640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a000c9870 con 0x7f7a0006b6d0 2024-09-13T15:36:56.027 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.021+0000 7f79fffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a0006b6d0 0x7f7a000bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:36:56.027 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.021+0000 7f7a04d33640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7a0006b2f0 0x7f7a000ca8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44056/0 (socket says 172.21.15.40:44056) 2024-09-13T15:36:56.027 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.021+0000 7f7a04d33640 1 -- 172.21.15.40:0/1973490410 learned_addr learned my addr 172.21.15.40:0/1973490410 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:36:56.028 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.021+0000 7f79fffff640 1 -- 172.21.15.40:0/1973490410 >> v1:172.21.15.40:6789/0 conn(0x7f7a0006b2f0 legacy=0x7f7a000ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:36:56.028 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.021+0000 7f79ff7fe640 1 -- 172.21.15.40:0/1973490410 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979027139 0 0) 0x7f7a0006fdc0 con 0x7f7a0006b2f0 2024-09-13T15:36:56.028 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.021+0000 7f79fffff640 1 -- 172.21.15.40:0/1973490410 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0006f920 con 0x7f7a0006b6d0 2024-09-13T15:36:56.030 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f79fffff640 1 --2- 172.21.15.40:0/1973490410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0006b6d0 0x7f7a000bea20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009740 tx=0x7f79f401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9a011767141ace server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:36:56.030 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f79ff7fe640 1 -- 172.21.15.40:0/1973490410 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79f40ab570 con 0x7f7a0006b6d0 2024-09-13T15:36:56.030 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f79ff7fe640 1 -- 172.21.15.40:0/1973490410 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f40a7070 con 0x7f7a0006b6d0 2024-09-13T15:36:56.031 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f79ff7fe640 1 -- 172.21.15.40:0/1973490410 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79f40ab820 con 0x7f7a0006b6d0 2024-09-13T15:36:56.031 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f7a06f97640 1 -- 172.21.15.40:0/1973490410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0006b6d0 msgr2=0x7f7a000bea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:36:56.031 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f7a06f97640 1 --2- 172.21.15.40:0/1973490410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0006b6d0 0x7f7a000bea20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009740 tx=0x7f79f401c420 comp rx=0 tx=0).stop 2024-09-13T15:36:56.031 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f7a06f97640 1 -- 172.21.15.40:0/1973490410 shutdown_connections 2024-09-13T15:36:56.031 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f7a06f97640 1 --2- 172.21.15.40:0/1973490410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0006b6d0 0x7f7a000bea20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:36:56.031 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f7a06f97640 1 -- 172.21.15.40:0/1973490410 >> 172.21.15.40:0/1973490410 conn(0x7f7a000bfa90 msgr2=0x7f7a000bfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:36:56.031 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f7a06f97640 1 -- 172.21.15.40:0/1973490410 shutdown_connections 2024-09-13T15:36:56.032 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f7a06f97640 1 -- 172.21.15.40:0/1973490410 wait complete. 2024-09-13T15:36:56.033 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f7a06f97640 1 Processor -- start 2024-09-13T15:36:56.034 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.025+0000 7f7a06f97640 1 -- start start 2024-09-13T15:36:56.034 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f7a06f97640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0006b2f0 0x7f7a000c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:36:56.034 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f7a06f97640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a00146130 con 0x7f7a0006b2f0 2024-09-13T15:36:56.034 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f7a04d33640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0006b2f0 0x7f7a000c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:36:56.034 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f7a04d33640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0006b2f0 0x7f7a000c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39792/0 (socket says 172.21.15.40:39792) 2024-09-13T15:36:56.034 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f7a04d33640 1 -- 172.21.15.40:0/1113220559 learned_addr learned my addr 172.21.15.40:0/1113220559 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:36:56.034 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f7a04d33640 1 -- 172.21.15.40:0/1113220559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f4009420 con 0x7f7a0006b2f0 2024-09-13T15:36:56.034 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f7a04d33640 1 --2- 172.21.15.40:0/1113220559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0006b2f0 0x7f7a000c81a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f79f800c840 tx=0x7f79f800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:36:56.034 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f79fd7fa640 1 -- 172.21.15.40:0/1113220559 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79f800a660 con 0x7f7a0006b2f0 2024-09-13T15:36:56.034 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f79fd7fa640 1 -- 172.21.15.40:0/1113220559 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f800a7e0 con 0x7f7a0006b2f0 2024-09-13T15:36:56.034 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f7a06f97640 1 -- 172.21.15.40:0/1113220559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a001e8040 con 0x7f7a0006b2f0 2024-09-13T15:36:56.034 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f79fd7fa640 1 -- 172.21.15.40:0/1113220559 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79f800aac0 con 0x7f7a0006b2f0 2024-09-13T15:36:56.035 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f7a06f97640 1 -- 172.21.15.40:0/1113220559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a001465d0 con 0x7f7a0006b2f0 2024-09-13T15:36:56.036 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f79fd7fa640 1 -- 172.21.15.40:0/1113220559 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 43307+0+0 (secure 0 0 0) 0x7f79f800ac20 con 0x7f7a0006b2f0 2024-09-13T15:36:56.036 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f7a06f97640 1 -- 172.21.15.40:0/1113220559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a000bea20 con 0x7f7a0006b2f0 2024-09-13T15:36:56.036 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f79fd7fa640 1 --2- 172.21.15.40:0/1113220559 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f79ec035450 0x7f79ec037910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:36:56.036 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f79fd7fa640 1 -- 172.21.15.40:0/1113220559 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5182+0+0 (secure 0 0 0) 0x7f79f8047680 con 0x7f7a0006b2f0 2024-09-13T15:36:56.036 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f79fffff640 1 --2- 172.21.15.40:0/1113220559 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f79ec035450 0x7f79ec037910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:36:56.036 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.029+0000 7f79fffff640 1 --2- 172.21.15.40:0/1113220559 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f79ec035450 0x7f79ec037910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f79f40af000 tx=0x7f79f4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:36:56.039 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.033+0000 7f79fd7fa640 1 -- 172.21.15.40:0/1113220559 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f79f801a6b0 con 0x7f7a0006b2f0 2024-09-13T15:36:56.238 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:56.233+0000 7f7a06f97640 1 -- 172.21.15.40:0/1113220559 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "mirroring"} v 0) v1 -- 0x7f7a00066890 con 0x7f7a0006b2f0 2024-09-13T15:36:57.186 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.181+0000 7f79fd7fa640 1 -- 172.21.15.40:0/1113220559 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mgrmap(e 6) v1 ==== 43320+0+0 (secure 0 0 0) 0x7f79f8011360 con 0x7f7a0006b2f0 2024-09-13T15:36:57.428 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:36:57.429 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:36:57.429 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:36:57.429 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:36:57.430 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:36:57.431 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.181+0000 7f79fd7fa640 1 -- 172.21.15.40:0/1113220559 <== mon.0 v2:172.21.15.40:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "mirroring"}]=0 v6) v1 ==== 88+0+0 (secure 0 0 0) 0x7f79f8007970 con 0x7f7a0006b2f0 2024-09-13T15:36:57.431 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.185+0000 7f7a06f97640 1 -- 172.21.15.40:0/1113220559 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f79ec035450 msgr2=0x7f79ec037910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:36:57.431 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.185+0000 7f7a06f97640 1 --2- 172.21.15.40:0/1113220559 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f79ec035450 0x7f79ec037910 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f79f40af000 tx=0x7f79f4008040 comp rx=0 tx=0).stop 2024-09-13T15:36:57.431 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.185+0000 7f7a06f97640 1 -- 172.21.15.40:0/1113220559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0006b2f0 msgr2=0x7f7a000c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:36:57.431 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.185+0000 7f7a06f97640 1 --2- 172.21.15.40:0/1113220559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0006b2f0 0x7f7a000c81a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f79f800c840 tx=0x7f79f800cd00 comp rx=0 tx=0).stop 2024-09-13T15:36:57.431 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.185+0000 7f7a06f97640 1 -- 172.21.15.40:0/1113220559 shutdown_connections 2024-09-13T15:36:57.432 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.185+0000 7f7a06f97640 1 --2- 172.21.15.40:0/1113220559 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7f79ec035450 0x7f79ec037910 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:36:57.432 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.185+0000 7f7a06f97640 1 --2- 172.21.15.40:0/1113220559 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a0006b2f0 0x7f7a000c81a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:36:57.432 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.185+0000 7f7a06f97640 1 -- 172.21.15.40:0/1113220559 >> 172.21.15.40:0/1113220559 conn(0x7f7a000bfa90 msgr2=0x7f7a000bfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:36:57.432 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.185+0000 7f7a06f97640 1 -- 172.21.15.40:0/1113220559 shutdown_connections 2024-09-13T15:36:57.432 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.185+0000 7f7a06f97640 1 -- 172.21.15.40:0/1113220559 wait complete. 2024-09-13T15:36:57.432 INFO:tasks.workunit.client.1.smithi040.stderr:+ ceph fs snapshot mirror enable dc 2024-09-13T15:36:57.432 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:57.309+0000 7f05316ae180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T15:36:57.436 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.325+0000 7fbed0940640 1 Processor -- start 2024-09-13T15:36:57.436 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.325+0000 7fbed0940640 1 -- start start 2024-09-13T15:36:57.436 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbed0940640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbecc0b1eb0 0x7fbecc0c2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:36:57.436 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbed0940640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc0cc770 con 0x7fbecc070720 2024-09-13T15:36:57.436 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbed0940640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbecc0c2b40 con 0x7fbecc0b1eb0 2024-09-13T15:36:57.436 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbeca59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbecc0b1eb0 0x7fbecc0c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:36:57.436 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbec1d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbecc070720 0x7fbecc06f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44072/0 (socket says 172.21.15.40:44072) 2024-09-13T15:36:57.437 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbec1d9b640 1 -- 172.21.15.40:0/2788730202 learned_addr learned my addr 172.21.15.40:0/2788730202 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:36:57.437 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbeca59c640 1 -- 172.21.15.40:0/2788730202 >> v1:172.21.15.40:6789/0 conn(0x7fbecc070720 legacy=0x7fbecc06f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:36:57.437 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbeca59c640 1 -- 172.21.15.40:0/2788730202 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc150ce0 con 0x7fbecc0b1eb0 2024-09-13T15:36:57.437 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbec9d9b640 1 -- 172.21.15.40:0/2788730202 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732232668 0 0) 0x7fbecc0cc770 con 0x7fbecc070720 2024-09-13T15:36:57.437 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbeca59c640 1 --2- 172.21.15.40:0/2788730202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbecc0b1eb0 0x7fbecc0c2220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009740 tx=0x7fbebc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3882f482d8fa7422 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:36:57.437 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbec9d9b640 1 -- 172.21.15.40:0/2788730202 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc0ab530 con 0x7fbecc0b1eb0 2024-09-13T15:36:57.437 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbec9d9b640 1 -- 172.21.15.40:0/2788730202 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc0a7050 con 0x7fbecc0b1eb0 2024-09-13T15:36:57.437 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbec9d9b640 1 -- 172.21.15.40:0/2788730202 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc0ab7e0 con 0x7fbecc0b1eb0 2024-09-13T15:36:57.437 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbed0940640 1 -- 172.21.15.40:0/2788730202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbecc0b1eb0 msgr2=0x7fbecc0c2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:36:57.437 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbed0940640 1 --2- 172.21.15.40:0/2788730202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbecc0b1eb0 0x7fbecc0c2220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009740 tx=0x7fbebc01c390 comp rx=0 tx=0).stop 2024-09-13T15:36:57.437 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbed0940640 1 -- 172.21.15.40:0/2788730202 shutdown_connections 2024-09-13T15:36:57.437 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbed0940640 1 --2- 172.21.15.40:0/2788730202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbecc0b1eb0 0x7fbecc0c2220 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbed0940640 1 -- 172.21.15.40:0/2788730202 >> 172.21.15.40:0/2788730202 conn(0x7fbecc06d480 msgr2=0x7fbecc06b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbed0940640 1 -- 172.21.15.40:0/2788730202 shutdown_connections 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.329+0000 7fbed0940640 1 -- 172.21.15.40:0/2788730202 wait complete. 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbed0940640 1 Processor -- start 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbed0940640 1 -- start start 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbed0940640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbecc070720 0x7fbecc0a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbed0940640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc0bf6c0 con 0x7fbecc070720 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbeca59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbecc070720 0x7fbecc0a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbeca59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbecc070720 0x7fbecc0a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39832/0 (socket says 172.21.15.40:39832) 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbeca59c640 1 -- 172.21.15.40:0/3190240624 learned_addr learned my addr 172.21.15.40:0/3190240624 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbeca59c640 1 -- 172.21.15.40:0/3190240624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc009420 con 0x7fbecc070720 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbeca59c640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbecc070720 0x7fbecc0a84b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbebc018fa0 tx=0x7fbebc01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbec37fe640 1 -- 172.21.15.40:0/3190240624 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc0b7450 con 0x7fbecc070720 2024-09-13T15:36:57.438 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbec37fe640 1 -- 172.21.15.40:0/3190240624 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc0b75d0 con 0x7fbecc070720 2024-09-13T15:36:57.439 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbec37fe640 1 -- 172.21.15.40:0/3190240624 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbebc0b78b0 con 0x7fbecc070720 2024-09-13T15:36:57.439 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbed0940640 1 -- 172.21.15.40:0/3190240624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc0c7ea0 con 0x7fbecc070720 2024-09-13T15:36:57.439 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbed0940640 1 -- 172.21.15.40:0/3190240624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc0c89a0 con 0x7fbecc070720 2024-09-13T15:36:57.439 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbed0940640 1 -- 172.21.15.40:0/3190240624 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbecc04eb40 con 0x7fbecc070720 2024-09-13T15:36:57.439 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbec37fe640 1 -- 172.21.15.40:0/3190240624 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 6) v1 ==== 43320+0+0 (secure 0 0 0) 0x7fbebc0b7a10 con 0x7fbecc070720 2024-09-13T15:36:57.439 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbec37fe640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 0x7fbeac037960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:36:57.439 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbec1d9b640 1 -- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 msgr2=0x7fbeac037960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6824/3185150828 2024-09-13T15:36:57.439 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbec37fe640 1 -- 172.21.15.40:0/3190240624 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5182+0+0 (secure 0 0 0) 0x7fbebc0e2690 con 0x7fbecc070720 2024-09-13T15:36:57.439 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.333+0000 7fbec1d9b640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 0x7fbeac037960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:36:57.439 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.341+0000 7fbec37fe640 1 -- 172.21.15.40:0/3190240624 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbebc0c78d0 con 0x7fbecc070720 2024-09-13T15:36:57.441 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:36:57.441 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:36:57.519 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.513+0000 7fbed0940640 1 -- 172.21.15.40:0/3190240624 --> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] -- mgr_command(tid 0: {"prefix": "fs snapshot mirror enable", "fs_name": "dc", "target": ["mon-mgr", ""]}) v1 -- 0x7fbecc0a9a30 con 0x7fbeac0354a0 2024-09-13T15:36:57.540 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.537+0000 7fbec1d9b640 1 -- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 msgr2=0x7fbeac037960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6824/3185150828 2024-09-13T15:36:57.540 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.537+0000 7fbec1d9b640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 0x7fbeac037960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T15:36:57.675 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:36:57.735 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:57.729+0000 7f05316ae180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T15:36:57.873 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:57.869+0000 7f05316ae180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T15:36:57.944 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.941+0000 7fbec1d9b640 1 -- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 msgr2=0x7fbeac037960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6824/3185150828 2024-09-13T15:36:57.966 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:57.941+0000 7fbec1d9b640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 0x7fbeac037960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T15:36:58.357 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:58.353+0000 7f05316ae180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T15:36:58.410 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:58.405+0000 7f05316ae180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T15:36:58.460 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:58.457+0000 7f05316ae180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T15:36:58.538 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:58.533+0000 7f05316ae180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T15:36:58.589 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:58.585+0000 7f05316ae180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T15:36:58.667 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:58.661+0000 7f05316ae180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T15:36:58.740 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:58.737+0000 7f05316ae180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T15:36:58.748 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:58.745+0000 7fbec1d9b640 1 -- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 msgr2=0x7fbeac037960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6824/3185150828 2024-09-13T15:36:58.748 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:36:58.745+0000 7fbec1d9b640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 0x7fbeac037960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T15:36:58.886 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:58.881+0000 7f05316ae180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T15:36:58.939 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:58.933+0000 7f05316ae180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T15:36:59.588 INFO:tasks.ceph.mgr.x.smithi040.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T15:36:59.589 INFO:tasks.ceph.mgr.x.smithi040.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T15:36:59.589 INFO:tasks.ceph.mgr.x.smithi040.stderr: from numpy import show_config as show_numpy_config 2024-09-13T15:36:59.602 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:59.597+0000 7f05316ae180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T15:36:59.811 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:59.805+0000 7f05316ae180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:36:59.983 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:36:59.977+0000 7f05316ae180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T15:37:00.055 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:00.049+0000 7f05316ae180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T15:37:00.194 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:00.189+0000 7f05316ae180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:37:00.352 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:00.349+0000 7fbec1d9b640 1 -- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 msgr2=0x7fbeac037960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.40:6824/3185150828 2024-09-13T15:37:00.352 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:00.349+0000 7fbec1d9b640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 0x7fbeac037960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T15:37:00.697 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:00.693+0000 7f05316ae180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T15:37:00.803 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:00.797+0000 7f05316ae180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T15:37:00.979 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:00.973+0000 7f05316ae180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T15:37:01.054 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.049+0000 7f05316ae180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T15:37:01.351 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.345+0000 7f05316ae180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T15:37:01.408 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.401+0000 7f05316ae180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T15:37:01.435 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:01.429+0000 7fbec37fe640 1 -- 172.21.15.40:0/3190240624 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mgrmap(e 7) v1 ==== 43031+0+0 (secure 0 0 0) 0x7fbebc0b7cc0 con 0x7fbecc070720 2024-09-13T15:37:01.435 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:01.429+0000 7fbec37fe640 1 -- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 msgr2=0x7fbeac037960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:37:01.435 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:01.429+0000 7fbec37fe640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 0x7fbeac037960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:01.510 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.505+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.510 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.505+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.510 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.505+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.511 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.505+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.511 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.505+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.511 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.505+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.511 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.505+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.511 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.505+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.511 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.505+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.511 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.505+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.523 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.517+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.524 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.517+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.524 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.517+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.524 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.517+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.524 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.517+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.554 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.549+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.554 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.549+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.554 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.549+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.554 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.549+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.555 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.549+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.561 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.557+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.561 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.557+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.561 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.557+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.561 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.557+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.561 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.557+0000 7f04b3c18640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.568 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.565+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.568 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.565+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.568 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.565+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.568 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.565+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:01.568 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:01.565+0000 7f04b641d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:02.439 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:02.433+0000 7fbec37fe640 1 -- 172.21.15.40:0/3190240624 <== mon.0 v2:172.21.15.40:3300/0 8 ==== mgrmap(e 8) v1 ==== 43158+0+0 (secure 0 0 0) 0x7fbebc0dc730 con 0x7fbecc070720 2024-09-13T15:37:02.440 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:02.433+0000 7fbec37fe640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fbeac03ffd0 0x7fbeac0423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:02.440 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:02.433+0000 7fbec37fe640 1 -- 172.21.15.40:0/3190240624 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "fs snapshot mirror enable", "fs_name": "dc", "target": ["mon-mgr", ""]}) v1 -- 0x7fbecc0a9a30 con 0x7fbeac03ffd0 2024-09-13T15:37:02.440 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:02.437+0000 7fbec1d9b640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fbeac03ffd0 0x7fbeac0423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:02.472 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:02.465+0000 7fbec1d9b640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fbeac03ffd0 0x7fbeac0423c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4004820 tx=0x7fbeb4007b30 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:03.493 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.489+0000 7fbec37fe640 1 -- 172.21.15.40:0/3190240624 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7fbecc0a9a30 con 0x7fbeac03ffd0 2024-09-13T15:37:03.493 INFO:tasks.workunit.client.1.smithi040.stdout:{} 2024-09-13T15:37:03.496 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.493+0000 7fbed0940640 1 -- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fbeac03ffd0 msgr2=0x7fbeac0423c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:03.496 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.493+0000 7fbed0940640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fbeac03ffd0 0x7fbeac0423c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4004820 tx=0x7fbeb4007b30 comp rx=0 tx=0).stop 2024-09-13T15:37:03.497 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.493+0000 7fbed0940640 1 -- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbecc070720 msgr2=0x7fbecc0a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:03.497 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.493+0000 7fbed0940640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbecc070720 0x7fbecc0a84b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbebc018fa0 tx=0x7fbebc01abd0 comp rx=0 tx=0).stop 2024-09-13T15:37:03.497 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.493+0000 7fbed0940640 1 -- 172.21.15.40:0/3190240624 shutdown_connections 2024-09-13T15:37:03.497 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.493+0000 7fbed0940640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3185150828,v1:172.21.15.40:6825/3185150828] conn(0x7fbeac0354a0 0x7fbeac037960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:03.497 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.493+0000 7fbed0940640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fbeac03ffd0 0x7fbeac0423c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:03.497 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.493+0000 7fbed0940640 1 --2- 172.21.15.40:0/3190240624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbecc070720 0x7fbecc0a84b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:03.497 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.493+0000 7fbed0940640 1 -- 172.21.15.40:0/3190240624 >> 172.21.15.40:0/3190240624 conn(0x7fbecc06d480 msgr2=0x7fbecc0cbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:37:03.497 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.493+0000 7fbed0940640 1 -- 172.21.15.40:0/3190240624 shutdown_connections 2024-09-13T15:37:03.497 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.493+0000 7fbed0940640 1 -- 172.21.15.40:0/3190240624 wait complete. 2024-09-13T15:37:03.518 INFO:tasks.workunit.client.1.smithi040.stderr:+ ceph fs snapshot mirror peer_add dc client.mirror_remote@ceph dc-backup 2024-09-13T15:37:03.649 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.645+0000 7ff5376c3640 1 Processor -- start 2024-09-13T15:37:03.649 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.645+0000 7ff5376c3640 1 -- start start 2024-09-13T15:37:03.650 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.645+0000 7ff5376c3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff5300ccc30 0x7ff5300bb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:03.650 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.645+0000 7ff5376c3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5300bf040 con 0x7ff5300cd010 2024-09-13T15:37:03.650 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.645+0000 7ff5376c3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5300bee20 con 0x7ff5300ccc30 2024-09-13T15:37:03.650 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.645+0000 7ff53545f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff5300ccc30 0x7ff5300bb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:03.650 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.645+0000 7ff534c5e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff5300cd010 0x7ff53015ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44100/0 (socket says 172.21.15.40:44100) 2024-09-13T15:37:03.650 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.645+0000 7ff534c5e640 1 -- 172.21.15.40:0/2263329363 learned_addr learned my addr 172.21.15.40:0/2263329363 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:37:03.650 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.645+0000 7ff53545f640 1 -- 172.21.15.40:0/2263329363 >> v1:172.21.15.40:6789/0 conn(0x7ff5300cd010 legacy=0x7ff53015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:03.650 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.645+0000 7ff53545f640 1 -- 172.21.15.40:0/2263329363 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5300bd260 con 0x7ff5300ccc30 2024-09-13T15:37:03.652 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff53545f640 1 --2- 172.21.15.40:0/2263329363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5300ccc30 0x7ff5300bb930 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009740 tx=0x7ff52c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed0fad598c7db60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:03.653 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff527fff640 1 -- 172.21.15.40:0/2263329363 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff52c0ab530 con 0x7ff5300ccc30 2024-09-13T15:37:03.653 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff527fff640 1 -- 172.21.15.40:0/2263329363 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c0a7050 con 0x7ff5300ccc30 2024-09-13T15:37:03.653 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff527fff640 1 -- 172.21.15.40:0/2263329363 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff52c0ab7e0 con 0x7ff5300ccc30 2024-09-13T15:37:03.654 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff5376c3640 1 -- 172.21.15.40:0/2263329363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5300ccc30 msgr2=0x7ff5300bb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:03.654 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff5376c3640 1 --2- 172.21.15.40:0/2263329363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5300ccc30 0x7ff5300bb930 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff52c009740 tx=0x7ff52c01c390 comp rx=0 tx=0).stop 2024-09-13T15:37:03.654 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff5376c3640 1 -- 172.21.15.40:0/2263329363 shutdown_connections 2024-09-13T15:37:03.654 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff5376c3640 1 --2- 172.21.15.40:0/2263329363 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5300ccc30 0x7ff5300bb930 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:03.654 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff5376c3640 1 -- 172.21.15.40:0/2263329363 >> 172.21.15.40:0/2263329363 conn(0x7ff53006d080 msgr2=0x7ff5300bf660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:37:03.654 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff5376c3640 1 -- 172.21.15.40:0/2263329363 shutdown_connections 2024-09-13T15:37:03.654 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff5376c3640 1 -- 172.21.15.40:0/2263329363 wait complete. 2024-09-13T15:37:03.655 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff5376c3640 1 Processor -- start 2024-09-13T15:37:03.655 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff5376c3640 1 -- start start 2024-09-13T15:37:03.655 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff5376c3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5300ccc30 0x7ff5301f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:03.655 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff5376c3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5301f58a0 con 0x7ff5300ccc30 2024-09-13T15:37:03.656 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff53545f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5300ccc30 0x7ff5301f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:03.656 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff53545f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5300ccc30 0x7ff5301f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40142/0 (socket says 172.21.15.40:40142) 2024-09-13T15:37:03.656 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff53545f640 1 -- 172.21.15.40:0/491804866 learned_addr learned my addr 172.21.15.40:0/491804866 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:37:03.656 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.649+0000 7ff53545f640 1 -- 172.21.15.40:0/491804866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c009420 con 0x7ff5300ccc30 2024-09-13T15:37:03.658 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.653+0000 7ff53545f640 1 --2- 172.21.15.40:0/491804866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5300ccc30 0x7ff5301f5360 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff52c018fa0 tx=0x7ff52c01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:03.658 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.653+0000 7ff525ffb640 1 -- 172.21.15.40:0/491804866 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff52c0b7450 con 0x7ff5300ccc30 2024-09-13T15:37:03.658 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.653+0000 7ff525ffb640 1 -- 172.21.15.40:0/491804866 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c0b75b0 con 0x7ff5300ccc30 2024-09-13T15:37:03.658 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.653+0000 7ff5376c3640 1 -- 172.21.15.40:0/491804866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff530153b90 con 0x7ff5300ccc30 2024-09-13T15:37:03.659 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.653+0000 7ff525ffb640 1 -- 172.21.15.40:0/491804866 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff52c0b7890 con 0x7ff5300ccc30 2024-09-13T15:37:03.659 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.653+0000 7ff5376c3640 1 -- 172.21.15.40:0/491804866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff530154070 con 0x7ff5300ccc30 2024-09-13T15:37:03.659 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.653+0000 7ff525ffb640 1 -- 172.21.15.40:0/491804866 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 8) v1 ==== 43158+0+0 (secure 0 0 0) 0x7ff52c0b79f0 con 0x7ff5300ccc30 2024-09-13T15:37:03.659 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.653+0000 7ff5376c3640 1 -- 172.21.15.40:0/491804866 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5300bddf0 con 0x7ff5300ccc30 2024-09-13T15:37:03.659 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.653+0000 7ff525ffb640 1 --2- 172.21.15.40:0/491804866 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff5140352f0 0x7ff5140377b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:03.659 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.653+0000 7ff525ffb640 1 -- 172.21.15.40:0/491804866 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5440+0+0 (secure 0 0 0) 0x7ff52c0e2700 con 0x7ff5300ccc30 2024-09-13T15:37:03.659 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.653+0000 7ff534c5e640 1 --2- 172.21.15.40:0/491804866 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff5140352f0 0x7ff5140377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:03.659 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.653+0000 7ff534c5e640 1 --2- 172.21.15.40:0/491804866 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff5140352f0 0x7ff5140377b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff520001610 tx=0x7ff520007ad0 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:03.662 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.657+0000 7ff525ffb640 1 -- 172.21.15.40:0/491804866 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5300bddf0 con 0x7ff5300ccc30 2024-09-13T15:37:03.841 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:03.837+0000 7ff5376c3640 1 -- 172.21.15.40:0/491804866 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "fs snapshot mirror peer_add", "fs_name": "dc", "remote_cluster_spec": "client.mirror_remote@ceph", "remote_fs_name": "dc-backup", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5300bddf0 con 0x7ff5140352f0 2024-09-13T15:37:03.864 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:03.861+0000 7f04cad46640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:03.864 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:03.861+0000 7f04cad46640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:03.864 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:03.861+0000 7f04cad46640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:03.864 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:03.861+0000 7f04cad46640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:03.864 INFO:tasks.ceph.mgr.x.smithi040.stderr:2024-09-13T15:37:03.861+0000 7f04cad46640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T15:37:04.449 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.445+0000 7ff525ffb640 1 -- 172.21.15.40:0/491804866 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mgrmap(e 9) v1 ==== 43623+0+0 (secure 0 0 0) 0x7ff52c0c7d00 con 0x7ff5300ccc30 2024-09-13T15:37:04.490 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.485+0000 7ff525ffb640 1 -- 172.21.15.40:0/491804866 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7ff5300bddf0 con 0x7ff5140352f0 2024-09-13T15:37:04.490 INFO:tasks.workunit.client.1.smithi040.stdout:{} 2024-09-13T15:37:04.494 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.489+0000 7ff5376c3640 1 -- 172.21.15.40:0/491804866 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff5140352f0 msgr2=0x7ff5140377b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:04.494 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.489+0000 7ff5376c3640 1 --2- 172.21.15.40:0/491804866 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff5140352f0 0x7ff5140377b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff520001610 tx=0x7ff520007ad0 comp rx=0 tx=0).stop 2024-09-13T15:37:04.494 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.489+0000 7ff5376c3640 1 -- 172.21.15.40:0/491804866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5300ccc30 msgr2=0x7ff5301f5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:04.494 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.489+0000 7ff5376c3640 1 --2- 172.21.15.40:0/491804866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5300ccc30 0x7ff5301f5360 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff52c018fa0 tx=0x7ff52c01abd0 comp rx=0 tx=0).stop 2024-09-13T15:37:04.494 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.489+0000 7ff5376c3640 1 -- 172.21.15.40:0/491804866 shutdown_connections 2024-09-13T15:37:04.494 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.489+0000 7ff5376c3640 1 --2- 172.21.15.40:0/491804866 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff5140352f0 0x7ff5140377b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:04.495 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.489+0000 7ff5376c3640 1 --2- 172.21.15.40:0/491804866 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5300ccc30 0x7ff5301f5360 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:04.495 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.489+0000 7ff5376c3640 1 -- 172.21.15.40:0/491804866 >> 172.21.15.40:0/491804866 conn(0x7ff53006d080 msgr2=0x7ff5300be170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:37:04.495 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.489+0000 7ff5376c3640 1 -- 172.21.15.40:0/491804866 shutdown_connections 2024-09-13T15:37:04.495 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.489+0000 7ff5376c3640 1 -- 172.21.15.40:0/491804866 wait complete. 2024-09-13T15:37:04.513 INFO:tasks.workunit.client.1.smithi040.stderr:++ seq 1 4 2024-09-13T15:37:04.514 INFO:tasks.workunit.client.1.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:37:04.514 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_1 2024-09-13T15:37:04.514 INFO:tasks.workunit.client.1.smithi040.stderr:+ ceph fs snapshot mirror add dc /mirror/ceph_repo/ceph-qa-suite_1 2024-09-13T15:37:04.633 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.629+0000 7f0809c61640 1 Processor -- start 2024-09-13T15:37:04.633 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.629+0000 7f0809c61640 1 -- start start 2024-09-13T15:37:04.635 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.629+0000 7f0809c61640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f080406f920 0x7f0804150c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:04.635 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.629+0000 7f0809c61640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08040ba4d0 con 0x7f080406f540 2024-09-13T15:37:04.635 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.629+0000 7f0809c61640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08041538b0 con 0x7f080406f920 2024-09-13T15:37:04.635 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.629+0000 7f08037fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f080406f540 0x7f0804071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54464/0 (socket says 172.21.15.40:54464) 2024-09-13T15:37:04.635 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.629+0000 7f08037fe640 1 -- 172.21.15.40:0/3520478960 learned_addr learned my addr 172.21.15.40:0/3520478960 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:37:04.635 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.629+0000 7f0802ffd640 1 --2- 172.21.15.40:0/3520478960 >> v2:172.21.15.40:3300/0 conn(0x7f080406f920 0x7f0804150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:04.635 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.629+0000 7f08027fc640 1 -- 172.21.15.40:0/3520478960 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222876249 0 0) 0x7f08040ba4d0 con 0x7f080406f540 2024-09-13T15:37:04.635 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.629+0000 7f08027fc640 1 -- 172.21.15.40:0/3520478960 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07ec003530 con 0x7f080406f540 2024-09-13T15:37:04.635 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.629+0000 7f0802ffd640 1 -- 172.21.15.40:0/3520478960 >> v1:172.21.15.40:6789/0 conn(0x7f080406f540 legacy=0x7f0804071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:04.636 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.629+0000 7f0802ffd640 1 -- 172.21.15.40:0/3520478960 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804153a20 con 0x7f080406f920 2024-09-13T15:37:04.637 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f0802ffd640 1 --2- 172.21.15.40:0/3520478960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f080406f920 0x7f0804150c10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009730 tx=0x7f07f801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafae9ced230045b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:04.637 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f08027fc640 1 -- 172.21.15.40:0/3520478960 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07f80ab570 con 0x7f080406f920 2024-09-13T15:37:04.637 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f08027fc640 1 -- 172.21.15.40:0/3520478960 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f80a7070 con 0x7f080406f920 2024-09-13T15:37:04.637 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f08027fc640 1 -- 172.21.15.40:0/3520478960 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07f80ab820 con 0x7f080406f920 2024-09-13T15:37:04.638 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f0809c61640 1 -- 172.21.15.40:0/3520478960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f080406f920 msgr2=0x7f0804150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:04.638 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f0809c61640 1 --2- 172.21.15.40:0/3520478960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f080406f920 0x7f0804150c10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009730 tx=0x7f07f801c420 comp rx=0 tx=0).stop 2024-09-13T15:37:04.638 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f0809c61640 1 -- 172.21.15.40:0/3520478960 shutdown_connections 2024-09-13T15:37:04.638 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f0809c61640 1 --2- 172.21.15.40:0/3520478960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f080406f920 0x7f0804150c10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:04.639 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f0809c61640 1 -- 172.21.15.40:0/3520478960 >> 172.21.15.40:0/3520478960 conn(0x7f080406e7c0 msgr2=0x7f080406ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:37:04.639 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f0809c61640 1 -- 172.21.15.40:0/3520478960 shutdown_connections 2024-09-13T15:37:04.639 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f0809c61640 1 -- 172.21.15.40:0/3520478960 wait complete. 2024-09-13T15:37:04.639 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f0809c61640 1 Processor -- start 2024-09-13T15:37:04.639 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.633+0000 7f0809c61640 1 -- start start 2024-09-13T15:37:04.640 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f0809c61640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f080406f540 0x7f08041522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:04.640 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f0809c61640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08040bcb60 con 0x7f080406f540 2024-09-13T15:37:04.640 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f08037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f080406f540 0x7f08041522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:04.640 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f08037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f080406f540 0x7f08041522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48402/0 (socket says 172.21.15.40:48402) 2024-09-13T15:37:04.640 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f08037fe640 1 -- 172.21.15.40:0/3355224681 learned_addr learned my addr 172.21.15.40:0/3355224681 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:37:04.641 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f08037fe640 1 -- 172.21.15.40:0/3355224681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f80093c0 con 0x7f080406f540 2024-09-13T15:37:04.641 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f08037fe640 1 --2- 172.21.15.40:0/3355224681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f080406f540 0x7f08041522c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f07f400cb40 tx=0x7f07f400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:04.641 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f07ebfff640 1 -- 172.21.15.40:0/3355224681 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07f400abf0 con 0x7f080406f540 2024-09-13T15:37:04.642 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f07ebfff640 1 -- 172.21.15.40:0/3355224681 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f400ad50 con 0x7f080406f540 2024-09-13T15:37:04.642 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f07ebfff640 1 -- 172.21.15.40:0/3355224681 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07f4012400 con 0x7f080406f540 2024-09-13T15:37:04.642 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f0809c61640 1 -- 172.21.15.40:0/3355224681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08040be5c0 con 0x7f080406f540 2024-09-13T15:37:04.642 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f0809c61640 1 -- 172.21.15.40:0/3355224681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080414b410 con 0x7f080406f540 2024-09-13T15:37:04.643 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f07ebfff640 1 -- 172.21.15.40:0/3355224681 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 43623+0+0 (secure 0 0 0) 0x7f07f4007070 con 0x7f080406f540 2024-09-13T15:37:04.643 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f0809c61640 1 -- 172.21.15.40:0/3355224681 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080404eb40 con 0x7f080406f540 2024-09-13T15:37:04.643 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f07ebfff640 1 --2- 172.21.15.40:0/3355224681 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f07f0035800 0x7f07f0037cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:04.643 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f07ebfff640 1 -- 172.21.15.40:0/3355224681 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5440+0+0 (secure 0 0 0) 0x7f07f40483c0 con 0x7f080406f540 2024-09-13T15:37:04.643 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f0802ffd640 1 --2- 172.21.15.40:0/3355224681 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f07f0035800 0x7f07f0037cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:04.643 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.637+0000 7f0802ffd640 1 --2- 172.21.15.40:0/3355224681 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f07f0035800 0x7f07f0037cc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f07f80af000 tx=0x7f07f8008040 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:04.648 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.645+0000 7f07ebfff640 1 -- 172.21.15.40:0/3355224681 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f07f401b3b0 con 0x7f080406f540 2024-09-13T15:37:04.828 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.821+0000 7f0809c61640 1 -- 172.21.15.40:0/3355224681 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "fs snapshot mirror add", "fs_name": "dc", "path": "/mirror/ceph_repo/ceph-qa-suite_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0804150c10 con 0x7f07f0035800 2024-09-13T15:37:04.833 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.829+0000 7f07ebfff640 1 -- 172.21.15.40:0/3355224681 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7f0804150c10 con 0x7f07f0035800 2024-09-13T15:37:04.833 INFO:tasks.workunit.client.1.smithi040.stdout:{} 2024-09-13T15:37:04.835 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.829+0000 7f0809c61640 1 -- 172.21.15.40:0/3355224681 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f07f0035800 msgr2=0x7f07f0037cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:04.836 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.829+0000 7f0809c61640 1 --2- 172.21.15.40:0/3355224681 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f07f0035800 0x7f07f0037cc0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f07f80af000 tx=0x7f07f8008040 comp rx=0 tx=0).stop 2024-09-13T15:37:04.836 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.829+0000 7f0809c61640 1 -- 172.21.15.40:0/3355224681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f080406f540 msgr2=0x7f08041522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:04.836 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.829+0000 7f0809c61640 1 --2- 172.21.15.40:0/3355224681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f080406f540 0x7f08041522c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f07f400cb40 tx=0x7f07f400a060 comp rx=0 tx=0).stop 2024-09-13T15:37:04.836 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.829+0000 7f0809c61640 1 -- 172.21.15.40:0/3355224681 shutdown_connections 2024-09-13T15:37:04.836 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.829+0000 7f0809c61640 1 --2- 172.21.15.40:0/3355224681 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f07f0035800 0x7f07f0037cc0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:04.836 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.829+0000 7f0809c61640 1 --2- 172.21.15.40:0/3355224681 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f080406f540 0x7f08041522c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:04.836 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.829+0000 7f0809c61640 1 -- 172.21.15.40:0/3355224681 >> 172.21.15.40:0/3355224681 conn(0x7f080406e7c0 msgr2=0x7f080406eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:37:04.836 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.829+0000 7f0809c61640 1 -- 172.21.15.40:0/3355224681 shutdown_connections 2024-09-13T15:37:04.836 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.829+0000 7f0809c61640 1 -- 172.21.15.40:0/3355224681 wait complete. 2024-09-13T15:37:04.851 INFO:tasks.workunit.client.1.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:37:04.851 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_2 2024-09-13T15:37:04.851 INFO:tasks.workunit.client.1.smithi040.stderr:+ ceph fs snapshot mirror add dc /mirror/ceph_repo/ceph-qa-suite_2 2024-09-13T15:37:04.977 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.973+0000 7f6b3da0e640 1 Processor -- start 2024-09-13T15:37:04.978 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.973+0000 7f6b3da0e640 1 -- start start 2024-09-13T15:37:04.978 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.973+0000 7f6b3da0e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b380cb640 0x7f6b38151240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:04.978 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.973+0000 7f6b3da0e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b38151b90 con 0x7f6b380cba20 2024-09-13T15:37:04.978 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.973+0000 7f6b3da0e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b380c75a0 con 0x7f6b380cb640 2024-09-13T15:37:04.979 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.973+0000 7f6b36ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b380cb640 0x7f6b38151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:04.979 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.973+0000 7f6b367fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6b380cba20 0x7f6b3806aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54476/0 (socket says 172.21.15.40:54476) 2024-09-13T15:37:04.979 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.973+0000 7f6b367fc640 1 -- 172.21.15.40:0/273840273 learned_addr learned my addr 172.21.15.40:0/273840273 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:37:04.979 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.973+0000 7f6b36ffd640 1 -- 172.21.15.40:0/273840273 >> v1:172.21.15.40:6789/0 conn(0x7f6b380cba20 legacy=0x7f6b3806aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:04.979 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.973+0000 7f6b35ffb640 1 -- 172.21.15.40:0/273840273 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481419819 0 0) 0x7f6b38151b90 con 0x7f6b380cba20 2024-09-13T15:37:04.979 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.973+0000 7f6b36ffd640 1 -- 172.21.15.40:0/273840273 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b38151780 con 0x7f6b380cb640 2024-09-13T15:37:04.982 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.977+0000 7f6b36ffd640 1 --2- 172.21.15.40:0/273840273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b380cb640 0x7f6b38151240 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009740 tx=0x7f6b2c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5374fac37c23e337 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:04.983 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.977+0000 7f6b35ffb640 1 -- 172.21.15.40:0/273840273 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b2c0ac540 con 0x7f6b380cb640 2024-09-13T15:37:04.983 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.977+0000 7f6b35ffb640 1 -- 172.21.15.40:0/273840273 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c0ac6a0 con 0x7f6b380cb640 2024-09-13T15:37:04.983 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.977+0000 7f6b35ffb640 1 -- 172.21.15.40:0/273840273 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b2c0ac960 con 0x7f6b380cb640 2024-09-13T15:37:04.983 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.977+0000 7f6b3da0e640 1 -- 172.21.15.40:0/273840273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b380cb640 msgr2=0x7f6b38151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:04.984 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.977+0000 7f6b3da0e640 1 --2- 172.21.15.40:0/273840273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b380cb640 0x7f6b38151240 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c009740 tx=0x7f6b2c01c390 comp rx=0 tx=0).stop 2024-09-13T15:37:04.984 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.977+0000 7f6b3da0e640 1 -- 172.21.15.40:0/273840273 shutdown_connections 2024-09-13T15:37:04.984 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.977+0000 7f6b3da0e640 1 --2- 172.21.15.40:0/273840273 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b380cb640 0x7f6b38151240 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:04.984 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.977+0000 7f6b3da0e640 1 -- 172.21.15.40:0/273840273 >> 172.21.15.40:0/273840273 conn(0x7f6b380bfa90 msgr2=0x7f6b380bfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:37:04.984 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.977+0000 7f6b3da0e640 1 -- 172.21.15.40:0/273840273 shutdown_connections 2024-09-13T15:37:04.984 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.977+0000 7f6b3da0e640 1 -- 172.21.15.40:0/273840273 wait complete. 2024-09-13T15:37:04.985 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b3da0e640 1 Processor -- start 2024-09-13T15:37:04.985 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b3da0e640 1 -- start start 2024-09-13T15:37:04.986 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b3da0e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b380cb640 0x7f6b38150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:04.986 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b3da0e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b381610d0 con 0x7f6b380cb640 2024-09-13T15:37:04.986 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b36ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b380cb640 0x7f6b38150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:04.986 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b36ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b380cb640 0x7f6b38150560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48426/0 (socket says 172.21.15.40:48426) 2024-09-13T15:37:04.986 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b36ffd640 1 -- 172.21.15.40:0/2430234982 learned_addr learned my addr 172.21.15.40:0/2430234982 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:37:04.986 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b36ffd640 1 -- 172.21.15.40:0/2430234982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c009420 con 0x7f6b380cb640 2024-09-13T15:37:04.987 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b36ffd640 1 --2- 172.21.15.40:0/2430234982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b380cb640 0x7f6b38150560 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c019fc0 tx=0x7f6b2c01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:04.987 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b1ffff640 1 -- 172.21.15.40:0/2430234982 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b2c0b8580 con 0x7f6b380cb640 2024-09-13T15:37:04.987 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b1ffff640 1 -- 172.21.15.40:0/2430234982 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c0b86e0 con 0x7f6b380cb640 2024-09-13T15:37:04.987 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b3da0e640 1 -- 172.21.15.40:0/2430234982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b38150aa0 con 0x7f6b380cb640 2024-09-13T15:37:04.988 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b1ffff640 1 -- 172.21.15.40:0/2430234982 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b2c0b89a0 con 0x7f6b380cb640 2024-09-13T15:37:04.988 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b3da0e640 1 -- 172.21.15.40:0/2430234982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3806abd0 con 0x7f6b380cb640 2024-09-13T15:37:04.988 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.981+0000 7f6b1ffff640 1 -- 172.21.15.40:0/2430234982 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 43623+0+0 (secure 0 0 0) 0x7f6b2c0b8b00 con 0x7f6b380cb640 2024-09-13T15:37:04.989 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.985+0000 7f6b3da0e640 1 -- 172.21.15.40:0/2430234982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b380746c0 con 0x7f6b380cb640 2024-09-13T15:37:04.989 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.985+0000 7f6b1ffff640 1 --2- 172.21.15.40:0/2430234982 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6b24035850 0x7f6b24037d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:04.989 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.985+0000 7f6b1ffff640 1 -- 172.21.15.40:0/2430234982 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5440+0+0 (secure 0 0 0) 0x7f6b2c0e3010 con 0x7f6b380cb640 2024-09-13T15:37:04.989 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.985+0000 7f6b367fc640 1 --2- 172.21.15.40:0/2430234982 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6b24035850 0x7f6b24037d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:04.989 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.985+0000 7f6b367fc640 1 --2- 172.21.15.40:0/2430234982 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6b24035850 0x7f6b24037d10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6b28007fd0 tx=0x7f6b28007980 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:04.992 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:04.989+0000 7f6b1ffff640 1 -- 172.21.15.40:0/2430234982 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b2c0b6400 con 0x7f6b380cb640 2024-09-13T15:37:05.172 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.169+0000 7f6b3da0e640 1 -- 172.21.15.40:0/2430234982 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "fs snapshot mirror add", "fs_name": "dc", "path": "/mirror/ceph_repo/ceph-qa-suite_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b38153f70 con 0x7f6b24035850 2024-09-13T15:37:05.177 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.173+0000 7f6b1ffff640 1 -- 172.21.15.40:0/2430234982 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7f6b28001c60 con 0x7f6b24035850 2024-09-13T15:37:05.177 INFO:tasks.workunit.client.1.smithi040.stdout:{} 2024-09-13T15:37:05.179 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.173+0000 7f6b3da0e640 1 -- 172.21.15.40:0/2430234982 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6b24035850 msgr2=0x7f6b24037d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:05.179 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.173+0000 7f6b3da0e640 1 --2- 172.21.15.40:0/2430234982 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6b24035850 0x7f6b24037d10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6b28007fd0 tx=0x7f6b28007980 comp rx=0 tx=0).stop 2024-09-13T15:37:05.179 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.173+0000 7f6b3da0e640 1 -- 172.21.15.40:0/2430234982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b380cb640 msgr2=0x7f6b38150560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:05.179 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.173+0000 7f6b3da0e640 1 --2- 172.21.15.40:0/2430234982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b380cb640 0x7f6b38150560 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c019fc0 tx=0x7f6b2c01abd0 comp rx=0 tx=0).stop 2024-09-13T15:37:05.179 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.173+0000 7f6b3da0e640 1 -- 172.21.15.40:0/2430234982 shutdown_connections 2024-09-13T15:37:05.180 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.173+0000 7f6b3da0e640 1 --2- 172.21.15.40:0/2430234982 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6b24035850 0x7f6b24037d10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:05.180 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.173+0000 7f6b3da0e640 1 --2- 172.21.15.40:0/2430234982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b380cb640 0x7f6b38150560 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:05.180 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.173+0000 7f6b3da0e640 1 -- 172.21.15.40:0/2430234982 >> 172.21.15.40:0/2430234982 conn(0x7f6b380bfa90 msgr2=0x7f6b38070450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:37:05.180 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.173+0000 7f6b3da0e640 1 -- 172.21.15.40:0/2430234982 shutdown_connections 2024-09-13T15:37:05.180 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.173+0000 7f6b3da0e640 1 -- 172.21.15.40:0/2430234982 wait complete. 2024-09-13T15:37:05.195 INFO:tasks.workunit.client.1.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:37:05.195 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_3 2024-09-13T15:37:05.195 INFO:tasks.workunit.client.1.smithi040.stderr:+ ceph fs snapshot mirror add dc /mirror/ceph_repo/ceph-qa-suite_3 2024-09-13T15:37:05.323 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.317+0000 7f0e8311a640 1 Processor -- start 2024-09-13T15:37:05.323 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.317+0000 7f0e8311a640 1 -- start start 2024-09-13T15:37:05.325 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e8311a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e7c0b1af0 0x7f0e7c069f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:05.325 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e8311a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c0ca6b0 con 0x7f0e7c0b1ed0 2024-09-13T15:37:05.325 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e8311a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7c0cccf0 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.325 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e80eb6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e7c0b1af0 0x7f0e7c069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:05.325 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e7bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0e7c0b1ed0 0x7f0e7c0c5820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54492/0 (socket says 172.21.15.40:54492) 2024-09-13T15:37:05.325 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e7bfff640 1 -- 172.21.15.40:0/2539110009 learned_addr learned my addr 172.21.15.40:0/2539110009 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:37:05.325 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e80eb6640 1 --2- 172.21.15.40:0/2539110009 >> v2:172.21.15.40:3300/0 conn(0x7f0e7c0b1af0 0x7f0e7c069f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48450/0 (socket says 172.21.15.40:48450) 2024-09-13T15:37:05.325 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e80eb6640 1 -- 172.21.15.40:0/2539110009 >> v1:172.21.15.40:6789/0 conn(0x7f0e7c0b1ed0 legacy=0x7f0e7c0c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:05.325 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e7b7fe640 1 -- 172.21.15.40:0/2539110009 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286573899 0 0) 0x7f0e7c0ca6b0 con 0x7f0e7c0b1ed0 2024-09-13T15:37:05.326 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e80eb6640 1 -- 172.21.15.40:0/2539110009 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c0c65b0 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.327 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e80eb6640 1 --2- 172.21.15.40:0/2539110009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e7c0b1af0 0x7f0e7c069f80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009740 tx=0x7f0e7001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40deb770b86aade server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:05.327 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e7b7fe640 1 -- 172.21.15.40:0/2539110009 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e700ab530 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.327 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e7b7fe640 1 -- 172.21.15.40:0/2539110009 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e700a7050 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.328 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.321+0000 7f0e7b7fe640 1 -- 172.21.15.40:0/2539110009 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e700ab7e0 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.328 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e8311a640 1 -- 172.21.15.40:0/2539110009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e7c0b1af0 msgr2=0x7f0e7c069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:05.328 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e8311a640 1 --2- 172.21.15.40:0/2539110009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e7c0b1af0 0x7f0e7c069f80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009740 tx=0x7f0e7001c360 comp rx=0 tx=0).stop 2024-09-13T15:37:05.328 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e8311a640 1 -- 172.21.15.40:0/2539110009 shutdown_connections 2024-09-13T15:37:05.329 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e8311a640 1 --2- 172.21.15.40:0/2539110009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e7c0b1af0 0x7f0e7c069f80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:05.329 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e8311a640 1 -- 172.21.15.40:0/2539110009 >> 172.21.15.40:0/2539110009 conn(0x7f0e7c06b090 msgr2=0x7f0e7c06b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:37:05.329 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e8311a640 1 -- 172.21.15.40:0/2539110009 shutdown_connections 2024-09-13T15:37:05.329 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e8311a640 1 -- 172.21.15.40:0/2539110009 wait complete. 2024-09-13T15:37:05.330 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e8311a640 1 Processor -- start 2024-09-13T15:37:05.330 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e8311a640 1 -- start start 2024-09-13T15:37:05.331 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e8311a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e7c0b1af0 0x7f0e7c0bff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:05.331 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e8311a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c160f50 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.331 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e80eb6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e7c0b1af0 0x7f0e7c0bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:05.331 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e80eb6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e7c0b1af0 0x7f0e7c0bff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48458/0 (socket says 172.21.15.40:48458) 2024-09-13T15:37:05.331 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e80eb6640 1 -- 172.21.15.40:0/820928528 learned_addr learned my addr 172.21.15.40:0/820928528 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:37:05.332 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.325+0000 7f0e80eb6640 1 -- 172.21.15.40:0/820928528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e70009420 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.332 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.329+0000 7f0e80eb6640 1 --2- 172.21.15.40:0/820928528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e7c0b1af0 0x7f0e7c0bff10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0e70019f90 tx=0x7f0e7001aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:05.332 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.329+0000 7f0e797fa640 1 -- 172.21.15.40:0/820928528 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e700b7450 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.333 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.329+0000 7f0e797fa640 1 -- 172.21.15.40:0/820928528 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e700b75b0 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.333 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.329+0000 7f0e8311a640 1 -- 172.21.15.40:0/820928528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c14c0b0 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.333 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.329+0000 7f0e797fa640 1 -- 172.21.15.40:0/820928528 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e700b7850 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.333 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.329+0000 7f0e8311a640 1 -- 172.21.15.40:0/820928528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c14be40 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.334 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.329+0000 7f0e797fa640 1 -- 172.21.15.40:0/820928528 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 9) v1 ==== 43623+0+0 (secure 0 0 0) 0x7f0e700b79b0 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.334 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.329+0000 7f0e8311a640 1 -- 172.21.15.40:0/820928528 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7c153880 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.334 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.329+0000 7f0e797fa640 1 --2- 172.21.15.40:0/820928528 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f0e60035800 0x7f0e60037cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:05.334 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.329+0000 7f0e797fa640 1 -- 172.21.15.40:0/820928528 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5440+0+0 (secure 0 0 0) 0x7f0e700e2f70 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.334 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.329+0000 7f0e7bfff640 1 --2- 172.21.15.40:0/820928528 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f0e60035800 0x7f0e60037cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:05.334 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.329+0000 7f0e7bfff640 1 --2- 172.21.15.40:0/820928528 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f0e60035800 0x7f0e60037cc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0e68007fd0 tx=0x7f0e68007980 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:05.339 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.333+0000 7f0e797fa640 1 -- 172.21.15.40:0/820928528 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0e700c76c0 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.505 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.501+0000 7f0e797fa640 1 -- 172.21.15.40:0/820928528 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mgrmap(e 10) v1 ==== 43732+0+0 (secure 0 0 0) 0x7f0e700b54a0 con 0x7f0e7c0b1af0 2024-09-13T15:37:05.524 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.521+0000 7f0e8311a640 1 -- 172.21.15.40:0/820928528 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "fs snapshot mirror add", "fs_name": "dc", "path": "/mirror/ceph_repo/ceph-qa-suite_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e7c06aa40 con 0x7f0e60035800 2024-09-13T15:37:05.529 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.525+0000 7f0e797fa640 1 -- 172.21.15.40:0/820928528 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7f0e7c06aa40 con 0x7f0e60035800 2024-09-13T15:37:05.529 INFO:tasks.workunit.client.1.smithi040.stdout:{} 2024-09-13T15:37:05.532 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.525+0000 7f0e8311a640 1 -- 172.21.15.40:0/820928528 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f0e60035800 msgr2=0x7f0e60037cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:05.532 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.525+0000 7f0e8311a640 1 --2- 172.21.15.40:0/820928528 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f0e60035800 0x7f0e60037cc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0e68007fd0 tx=0x7f0e68007980 comp rx=0 tx=0).stop 2024-09-13T15:37:05.532 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.525+0000 7f0e8311a640 1 -- 172.21.15.40:0/820928528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e7c0b1af0 msgr2=0x7f0e7c0bff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:05.532 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.525+0000 7f0e8311a640 1 --2- 172.21.15.40:0/820928528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e7c0b1af0 0x7f0e7c0bff10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0e70019f90 tx=0x7f0e7001aba0 comp rx=0 tx=0).stop 2024-09-13T15:37:05.532 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.525+0000 7f0e8311a640 1 -- 172.21.15.40:0/820928528 shutdown_connections 2024-09-13T15:37:05.533 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.525+0000 7f0e8311a640 1 --2- 172.21.15.40:0/820928528 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f0e60035800 0x7f0e60037cc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:05.533 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.525+0000 7f0e8311a640 1 --2- 172.21.15.40:0/820928528 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e7c0b1af0 0x7f0e7c0bff10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:05.533 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.525+0000 7f0e8311a640 1 -- 172.21.15.40:0/820928528 >> 172.21.15.40:0/820928528 conn(0x7f0e7c06b090 msgr2=0x7f0e7c1512b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:37:05.533 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.525+0000 7f0e8311a640 1 -- 172.21.15.40:0/820928528 shutdown_connections 2024-09-13T15:37:05.533 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.525+0000 7f0e8311a640 1 -- 172.21.15.40:0/820928528 wait complete. 2024-09-13T15:37:05.547 INFO:tasks.workunit.client.1.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:37:05.547 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_4 2024-09-13T15:37:05.547 INFO:tasks.workunit.client.1.smithi040.stderr:+ ceph fs snapshot mirror add dc /mirror/ceph_repo/ceph-qa-suite_4 2024-09-13T15:37:05.668 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.661+0000 7fab0a298640 1 Processor -- start 2024-09-13T15:37:05.668 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.661+0000 7fab0a298640 1 -- start start 2024-09-13T15:37:05.670 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab0a298640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fab0406b2f0 0x7fab040ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:05.670 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab0a298640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab0406fdc0 con 0x7fab0406b6d0 2024-09-13T15:37:05.670 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab0a298640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab040c9870 con 0x7fab0406b2f0 2024-09-13T15:37:05.671 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab03fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fab0406b2f0 0x7fab040ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:05.671 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab03fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fab0406b2f0 0x7fab040ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48502/0 (socket says 172.21.15.40:48502) 2024-09-13T15:37:05.671 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab03fff640 1 -- 172.21.15.40:0/1857956511 learned_addr learned my addr 172.21.15.40:0/1857956511 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:37:05.671 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab03fff640 1 -- 172.21.15.40:0/1857956511 >> v1:172.21.15.40:6789/0 conn(0x7fab0406b6d0 legacy=0x7fab040bea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:05.671 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab02ffd640 1 -- 172.21.15.40:0/1857956511 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332891563 0 0) 0x7fab0406fdc0 con 0x7fab0406b6d0 2024-09-13T15:37:05.671 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab03fff640 1 -- 172.21.15.40:0/1857956511 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0406f920 con 0x7fab0406b2f0 2024-09-13T15:37:05.677 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab03fff640 1 --2- 172.21.15.40:0/1857956511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab0406b2f0 0x7fab040ca8b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faaf400ba90 tx=0x7faaf401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9663c626876a756 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:05.677 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab02ffd640 1 -- 172.21.15.40:0/1857956511 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaf40a7b20 con 0x7fab0406b2f0 2024-09-13T15:37:05.677 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab02ffd640 1 -- 172.21.15.40:0/1857956511 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf40a7c80 con 0x7fab0406b2f0 2024-09-13T15:37:05.677 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.665+0000 7fab02ffd640 1 -- 172.21.15.40:0/1857956511 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaf40af440 con 0x7fab0406b2f0 2024-09-13T15:37:05.677 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 -- 172.21.15.40:0/1857956511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab0406b2f0 msgr2=0x7fab040ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:05.677 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 --2- 172.21.15.40:0/1857956511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab0406b2f0 0x7fab040ca8b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faaf400ba90 tx=0x7faaf401eb60 comp rx=0 tx=0).stop 2024-09-13T15:37:05.677 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 -- 172.21.15.40:0/1857956511 shutdown_connections 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 --2- 172.21.15.40:0/1857956511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab0406b2f0 0x7fab040ca8b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 -- 172.21.15.40:0/1857956511 >> 172.21.15.40:0/1857956511 conn(0x7fab040bfa90 msgr2=0x7fab040bfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 -- 172.21.15.40:0/1857956511 shutdown_connections 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 -- 172.21.15.40:0/1857956511 wait complete. 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 Processor -- start 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 -- start start 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab0406b2f0 0x7fab0414fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab041429e0 con 0x7fab0406b2f0 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab03fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab0406b2f0 0x7fab0414fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab03fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab0406b2f0 0x7fab0414fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48508/0 (socket says 172.21.15.40:48508) 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab03fff640 1 -- 172.21.15.40:0/3880194262 learned_addr learned my addr 172.21.15.40:0/3880194262 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab03fff640 1 -- 172.21.15.40:0/3880194262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf400b770 con 0x7fab0406b2f0 2024-09-13T15:37:05.678 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab03fff640 1 --2- 172.21.15.40:0/3880194262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab0406b2f0 0x7fab0414fdd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faaf401c790 tx=0x7faaf401b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:05.679 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab00ff9640 1 -- 172.21.15.40:0/3880194262 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaf40afd70 con 0x7fab0406b2f0 2024-09-13T15:37:05.679 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab00ff9640 1 -- 172.21.15.40:0/3880194262 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf40b8400 con 0x7fab0406b2f0 2024-09-13T15:37:05.679 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 -- 172.21.15.40:0/3880194262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0414e490 con 0x7fab0406b2f0 2024-09-13T15:37:05.679 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab00ff9640 1 -- 172.21.15.40:0/3880194262 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faaf40b8590 con 0x7fab0406b2f0 2024-09-13T15:37:05.679 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 -- 172.21.15.40:0/3880194262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0414e110 con 0x7fab0406b2f0 2024-09-13T15:37:05.679 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.669+0000 7fab0a298640 1 -- 172.21.15.40:0/3880194262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab04150d30 con 0x7fab0406b2f0 2024-09-13T15:37:05.679 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.673+0000 7fab00ff9640 1 -- 172.21.15.40:0/3880194262 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 10) v1 ==== 43732+0+0 (secure 0 0 0) 0x7faaf40b6040 con 0x7fab0406b2f0 2024-09-13T15:37:05.679 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.673+0000 7fab00ff9640 1 --2- 172.21.15.40:0/3880194262 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7faaf0035920 0x7faaf0037de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:37:05.679 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.673+0000 7fab00ff9640 1 -- 172.21.15.40:0/3880194262 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5440+0+0 (secure 0 0 0) 0x7faaf40e58f0 con 0x7fab0406b2f0 2024-09-13T15:37:05.679 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.673+0000 7fab037fe640 1 --2- 172.21.15.40:0/3880194262 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7faaf0035920 0x7faaf0037de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:37:05.679 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.673+0000 7fab037fe640 1 --2- 172.21.15.40:0/3880194262 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7faaf0035920 0x7faaf0037de0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faaf8000f70 tx=0x7faaf8007930 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:37:05.680 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.677+0000 7fab00ff9640 1 -- 172.21.15.40:0/3880194262 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faaf40ad340 con 0x7fab0406b2f0 2024-09-13T15:37:05.857 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.853+0000 7fab0a298640 1 -- 172.21.15.40:0/3880194262 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "fs snapshot mirror add", "fs_name": "dc", "path": "/mirror/ceph_repo/ceph-qa-suite_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fab0414b7c0 con 0x7faaf0035920 2024-09-13T15:37:05.863 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.857+0000 7fab00ff9640 1 -- 172.21.15.40:0/3880194262 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7fab0414b7c0 con 0x7faaf0035920 2024-09-13T15:37:05.863 INFO:tasks.workunit.client.1.smithi040.stdout:{} 2024-09-13T15:37:05.865 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.861+0000 7fab0a298640 1 -- 172.21.15.40:0/3880194262 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7faaf0035920 msgr2=0x7faaf0037de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:05.865 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.861+0000 7fab0a298640 1 --2- 172.21.15.40:0/3880194262 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7faaf0035920 0x7faaf0037de0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faaf8000f70 tx=0x7faaf8007930 comp rx=0 tx=0).stop 2024-09-13T15:37:05.865 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.861+0000 7fab0a298640 1 -- 172.21.15.40:0/3880194262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab0406b2f0 msgr2=0x7fab0414fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:37:05.865 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.861+0000 7fab0a298640 1 --2- 172.21.15.40:0/3880194262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab0406b2f0 0x7fab0414fdd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7faaf401c790 tx=0x7faaf401b900 comp rx=0 tx=0).stop 2024-09-13T15:37:05.866 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.861+0000 7fab0a298640 1 -- 172.21.15.40:0/3880194262 shutdown_connections 2024-09-13T15:37:05.866 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.861+0000 7fab0a298640 1 --2- 172.21.15.40:0/3880194262 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7faaf0035920 0x7faaf0037de0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:05.866 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.861+0000 7fab0a298640 1 --2- 172.21.15.40:0/3880194262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab0406b2f0 0x7fab0414fdd0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:37:05.866 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.861+0000 7fab0a298640 1 -- 172.21.15.40:0/3880194262 >> 172.21.15.40:0/3880194262 conn(0x7fab040bfa90 msgr2=0x7fab04070870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:37:05.866 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.861+0000 7fab0a298640 1 -- 172.21.15.40:0/3880194262 shutdown_connections 2024-09-13T15:37:05.866 INFO:tasks.workunit.client.1.smithi040.stderr:2024-09-13T15:37:05.861+0000 7fab0a298640 1 -- 172.21.15.40:0/3880194262 wait complete. 2024-09-13T15:37:05.881 INFO:tasks.workunit.client.1.smithi040.stderr:+ create_snaps 2024-09-13T15:37:05.881 INFO:tasks.workunit.client.1.smithi040.stderr:++ seq 1 4 2024-09-13T15:37:05.882 INFO:tasks.workunit.client.1.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:37:05.882 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_1 2024-09-13T15:37:05.882 INFO:tasks.workunit.client.1.smithi040.stderr:++ seq 1 4 2024-09-13T15:37:05.883 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:37:05.884 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:37:05.884 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=71 2024-09-13T15:37:05.884 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:37:05.884 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_1 reset --hard HEAD~71 2024-09-13T15:37:05.884 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_1' 'reset' '--hard' 'HEAD~71') 2024-09-13T15:37:05.884 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:37:05.884 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_1 2024-09-13T15:37:05.884 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~71' 2024-09-13T15:37:05.884 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_1/.git reset --hard HEAD~71 2024-09-13T15:37:07.442 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.542080547880415) > weight (0.3333333333333333) 2024-09-13T15:37:07.442 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.6608234527435479) > weight (0.3333333333333333) 2024-09-13T15:37:07.442 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.6345499914083219) > weight (0.3333333333333333) 2024-09-13T15:37:07.442 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:37:10.988 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 28% (421/1468) Updating files: 29% (426/1468) Updating files: 30% (441/1468) Updating files: 31% (456/1468) Updating files: 32% (470/1468) Updating files: 33% (485/1468) Updating files: 34% (500/1468) Updating files: 35% (514/1468) Updating files: 36% (529/1468) Updating files: 37% (544/1468) Updating files: 38% (558/1468) Updating files: 39% (573/1468) Updating files: 40% (588/1468) Updating files: 41% (602/1468) Updating files: 42% (617/1468) Updating files: 43% (632/1468) Updating files: 44% (646/1468) Updating files: 45% (661/1468) Updating files: 46% (676/1468) Updating files: 47% (690/1468) Updating files: 48% (705/1468) Updating files: 49% (720/1468) Updating files: 49% (726/1468) Updating files: 50% (734/1468) Updating files: 51% (749/1468) Updating files: 52% (764/1468) Updating files: 53% (779/1468) Updating files: 54% (793/1468) Updating files: 55% (808/1468) Updating files: 56% (823/1468) Updating files: 57% (837/1468) Updating files: 58% (852/1468) Updating files: 59% (867/1468) Updating files: 60% (881/1468) Updating files: 61% (896/1468) Updating files: 62% (911/1468) Updating files: 63% (925/1468) Updating files: 64% (940/1468) Updating files: 65% (955/1468) Updating files: 65% (958/1468) Updating files: 66% (969/1468) Updating files: 67% (984/1468) Updating files: 68% (999/1468) Updating files: 69% (1013/1468) Updating files: 70% (1028/1468) Updating files: 71% (1043/1468) Updating files: 72% (1057/1468) Updating files: 73% (1072/1468) Updating files: 74% (1087/1468) Updating files: 75% (1101/1468) Updating files: 76% (1116/1468) Updating files: 77% (1131/1468) Updating files: 78% (1146/1468) Updating files: 79% (1160/1468) Updating files: 80% (1175/1468) Updating files: 81% (1190/1468) Updating files: 82% (1204/1468) Updating files: 82% (1208/1468) Updating files: 83% (1219/1468) Updating files: 84% (1234/1468) Updating files: 85% (1248/1468) Updating files: 86% (1263/1468) Updating files: 87% (1278/1468) Updating files: 88% (1292/1468) Updating files: 89% (1307/1468) Updating files: 90% (1322/1468) Updating files: 91% (1336/1468) Updating files: 92% (1351/1468) Updating files: 93% (1366/1468) Updating files: 94% (1380/1468) Updating files: 95% (1395/1468) Updating files: 96% (1410/1468) Updating files: 97% (1424/1468) Updating files: 98% (1439/1468) Updating files: 99% (1454/1468) Updating files: 100% (1468/1468) Updating files: 100% (1468/1468), done. 2024-09-13T15:37:11.329 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at 147f343c Merge pull request #188 from ceph/wip-multi-version 2024-09-13T15:37:11.330 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:37:11.465 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:37:11.465 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:37:11.465 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:37:11.466 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:37:11.466 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:37:11.466 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:37:11.468 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=d96e001595fadc67790d653012b2a388 2024-09-13T15:37:11.468 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_1/.snap/snap_1 cksum 2024-09-13T15:37:11.468 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:37:11.468 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:37:11.469 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_1/.snap/snap_1 -type f -exec md5sum '{}' + 2024-09-13T15:37:11.469 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:37:11.469 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:37:11.469 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:37:17.443 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:37:17.444 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:37:17.444 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:37:17.445 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:37:17.441+0000 7f97b6036640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 34633) UID: 1000 2024-09-13T15:37:19.479 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:37:19.473+0000 7f9797ffa640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) remote_file_op: failed to copy path=./.git/index: (115) Operation now in progress 2024-09-13T15:37:19.479 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:37:19.473+0000 7f9797ffa640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) do_sync_snaps: failed to synchronize dir_root=/mirror/ceph_repo/ceph-qa-suite_1, snapshot=snap_1 2024-09-13T15:37:19.479 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:37:19.473+0000 7f9797ffa640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) sync_snaps: failed to sync snapshots for dir_root=/mirror/ceph_repo/ceph-qa-suite_1 2024-09-13T15:37:28.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:37:32.445 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:37:32.445 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:37:32.445 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:37:32.445 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:37:32.445 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:37:32.448 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:37:32.448 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:37:37.245 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=96af404e74d84fbe2f30c7e32b21afda 2024-09-13T15:37:37.246 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n 96af404e74d84fbe2f30c7e32b21afda 2024-09-13T15:37:37.246 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:37:37.246 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:37:37.246 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=96 2024-09-13T15:37:37.246 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:37:37.246 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_1 reset --hard HEAD~96 2024-09-13T15:37:37.246 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_1' 'reset' '--hard' 'HEAD~96') 2024-09-13T15:37:37.246 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:37:37.246 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_1 2024-09-13T15:37:37.246 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~96' 2024-09-13T15:37:37.246 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_1/.git reset --hard HEAD~96 2024-09-13T15:37:41.324 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 18% (87/474) Updating files: 19% (91/474) Updating files: 20% (95/474) Updating files: 21% (100/474) Updating files: 22% (105/474) Updating files: 23% (110/474) Updating files: 24% (114/474) Updating files: 25% (119/474) Updating files: 26% (124/474) Updating files: 27% (128/474) Updating files: 28% (133/474) Updating files: 29% (138/474) Updating files: 30% (143/474) Updating files: 31% (147/474) Updating files: 32% (152/474) Updating files: 33% (157/474) Updating files: 34% (162/474) Updating files: 35% (166/474) Updating files: 36% (171/474) Updating files: 37% (176/474) Updating files: 38% (181/474) Updating files: 39% (185/474) Updating files: 40% (190/474) Updating files: 41% (195/474) Updating files: 42% (200/474) Updating files: 43% (204/474) Updating files: 43% (207/474) Updating files: 44% (209/474) Updating files: 45% (214/474) Updating files: 46% (219/474) Updating files: 47% (223/474) Updating files: 48% (228/474) Updating files: 49% (233/474) Updating files: 50% (237/474) Updating files: 51% (242/474) Updating files: 52% (247/474) Updating files: 53% (252/474) Updating files: 54% (256/474) Updating files: 55% (261/474) Updating files: 56% (266/474) Updating files: 57% (271/474) Updating files: 58% (275/474) Updating files: 59% (280/474) Updating files: 60% (285/474) Updating files: 61% (290/474) Updating files: 62% (294/474) Updating files: 63% (299/474) Updating files: 64% (304/474) Updating files: 65% (309/474) Updating files: 66% (313/474) Updating files: 67% (318/474) Updating files: 68% (323/474) Updating files: 69% (328/474) Updating files: 70% (332/474) Updating files: 71% (337/474) Updating files: 72% (342/474) Updating files: 73% (347/474) Updating files: 74% (351/474) Updating files: 75% (356/474) Updating files: 76% (361/474) Updating files: 77% (365/474) Updating files: 78% (370/474) Updating files: 79% (375/474) Updating files: 80% (380/474) Updating files: 81% (384/474) Updating files: 82% (389/474) Updating files: 83% (394/474) Updating files: 84% (399/474) Updating files: 85% (403/474) Updating files: 86% (408/474) Updating files: 87% (413/474) Updating files: 88% (418/474) Updating files: 89% (422/474) Updating files: 90% (427/474) Updating files: 91% (432/474) Updating files: 92% (437/474) Updating files: 92% (439/474) Updating files: 93% (441/474) Updating files: 94% (446/474) Updating files: 95% (451/474) Updating files: 96% (456/474) Updating files: 97% (460/474) Updating files: 98% (465/474) Updating files: 99% (470/474) Updating files: 100% (474/474) Updating files: 100% (474/474), done. 2024-09-13T15:37:41.517 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at 8920c4ba remove stray workload dir 2024-09-13T15:37:41.518 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:37:41.545 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:37:41.545 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:37:41.545 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:37:41.545 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:37:41.545 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:37:41.545 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:37:41.548 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=60f861d8bf2fe5b4ca2686aa4a55c969 2024-09-13T15:37:41.548 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_1/.snap/snap_2 cksum 2024-09-13T15:37:41.548 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:37:41.548 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:37:41.548 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_1/.snap/snap_2 -type f -exec md5sum '{}' + 2024-09-13T15:37:41.549 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:37:41.549 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:37:41.549 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:37:42.449 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:37:42.450 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:37:42.450 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:37:42.451 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:37:42.445+0000 7fa407484640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 35237) UID: 1000 2024-09-13T15:37:57.450 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:37:57.451 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:37:57.451 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:37:57.451 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:37:57.451 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:37:57.454 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:37:57.454 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:37:58.151 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:38:04.690 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=46aa6b2df97cd836e8cc88608992321d 2024-09-13T15:38:04.690 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n 46aa6b2df97cd836e8cc88608992321d 2024-09-13T15:38:04.690 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:38:04.690 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:38:04.690 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=65 2024-09-13T15:38:04.691 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:38:04.691 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_1 reset --hard HEAD~65 2024-09-13T15:38:04.691 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_1' 'reset' '--hard' 'HEAD~65') 2024-09-13T15:38:04.691 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:38:04.691 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_1 2024-09-13T15:38:04.691 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~65' 2024-09-13T15:38:04.691 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_1/.git reset --hard HEAD~65 2024-09-13T15:38:07.455 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.43986380996180285) > weight (0.3333333333333333) 2024-09-13T15:38:07.455 INFO:tasks.cephfs_mirror_thrash:kill client.mirror2 2024-09-13T15:38:07.456 INFO:tasks.cephfs_mirror.client.mirror2:Sent signal 15 2024-09-13T15:38:07.456 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:38:07.457 INFO:tasks.cephfs_mirror.client.mirror2.smithi040.stderr:2024-09-13T15:38:07.453+0000 7f7768720640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground (PID: 34419) UID: 1000 2024-09-13T15:38:08.849 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 28% (98/347) Updating files: 29% (101/347) Updating files: 30% (105/347) Updating files: 31% (108/347) Updating files: 32% (112/347) Updating files: 33% (115/347) Updating files: 34% (118/347) Updating files: 35% (122/347) Updating files: 36% (125/347) Updating files: 37% (129/347) Updating files: 38% (132/347) Updating files: 39% (136/347) Updating files: 40% (139/347) Updating files: 41% (143/347) Updating files: 42% (146/347) Updating files: 43% (150/347) Updating files: 44% (153/347) Updating files: 45% (157/347) Updating files: 46% (160/347) Updating files: 47% (164/347) Updating files: 48% (167/347) Updating files: 49% (171/347) Updating files: 50% (174/347) Updating files: 51% (177/347) Updating files: 52% (181/347) Updating files: 53% (184/347) Updating files: 54% (188/347) Updating files: 55% (191/347) Updating files: 56% (195/347) Updating files: 57% (198/347) Updating files: 58% (202/347) Updating files: 59% (205/347) Updating files: 60% (209/347) Updating files: 61% (212/347) Updating files: 62% (216/347) Updating files: 63% (219/347) Updating files: 63% (220/347) Updating files: 64% (223/347) Updating files: 65% (226/347) Updating files: 66% (230/347) Updating files: 67% (233/347) Updating files: 68% (236/347) Updating files: 69% (240/347) Updating files: 70% (243/347) Updating files: 71% (247/347) Updating files: 72% (250/347) Updating files: 73% (254/347) Updating files: 74% (257/347) Updating files: 75% (261/347) Updating files: 76% (264/347) Updating files: 77% (268/347) Updating files: 78% (271/347) Updating files: 79% (275/347) Updating files: 80% (278/347) Updating files: 81% (282/347) Updating files: 82% (285/347) Updating files: 83% (289/347) Updating files: 84% (292/347) Updating files: 85% (295/347) Updating files: 86% (299/347) Updating files: 87% (302/347) Updating files: 88% (306/347) Updating files: 89% (309/347) Updating files: 90% (313/347) Updating files: 91% (316/347) Updating files: 92% (320/347) Updating files: 93% (323/347) Updating files: 94% (327/347) Updating files: 95% (330/347) Updating files: 96% (334/347) Updating files: 97% (337/347) Updating files: 98% (341/347) Updating files: 99% (344/347) Updating files: 100% (347/347) Updating files: 100% (347/347), done. 2024-09-13T15:38:09.178 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at e1694b4c knfs: restructure a bit 2024-09-13T15:38:09.178 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:38:09.206 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:38:09.206 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:38:09.207 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:38:09.207 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:38:09.207 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:38:09.207 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:38:09.209 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=e9645d7fafcb6cbc659d5acd0a395859 2024-09-13T15:38:09.209 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_1/.snap/snap_3 cksum 2024-09-13T15:38:09.209 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:38:09.209 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:38:09.209 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_1/.snap/snap_3 -type f -exec md5sum '{}' + 2024-09-13T15:38:09.209 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:38:09.209 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:38:09.209 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:38:22.457 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror2 2024-09-13T15:38:22.457 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:38:22.458 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror2 2024-09-13T15:38:22.458 INFO:tasks.cephfs_mirror.client.mirror2:Restarting daemon 2024-09-13T15:38:22.458 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground 2024-09-13T15:38:22.461 INFO:tasks.cephfs_mirror.client.mirror2:Started 2024-09-13T15:38:22.461 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:38:28.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:38:30.184 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=96a3155f140bbb8b294e8cc36b62436d 2024-09-13T15:38:30.184 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n 96a3155f140bbb8b294e8cc36b62436d 2024-09-13T15:38:30.184 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:38:30.184 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:38:30.185 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=52 2024-09-13T15:38:30.185 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:38:30.185 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_1 reset --hard HEAD~52 2024-09-13T15:38:30.185 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_1' 'reset' '--hard' 'HEAD~52') 2024-09-13T15:38:30.185 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:38:30.185 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_1 2024-09-13T15:38:30.185 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~52' 2024-09-13T15:38:30.185 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_1/.git reset --hard HEAD~52 2024-09-13T15:38:32.462 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.9731508214530584) > weight (0.3333333333333333) 2024-09-13T15:38:32.462 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.6681136735656437) > weight (0.3333333333333333) 2024-09-13T15:38:32.462 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.6098599293423892) > weight (0.3333333333333333) 2024-09-13T15:38:32.462 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:38:35.213 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 25% (170/662) Updating files: 26% (173/662) Updating files: 27% (179/662) Updating files: 28% (186/662) Updating files: 29% (192/662) Updating files: 30% (199/662) Updating files: 31% (206/662) Updating files: 32% (212/662) Updating files: 33% (219/662) Updating files: 34% (226/662) Updating files: 35% (232/662) Updating files: 36% (239/662) Updating files: 37% (245/662) Updating files: 38% (252/662) Updating files: 39% (259/662) Updating files: 40% (265/662) Updating files: 41% (272/662) Updating files: 42% (279/662) Updating files: 43% (285/662) Updating files: 44% (292/662) Updating files: 45% (298/662) Updating files: 46% (305/662) Updating files: 47% (312/662) Updating files: 48% (318/662) Updating files: 49% (325/662) Updating files: 50% (331/662) Updating files: 51% (338/662) Updating files: 52% (345/662) Updating files: 53% (351/662) Updating files: 54% (358/662) Updating files: 55% (365/662) Updating files: 56% (371/662) Updating files: 57% (378/662) Updating files: 58% (384/662) Updating files: 59% (391/662) Updating files: 60% (398/662) Updating files: 60% (400/662) Updating files: 61% (404/662) Updating files: 62% (411/662) Updating files: 63% (418/662) Updating files: 64% (424/662) Updating files: 65% (431/662) Updating files: 66% (437/662) Updating files: 67% (444/662) Updating files: 68% (451/662) Updating files: 69% (457/662) Updating files: 70% (464/662) Updating files: 71% (471/662) Updating files: 72% (477/662) Updating files: 73% (484/662) Updating files: 74% (490/662) Updating files: 75% (497/662) Updating files: 76% (504/662) Updating files: 77% (510/662) Updating files: 78% (517/662) Updating files: 79% (523/662) Updating files: 80% (530/662) Updating files: 81% (537/662) Updating files: 82% (543/662) Updating files: 83% (550/662) Updating files: 84% (557/662) Updating files: 85% (563/662) Updating files: 86% (570/662) Updating files: 87% (576/662) Updating files: 88% (583/662) Updating files: 89% (590/662) Updating files: 90% (596/662) Updating files: 91% (603/662) Updating files: 92% (610/662) Updating files: 93% (616/662) Updating files: 94% (623/662) Updating files: 95% (629/662) Updating files: 96% (636/662) Updating files: 97% (643/662) Updating files: 98% (649/662) Updating files: 99% (656/662) Updating files: 100% (662/662) Updating files: 100% (662/662), done. 2024-09-13T15:38:35.396 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at b4a2a2b0 s/rgw_user_quota.pl/rgw_user_quota.yaml 2024-09-13T15:38:35.397 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:38:35.427 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:38:35.427 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:38:35.427 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:38:35.428 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:38:35.428 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:38:35.428 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:38:35.429 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=50bbdc15c793b73ca67a2f45fe1ba36a 2024-09-13T15:38:35.429 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_1/.snap/snap_4 cksum 2024-09-13T15:38:35.429 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:38:35.429 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:38:35.430 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_1/.snap/snap_4 -type f -exec md5sum '{}' + 2024-09-13T15:38:35.430 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:38:35.430 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:38:35.430 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:38:42.463 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:38:42.464 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:38:42.464 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:38:42.464 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:38:42.460+0000 7f6781224640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 35366) UID: 1000 2024-09-13T15:38:42.465 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:38:42.460+0000 7f67631e8640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) do_synchronize: failed to propagate missing dirs: (115) Operation now in progress 2024-09-13T15:38:42.465 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:38:42.460+0000 7f67631e8640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) do_sync_snaps: failed to synchronize dir_root=/mirror/ceph_repo/ceph-qa-suite_1, snapshot=snap_2 2024-09-13T15:38:42.465 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:38:42.460+0000 7f67631e8640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) sync_snaps: failed to sync snapshots for dir_root=/mirror/ceph_repo/ceph-qa-suite_1 2024-09-13T15:38:54.389 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=89249e9344c22e98e86b8d831d014ddb 2024-09-13T15:38:54.389 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n 89249e9344c22e98e86b8d831d014ddb 2024-09-13T15:38:54.389 INFO:tasks.workunit.client.1.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:38:54.389 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_2 2024-09-13T15:38:54.390 INFO:tasks.workunit.client.1.smithi040.stderr:++ seq 1 4 2024-09-13T15:38:54.391 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:38:54.391 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:38:54.391 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=90 2024-09-13T15:38:54.391 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:38:54.391 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_2 reset --hard HEAD~90 2024-09-13T15:38:54.391 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_2' 'reset' '--hard' 'HEAD~90') 2024-09-13T15:38:54.391 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:38:54.391 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_2 2024-09-13T15:38:54.391 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~90' 2024-09-13T15:38:54.392 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_2/.git reset --hard HEAD~90 2024-09-13T15:38:57.464 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:38:57.465 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:38:57.465 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:38:57.465 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:38:57.465 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:38:57.468 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:38:57.468 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:38:58.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:39:01.176 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 28% (428/1493) Updating files: 29% (433/1493) Updating files: 30% (448/1493) Updating files: 31% (463/1493) Updating files: 32% (478/1493) Updating files: 33% (493/1493) Updating files: 34% (508/1493) Updating files: 35% (523/1493) Updating files: 36% (538/1493) Updating files: 37% (553/1493) Updating files: 38% (568/1493) Updating files: 39% (583/1493) Updating files: 40% (598/1493) Updating files: 41% (613/1493) Updating files: 42% (628/1493) Updating files: 43% (642/1493) Updating files: 43% (646/1493) Updating files: 44% (657/1493) Updating files: 45% (672/1493) Updating files: 46% (687/1493) Updating files: 47% (702/1493) Updating files: 48% (717/1493) Updating files: 49% (732/1493) Updating files: 50% (747/1493) Updating files: 51% (762/1493) Updating files: 52% (777/1493) Updating files: 53% (792/1493) Updating files: 54% (807/1493) Updating files: 54% (814/1493) Updating files: 55% (822/1493) Updating files: 56% (837/1493) Updating files: 57% (852/1493) Updating files: 58% (866/1493) Updating files: 59% (881/1493) Updating files: 60% (896/1493) Updating files: 61% (911/1493) Updating files: 62% (926/1493) Updating files: 63% (941/1493) Updating files: 64% (956/1493) Updating files: 65% (971/1493) Updating files: 66% (986/1493) Updating files: 67% (1001/1493) Updating files: 68% (1016/1493) Updating files: 69% (1031/1493) Updating files: 70% (1046/1493) Updating files: 70% (1060/1493) Updating files: 71% (1061/1493) Updating files: 72% (1075/1493) Updating files: 73% (1090/1493) Updating files: 74% (1105/1493) Updating files: 75% (1120/1493) Updating files: 76% (1135/1493) Updating files: 77% (1150/1493) Updating files: 78% (1165/1493) Updating files: 79% (1180/1493) Updating files: 80% (1195/1493) Updating files: 81% (1210/1493) Updating files: 82% (1225/1493) Updating files: 83% (1240/1493) Updating files: 84% (1255/1493) Updating files: 84% (1264/1493) Updating files: 85% (1270/1493) Updating files: 86% (1284/1493) Updating files: 87% (1299/1493) Updating files: 88% (1314/1493) Updating files: 89% (1329/1493) Updating files: 90% (1344/1493) Updating files: 91% (1359/1493) Updating files: 92% (1374/1493) Updating files: 93% (1389/1493) Updating files: 94% (1404/1493) Updating files: 95% (1419/1493) Updating files: 96% (1434/1493) Updating files: 97% (1449/1493) Updating files: 98% (1464/1493) Updating files: 99% (1479/1493) Updating files: 100% (1493/1493) Updating files: 100% (1493/1493), done. 2024-09-13T15:39:01.636 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at 84a63faa Create dumpling-giant-x stress-split upgrade suite 2024-09-13T15:39:01.637 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:39:01.751 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:39:01.751 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:39:01.751 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:39:01.752 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:39:01.752 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:39:01.752 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:39:01.754 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=c524cf5cc479c4e40566f250556aa0f7 2024-09-13T15:39:01.754 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_2/.snap/snap_1 cksum 2024-09-13T15:39:01.755 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:39:01.755 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:39:01.755 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_2/.snap/snap_1 -type f -exec md5sum '{}' + 2024-09-13T15:39:01.755 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:39:01.755 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:39:01.755 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:39:07.469 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.44184094131733487) > weight (0.3333333333333333) 2024-09-13T15:39:07.469 INFO:tasks.cephfs_mirror_thrash:kill client.mirror2 2024-09-13T15:39:07.470 INFO:tasks.cephfs_mirror.client.mirror2:Sent signal 15 2024-09-13T15:39:07.470 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:39:07.471 INFO:tasks.cephfs_mirror.client.mirror2.smithi040.stderr:2024-09-13T15:39:07.464+0000 7f933b90a640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground (PID: 35497) UID: 1000 2024-09-13T15:39:17.124 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=99ed4fd6963497f2e9262bcde9a76d52 2024-09-13T15:39:17.124 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n 99ed4fd6963497f2e9262bcde9a76d52 2024-09-13T15:39:17.124 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:39:17.124 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:39:17.124 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=9 2024-09-13T15:39:17.124 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:39:17.125 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_2 reset --hard HEAD~9 2024-09-13T15:39:17.125 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_2' 'reset' '--hard' 'HEAD~9') 2024-09-13T15:39:17.125 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:39:17.125 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_2 2024-09-13T15:39:17.125 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~9' 2024-09-13T15:39:17.125 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_2/.git reset --hard HEAD~9 2024-09-13T15:39:17.657 INFO:tasks.cephfs_mirror.client.mirror3.smithi040.stderr:2024-09-13T15:39:17.652+0000 7fdeb1086640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) unlock_directory: failed to unlock remote dir_root=/mirror/ceph_repo/ceph-qa-suite_4: (9) Bad file descriptor 2024-09-13T15:39:18.898 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at 5864369a Merge pull request #118 from dachary/wip-more-osds 2024-09-13T15:39:18.899 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:39:18.932 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:39:18.932 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:39:18.932 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:39:18.933 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:39:18.933 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:39:18.933 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:39:18.935 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=e11652dd527663b91a3979316e87da38 2024-09-13T15:39:18.935 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_2/.snap/snap_2 cksum 2024-09-13T15:39:18.935 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:39:18.935 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:39:18.935 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_2/.snap/snap_2 -type f -exec md5sum '{}' + 2024-09-13T15:39:18.935 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:39:18.936 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:39:18.936 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:39:22.470 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror2 2024-09-13T15:39:22.471 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:39:22.471 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror2 2024-09-13T15:39:22.471 INFO:tasks.cephfs_mirror.client.mirror2:Restarting daemon 2024-09-13T15:39:22.471 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground 2024-09-13T15:39:22.474 INFO:tasks.cephfs_mirror.client.mirror2:Started 2024-09-13T15:39:22.474 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:39:28.350 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:39:32.475 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:39:32.475 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:39:32.476 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:39:32.476 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:39:32.472+0000 7fdf840bf640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 35644) UID: 1000 2024-09-13T15:39:32.477 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:39:32.472+0000 7fdf66083640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) do_sync_snaps: failed to synchronize dir_root=/mirror/ceph_repo/ceph-qa-suite_1, snapshot=snap_3 2024-09-13T15:39:32.477 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:39:32.472+0000 7fdf66083640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) sync_snaps: failed to sync snapshots for dir_root=/mirror/ceph_repo/ceph-qa-suite_1 2024-09-13T15:39:35.826 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=8da4739a394a4ffc6a32e632d80d481c 2024-09-13T15:39:35.826 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n 8da4739a394a4ffc6a32e632d80d481c 2024-09-13T15:39:35.826 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:39:35.826 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:39:35.826 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=58 2024-09-13T15:39:35.826 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:39:35.826 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_2 reset --hard HEAD~58 2024-09-13T15:39:35.826 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_2' 'reset' '--hard' 'HEAD~58') 2024-09-13T15:39:35.826 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:39:35.827 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_2 2024-09-13T15:39:35.827 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~58' 2024-09-13T15:39:35.827 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_2/.git reset --hard HEAD~58 2024-09-13T15:39:37.914 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 77% (219/282) Updating files: 78% (220/282) Updating files: 79% (223/282) Updating files: 80% (226/282) Updating files: 81% (229/282) Updating files: 82% (232/282) Updating files: 83% (235/282) Updating files: 84% (237/282) Updating files: 85% (240/282) Updating files: 86% (243/282) Updating files: 87% (246/282) Updating files: 88% (249/282) Updating files: 89% (251/282) Updating files: 90% (254/282) Updating files: 91% (257/282) Updating files: 92% (260/282) Updating files: 93% (263/282) Updating files: 94% (266/282) Updating files: 95% (268/282) Updating files: 96% (271/282) Updating files: 97% (274/282) Updating files: 98% (277/282) Updating files: 99% (280/282) Updating files: 100% (282/282) Updating files: 100% (282/282), done. 2024-09-13T15:39:38.024 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at 5f452829 Merge pull request #64 from ceph/wip_dumpling-firefly-x_upgrade_suite 2024-09-13T15:39:38.024 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:39:38.069 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:39:38.070 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:39:38.070 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:39:38.070 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:39:38.070 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:39:38.070 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:39:38.071 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=3d17b914142381451cdd0b7235b5a02e 2024-09-13T15:39:38.071 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_2/.snap/snap_3 cksum 2024-09-13T15:39:38.072 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:39:38.072 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:39:38.072 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_2/.snap/snap_3 -type f -exec md5sum '{}' + 2024-09-13T15:39:38.072 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:39:38.073 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:39:38.073 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:39:47.476 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:39:47.477 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:39:47.477 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:39:47.477 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:39:47.477 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:39:47.479 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:39:47.479 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:39:50.530 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=b0d2df37a009577e7edcfd3ce9e9f60d 2024-09-13T15:39:50.530 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n b0d2df37a009577e7edcfd3ce9e9f60d 2024-09-13T15:39:50.530 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:39:50.530 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:39:50.530 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=95 2024-09-13T15:39:50.530 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:39:50.530 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_2 reset --hard HEAD~95 2024-09-13T15:39:50.530 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_2' 'reset' '--hard' 'HEAD~95') 2024-09-13T15:39:50.531 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:39:50.531 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_2 2024-09-13T15:39:50.531 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~95' 2024-09-13T15:39:50.531 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_2/.git reset --hard HEAD~95 2024-09-13T15:39:53.967 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 43% (193/445) Updating files: 44% (196/445) Updating files: 45% (201/445) Updating files: 46% (205/445) Updating files: 47% (210/445) Updating files: 48% (214/445) Updating files: 49% (219/445) Updating files: 50% (223/445) Updating files: 51% (227/445) Updating files: 52% (232/445) Updating files: 53% (236/445) Updating files: 54% (241/445) Updating files: 55% (245/445) Updating files: 56% (250/445) Updating files: 57% (254/445) Updating files: 58% (259/445) Updating files: 59% (263/445) Updating files: 60% (267/445) Updating files: 61% (272/445) Updating files: 62% (276/445) Updating files: 63% (281/445) Updating files: 64% (285/445) Updating files: 65% (290/445) Updating files: 66% (294/445) Updating files: 67% (299/445) Updating files: 68% (303/445) Updating files: 69% (308/445) Updating files: 70% (312/445) Updating files: 71% (316/445) Updating files: 72% (321/445) Updating files: 73% (325/445) Updating files: 74% (330/445) Updating files: 75% (334/445) Updating files: 76% (339/445) Updating files: 77% (343/445) Updating files: 78% (348/445) Updating files: 79% (352/445) Updating files: 80% (356/445) Updating files: 81% (361/445) Updating files: 81% (364/445) Updating files: 82% (365/445) Updating files: 83% (370/445) Updating files: 84% (374/445) Updating files: 85% (379/445) Updating files: 86% (383/445) Updating files: 87% (388/445) Updating files: 88% (392/445) Updating files: 89% (397/445) Updating files: 90% (401/445) Updating files: 91% (405/445) Updating files: 92% (410/445) Updating files: 93% (414/445) Updating files: 94% (419/445) Updating files: 95% (423/445) Updating files: 96% (428/445) Updating files: 97% (432/445) Updating files: 98% (437/445) Updating files: 99% (441/445) Updating files: 100% (445/445) Updating files: 100% (445/445), done. 2024-09-13T15:39:54.292 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at bda2fd3d upgrade: fix typo in subsection name 2024-09-13T15:39:54.292 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:39:54.317 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:39:54.317 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:39:54.317 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:39:54.318 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:39:54.318 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:39:54.318 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:39:54.319 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=4b28b013e9076873b5ef626f8ffba7d8 2024-09-13T15:39:54.319 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_2/.snap/snap_4 cksum 2024-09-13T15:39:54.319 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:39:54.319 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:39:54.320 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_2/.snap/snap_4 -type f -exec md5sum '{}' + 2024-09-13T15:39:54.320 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:39:54.320 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:39:54.320 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:39:57.480 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.7664939790566485) > weight (0.3333333333333333) 2024-09-13T15:39:57.481 INFO:tasks.cephfs_mirror_thrash:kill client.mirror2 2024-09-13T15:39:57.481 INFO:tasks.cephfs_mirror.client.mirror2:Sent signal 15 2024-09-13T15:39:57.481 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:39:57.482 INFO:tasks.cephfs_mirror.client.mirror2.smithi040.stderr:2024-09-13T15:39:57.476+0000 7fe86f7d8640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground (PID: 35784) UID: 1000 2024-09-13T15:39:58.901 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:40:06.071 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=23df78d79e77eb4c8753999fba25957b 2024-09-13T15:40:06.071 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n 23df78d79e77eb4c8753999fba25957b 2024-09-13T15:40:06.071 INFO:tasks.workunit.client.1.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:40:06.071 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_3 2024-09-13T15:40:06.071 INFO:tasks.workunit.client.1.smithi040.stderr:++ seq 1 4 2024-09-13T15:40:06.071 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:40:06.072 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:40:06.072 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=73 2024-09-13T15:40:06.072 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:40:06.072 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_3 reset --hard HEAD~73 2024-09-13T15:40:06.072 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_3' 'reset' '--hard' 'HEAD~73') 2024-09-13T15:40:06.072 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:40:06.072 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_3 2024-09-13T15:40:06.072 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~73' 2024-09-13T15:40:06.072 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_3/.git reset --hard HEAD~73 2024-09-13T15:40:12.482 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror2 2024-09-13T15:40:12.482 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:40:12.483 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror2 2024-09-13T15:40:12.483 INFO:tasks.cephfs_mirror.client.mirror2:Restarting daemon 2024-09-13T15:40:12.483 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground 2024-09-13T15:40:12.485 INFO:tasks.cephfs_mirror.client.mirror2:Started 2024-09-13T15:40:12.485 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:40:15.120 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 22% (333/1470) Updating files: 23% (339/1470) Updating files: 24% (353/1470) Updating files: 25% (368/1470) Updating files: 26% (383/1470) Updating files: 27% (397/1470) Updating files: 28% (412/1470) Updating files: 29% (427/1470) Updating files: 30% (441/1470) Updating files: 31% (456/1470) Updating files: 32% (471/1470) Updating files: 33% (486/1470) Updating files: 34% (500/1470) Updating files: 35% (515/1470) Updating files: 35% (529/1470) Updating files: 36% (530/1470) Updating files: 37% (544/1470) Updating files: 38% (559/1470) Updating files: 39% (574/1470) Updating files: 40% (588/1470) Updating files: 41% (603/1470) Updating files: 42% (618/1470) Updating files: 43% (633/1470) Updating files: 44% (647/1470) Updating files: 45% (662/1470) Updating files: 46% (677/1470) Updating files: 47% (691/1470) Updating files: 47% (704/1470) Updating files: 48% (706/1470) Updating files: 49% (721/1470) Updating files: 50% (735/1470) Updating files: 51% (750/1470) Updating files: 52% (765/1470) Updating files: 53% (780/1470) Updating files: 54% (794/1470) Updating files: 55% (809/1470) Updating files: 56% (824/1470) Updating files: 57% (838/1470) Updating files: 58% (853/1470) Updating files: 59% (868/1470) Updating files: 59% (880/1470) Updating files: 60% (882/1470) Updating files: 61% (897/1470) Updating files: 62% (912/1470) Updating files: 63% (927/1470) Updating files: 64% (941/1470) Updating files: 65% (956/1470) Updating files: 66% (971/1470) Updating files: 67% (985/1470) Updating files: 68% (1000/1470) Updating files: 69% (1015/1470) Updating files: 70% (1029/1470) Updating files: 70% (1037/1470) Updating files: 71% (1044/1470) Updating files: 72% (1059/1470) Updating files: 73% (1074/1470) Updating files: 74% (1088/1470) Updating files: 75% (1103/1470) Updating files: 76% (1118/1470) Updating files: 77% (1132/1470) Updating files: 78% (1147/1470) Updating files: 79% (1162/1470) Updating files: 80% (1176/1470) Updating files: 80% (1178/1470) Updating files: 81% (1191/1470) Updating files: 82% (1206/1470) Updating files: 83% (1221/1470) Updating files: 84% (1235/1470) Updating files: 85% (1250/1470) Updating files: 86% (1265/1470) Updating files: 87% (1279/1470) Updating files: 88% (1294/1470) Updating files: 89% (1309/1470) Updating files: 89% (1318/1470) Updating files: 90% (1323/1470) Updating files: 91% (1338/1470) Updating files: 92% (1353/1470) Updating files: 93% (1368/1470) Updating files: 94% (1382/1470) Updating files: 94% (1386/1470) Updating files: 95% (1397/1470) Updating files: 96% (1412/1470) Updating files: 97% (1426/1470) Updating files: 98% (1441/1470) Updating files: 99% (1456/1470) Updating files: 100% (1470/1470) Updating files: 100% (1470/1470), done. 2024-09-13T15:40:15.436 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at 78da2dc0 Merge pull request #177 from ceph/wip_9691 2024-09-13T15:40:15.437 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:40:15.551 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:40:15.552 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:40:15.552 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:40:15.552 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:40:15.552 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:40:15.553 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:40:15.555 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=fca2516c8f0507d23bb18b097445be80 2024-09-13T15:40:15.555 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_3/.snap/snap_1 cksum 2024-09-13T15:40:15.555 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:40:15.555 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:40:15.556 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_3/.snap/snap_1 -type f -exec md5sum '{}' + 2024-09-13T15:40:15.556 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:40:15.556 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:40:15.556 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:40:22.486 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:40:22.486 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:40:22.487 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:40:22.487 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:40:22.487+0000 7f8b35cb0640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 35916) UID: 1000 2024-09-13T15:40:22.488 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:40:22.487+0000 7f8b17c74640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) do_synchronize: failed to propagate missing dirs: (115) Operation now in progress 2024-09-13T15:40:22.488 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:40:22.487+0000 7f8b17c74640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) do_sync_snaps: failed to synchronize dir_root=/mirror/ceph_repo/ceph-qa-suite_1, snapshot=snap_4 2024-09-13T15:40:22.488 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:40:22.487+0000 7f8b17c74640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) sync_snaps: failed to sync snapshots for dir_root=/mirror/ceph_repo/ceph-qa-suite_1 2024-09-13T15:40:28.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:40:37.487 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:40:37.488 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:40:37.488 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:40:37.488 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:40:37.488 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:40:37.491 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:40:37.491 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:40:39.074 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=5f4816837a5020e931ea1c4d2b06a051 2024-09-13T15:40:39.074 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n 5f4816837a5020e931ea1c4d2b06a051 2024-09-13T15:40:39.074 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:40:39.074 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:40:39.074 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=13 2024-09-13T15:40:39.074 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:40:39.074 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_3 reset --hard HEAD~13 2024-09-13T15:40:39.074 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_3' 'reset' '--hard' 'HEAD~13') 2024-09-13T15:40:39.074 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:40:39.075 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_3 2024-09-13T15:40:39.075 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~13' 2024-09-13T15:40:39.075 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_3/.git reset --hard HEAD~13 2024-09-13T15:40:41.049 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at ec4291f8 Merge pull request #146 from dachary/wip-9298-rgw-ec-starvation-giant 2024-09-13T15:40:41.050 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:40:41.085 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:40:41.085 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:40:41.085 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:40:41.085 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:40:41.085 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:40:41.085 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:40:41.087 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=7685357004d198934dfa68b5a214fb2a 2024-09-13T15:40:41.087 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_3/.snap/snap_2 cksum 2024-09-13T15:40:41.087 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:40:41.087 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:40:41.087 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_3/.snap/snap_2 -type f -exec md5sum '{}' + 2024-09-13T15:40:41.087 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:40:41.087 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:40:41.087 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:40:47.492 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.7241666339420589) > weight (0.3333333333333333) 2024-09-13T15:40:47.492 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.4115233314873884) > weight (0.3333333333333333) 2024-09-13T15:40:47.492 INFO:tasks.cephfs_mirror_thrash:kill client.mirror3 2024-09-13T15:40:47.493 INFO:tasks.cephfs_mirror.client.mirror3:Sent signal 15 2024-09-13T15:40:47.493 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:40:47.494 INFO:tasks.cephfs_mirror.client.mirror3.smithi040.stderr:2024-09-13T15:40:47.491+0000 7fdecf0c2640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground (PID: 33781) UID: 1000 2024-09-13T15:40:54.619 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=fcc22cc3ce574f239413e91058dfc806 2024-09-13T15:40:54.619 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n fcc22cc3ce574f239413e91058dfc806 2024-09-13T15:40:54.620 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:40:54.620 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:40:54.620 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=71 2024-09-13T15:40:54.620 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:40:54.620 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_3 reset --hard HEAD~71 2024-09-13T15:40:54.620 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_3' 'reset' '--hard' 'HEAD~71') 2024-09-13T15:40:54.620 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:40:54.620 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_3 2024-09-13T15:40:54.620 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~71' 2024-09-13T15:40:54.620 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_3/.git reset --hard HEAD~71 2024-09-13T15:40:57.095 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 65% (220/337) Updating files: 66% (223/337) Updating files: 67% (226/337) Updating files: 68% (230/337) Updating files: 69% (233/337) Updating files: 70% (236/337) Updating files: 71% (240/337) Updating files: 72% (243/337) Updating files: 73% (247/337) Updating files: 74% (250/337) Updating files: 75% (253/337) Updating files: 76% (257/337) Updating files: 77% (260/337) Updating files: 78% (263/337) Updating files: 79% (267/337) Updating files: 80% (270/337) Updating files: 81% (273/337) Updating files: 82% (277/337) Updating files: 83% (280/337) Updating files: 84% (284/337) Updating files: 85% (287/337) Updating files: 86% (290/337) Updating files: 87% (294/337) Updating files: 88% (297/337) Updating files: 89% (300/337) Updating files: 90% (304/337) Updating files: 91% (307/337) Updating files: 92% (311/337) Updating files: 93% (314/337) Updating files: 94% (317/337) Updating files: 95% (321/337) Updating files: 96% (324/337) Updating files: 97% (327/337) Updating files: 98% (331/337) Updating files: 99% (334/337) Updating files: 100% (337/337) Updating files: 100% (337/337), done. 2024-09-13T15:40:57.352 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at 5f452829 Merge pull request #64 from ceph/wip_dumpling-firefly-x_upgrade_suite 2024-09-13T15:40:57.352 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:40:57.385 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:40:57.385 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:40:57.385 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:40:57.386 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:40:57.386 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:40:57.386 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:40:57.388 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=5f0e6f1ab4f0b84a8a31feaf9233254d 2024-09-13T15:40:57.388 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_3/.snap/snap_3 cksum 2024-09-13T15:40:57.388 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:40:57.388 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:40:57.389 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_3/.snap/snap_3 -type f -exec md5sum '{}' + 2024-09-13T15:40:57.389 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:40:57.389 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:40:57.389 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:40:59.392 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:41:02.494 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror3 2024-09-13T15:41:02.494 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:41:02.495 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror3 2024-09-13T15:41:02.495 INFO:tasks.cephfs_mirror.client.mirror3:Restarting daemon 2024-09-13T15:41:02.495 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground 2024-09-13T15:41:02.498 INFO:tasks.cephfs_mirror.client.mirror3:Started 2024-09-13T15:41:02.498 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:41:10.727 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=b8a2ee7d01f6db35f96acb36eaf07a78 2024-09-13T15:41:10.727 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n b8a2ee7d01f6db35f96acb36eaf07a78 2024-09-13T15:41:10.727 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:41:10.727 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:41:10.727 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=32 2024-09-13T15:41:10.727 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:41:10.727 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_3 reset --hard HEAD~32 2024-09-13T15:41:10.727 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_3' 'reset' '--hard' 'HEAD~32') 2024-09-13T15:41:10.728 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:41:10.728 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_3 2024-09-13T15:41:10.728 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~32' 2024-09-13T15:41:10.728 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_3/.git reset --hard HEAD~32 2024-09-13T15:41:12.499 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.8862963713415475) > weight (0.3333333333333333) 2024-09-13T15:41:12.499 INFO:tasks.cephfs_mirror_thrash:kill client.mirror2 2024-09-13T15:41:12.499 INFO:tasks.cephfs_mirror.client.mirror2:Sent signal 15 2024-09-13T15:41:12.500 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:41:12.500 INFO:tasks.cephfs_mirror.client.mirror2.smithi040.stderr:2024-09-13T15:41:12.499+0000 7f707728d640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground (PID: 36050) UID: 1000 2024-09-13T15:41:12.504 INFO:tasks.cephfs_mirror.client.mirror2.smithi040.stderr:2024-09-13T15:41:12.503+0000 7f705824f640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) do_sync_snaps: failed to synchronize dir_root=/mirror/ceph_repo/ceph-qa-suite_3, snapshot=snap_3 2024-09-13T15:41:12.504 INFO:tasks.cephfs_mirror.client.mirror2.smithi040.stderr:2024-09-13T15:41:12.503+0000 7f705824f640 -1 cephfs::mirror::PeerReplayer(9c8da8d1-f266-49c4-b1e7-d45faa2cb9b2) sync_snaps: failed to sync snapshots for dir_root=/mirror/ceph_repo/ceph-qa-suite_3 2024-09-13T15:41:12.668 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 83% (172/206) Updating files: 84% (174/206) Updating files: 85% (176/206) Updating files: 86% (178/206) Updating files: 87% (180/206) Updating files: 88% (182/206) Updating files: 89% (184/206) Updating files: 90% (186/206) Updating files: 91% (188/206) Updating files: 92% (190/206) Updating files: 93% (192/206) Updating files: 94% (194/206) Updating files: 95% (196/206) Updating files: 96% (198/206) Updating files: 97% (200/206) Updating files: 98% (202/206) Updating files: 99% (204/206) Updating files: 100% (206/206) Updating files: 100% (206/206), done. 2024-09-13T15:41:12.887 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at adf2ec43 Merge pull request #30 from ceph/wip-8263 2024-09-13T15:41:12.887 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:41:12.924 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:41:12.924 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:41:12.924 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:41:12.924 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:41:12.925 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:41:12.925 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:41:12.927 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=a4a1c36b9f53d18d85119930c5d402d2 2024-09-13T15:41:12.927 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_3/.snap/snap_4 cksum 2024-09-13T15:41:12.927 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:41:12.927 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:41:12.927 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_3/.snap/snap_4 -type f -exec md5sum '{}' + 2024-09-13T15:41:12.927 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:41:12.927 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:41:12.927 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:41:27.500 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror2 2024-09-13T15:41:27.501 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:41:27.501 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror2 2024-09-13T15:41:27.501 INFO:tasks.cephfs_mirror.client.mirror2:Restarting daemon 2024-09-13T15:41:27.501 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground 2024-09-13T15:41:27.505 INFO:tasks.cephfs_mirror.client.mirror2:Started 2024-09-13T15:41:27.505 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:41:29.431 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:41:35.251 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=30cdedad0495361becb9de69d0f2902f 2024-09-13T15:41:35.251 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n 30cdedad0495361becb9de69d0f2902f 2024-09-13T15:41:35.251 INFO:tasks.workunit.client.1.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:41:35.251 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_4 2024-09-13T15:41:35.251 INFO:tasks.workunit.client.1.smithi040.stderr:++ seq 1 4 2024-09-13T15:41:35.252 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:41:35.252 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:41:35.252 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=97 2024-09-13T15:41:35.252 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:41:35.252 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_4 reset --hard HEAD~97 2024-09-13T15:41:35.253 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_4' 'reset' '--hard' 'HEAD~97') 2024-09-13T15:41:35.253 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:41:35.253 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_4 2024-09-13T15:41:35.253 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~97' 2024-09-13T15:41:35.253 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_4/.git reset --hard HEAD~97 2024-09-13T15:41:37.506 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.8884039177795301) > weight (0.3333333333333333) 2024-09-13T15:41:37.507 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.33351339259098245) > weight (0.3333333333333333) 2024-09-13T15:41:37.507 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.9366370517646426) > weight (0.3333333333333333) 2024-09-13T15:41:37.507 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:41:43.113 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 26% (392/1493) Updating files: 27% (404/1493) Updating files: 28% (419/1493) Updating files: 29% (433/1493) Updating files: 30% (448/1493) Updating files: 31% (463/1493) Updating files: 32% (478/1493) Updating files: 33% (493/1493) Updating files: 34% (508/1493) Updating files: 35% (523/1493) Updating files: 36% (538/1493) Updating files: 37% (553/1493) Updating files: 37% (559/1493) Updating files: 38% (568/1493) Updating files: 39% (583/1493) Updating files: 40% (598/1493) Updating files: 41% (613/1493) Updating files: 42% (628/1493) Updating files: 43% (642/1493) Updating files: 44% (657/1493) Updating files: 45% (672/1493) Updating files: 46% (687/1493) Updating files: 47% (702/1493) Updating files: 48% (717/1493) Updating files: 49% (732/1493) Updating files: 50% (747/1493) Updating files: 51% (762/1493) Updating files: 51% (764/1493) Updating files: 52% (777/1493) Updating files: 53% (792/1493) Updating files: 54% (807/1493) Updating files: 55% (822/1493) Updating files: 56% (837/1493) Updating files: 57% (852/1493) Updating files: 58% (866/1493) Updating files: 59% (881/1493) Updating files: 60% (896/1493) Updating files: 61% (911/1493) Updating files: 62% (926/1493) Updating files: 63% (941/1493) Updating files: 64% (956/1493) Updating files: 65% (971/1493) Updating files: 65% (977/1493) Updating files: 66% (986/1493) Updating files: 67% (1001/1493) Updating files: 68% (1016/1493) Updating files: 69% (1031/1493) Updating files: 70% (1046/1493) Updating files: 71% (1061/1493) Updating files: 72% (1075/1493) Updating files: 73% (1090/1493) Updating files: 74% (1105/1493) Updating files: 75% (1120/1493) Updating files: 76% (1135/1493) Updating files: 77% (1150/1493) Updating files: 78% (1165/1493) Updating files: 79% (1180/1493) Updating files: 80% (1195/1493) Updating files: 81% (1210/1493) Updating files: 81% (1211/1493) Updating files: 82% (1225/1493) Updating files: 83% (1240/1493) Updating files: 84% (1255/1493) Updating files: 85% (1270/1493) Updating files: 86% (1284/1493) Updating files: 87% (1299/1493) Updating files: 88% (1314/1493) Updating files: 89% (1329/1493) Updating files: 90% (1344/1493) Updating files: 91% (1359/1493) Updating files: 91% (1365/1493) Updating files: 92% (1374/1493) Updating files: 93% (1389/1493) Updating files: 94% (1404/1493) Updating files: 95% (1419/1493) Updating files: 96% (1434/1493) Updating files: 97% (1449/1493) Updating files: 98% (1464/1493) Updating files: 99% (1479/1493) Updating files: 100% (1493/1493) Updating files: 100% (1493/1493), done. 2024-09-13T15:41:43.525 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at b1365a80 Merge pull request #140 from ceph/wip-9177 2024-09-13T15:41:43.525 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:41:43.714 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:41:43.715 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:41:43.715 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:41:43.715 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:41:43.715 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:41:43.715 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:41:43.717 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=99efa01e0c3ea92844b3543ae4334258 2024-09-13T15:41:43.718 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_4/.snap/snap_1 cksum 2024-09-13T15:41:43.718 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:41:43.718 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:41:43.718 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_4/.snap/snap_1 -type f -exec md5sum '{}' + 2024-09-13T15:41:43.718 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:41:43.719 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:41:43.719 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:41:47.508 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:41:47.508 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:41:47.509 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:41:47.509 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:41:47.507+0000 7f90f4cd1640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 36178) UID: 1000 2024-09-13T15:41:59.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:42:02.510 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:42:02.510 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:42:02.510 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:42:02.511 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:42:02.511 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:42:02.514 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:42:02.514 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:42:10.645 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=c4eb55752f20f5a44c42d69f3f7835c8 2024-09-13T15:42:10.645 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n c4eb55752f20f5a44c42d69f3f7835c8 2024-09-13T15:42:10.645 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:42:10.645 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:42:10.646 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=17 2024-09-13T15:42:10.646 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:42:10.646 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_4 reset --hard HEAD~17 2024-09-13T15:42:10.646 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_4' 'reset' '--hard' 'HEAD~17') 2024-09-13T15:42:10.646 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:42:10.646 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_4 2024-09-13T15:42:10.646 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~17' 2024-09-13T15:42:10.646 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_4/.git reset --hard HEAD~17 2024-09-13T15:42:12.126 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at 4f8436bf Merge pull request #106 from ceph/wip-9091-wusui 2024-09-13T15:42:12.126 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:42:12.151 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:42:12.151 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:42:12.152 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:42:12.152 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:42:12.152 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:42:12.152 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:42:12.153 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=7d4bec9eceadf626bdfb7360c9ab76cf 2024-09-13T15:42:12.153 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_4/.snap/snap_2 cksum 2024-09-13T15:42:12.153 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:42:12.154 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:42:12.154 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_4/.snap/snap_2 -type f -exec md5sum '{}' + 2024-09-13T15:42:12.154 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:42:12.154 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:42:12.154 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:42:12.516 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.7032176305702067) > weight (0.3333333333333333) 2024-09-13T15:42:12.516 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.6804105774547935) > weight (0.3333333333333333) 2024-09-13T15:42:12.516 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.6000727747212963) > weight (0.3333333333333333) 2024-09-13T15:42:12.516 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:42:22.517 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:42:22.518 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:42:22.518 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:42:22.519 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:42:22.518+0000 7f233565b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 36596) UID: 1000 2024-09-13T15:42:29.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:42:34.915 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=4c84bf6097f8a4cf83289a5cebbaae9a 2024-09-13T15:42:34.915 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n 4c84bf6097f8a4cf83289a5cebbaae9a 2024-09-13T15:42:34.916 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:42:34.916 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:42:34.916 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=87 2024-09-13T15:42:34.916 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:42:34.916 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_4 reset --hard HEAD~87 2024-09-13T15:42:34.916 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_4' 'reset' '--hard' 'HEAD~87') 2024-09-13T15:42:34.916 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:42:34.916 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_4 2024-09-13T15:42:34.916 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~87' 2024-09-13T15:42:34.917 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_4/.git reset --hard HEAD~87 2024-09-13T15:42:37.518 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:42:37.519 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:42:37.519 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:42:37.519 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:42:37.519 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:42:37.521 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:42:37.522 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:42:38.140 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 46% (205/440) Updating files: 47% (207/440) Updating files: 48% (212/440) Updating files: 49% (216/440) Updating files: 50% (220/440) Updating files: 51% (225/440) Updating files: 52% (229/440) Updating files: 53% (234/440) Updating files: 54% (238/440) Updating files: 55% (242/440) Updating files: 56% (247/440) Updating files: 57% (251/440) Updating files: 58% (256/440) Updating files: 59% (260/440) Updating files: 60% (264/440) Updating files: 61% (269/440) Updating files: 62% (273/440) Updating files: 63% (278/440) Updating files: 64% (282/440) Updating files: 65% (286/440) Updating files: 66% (291/440) Updating files: 67% (295/440) Updating files: 68% (300/440) Updating files: 69% (304/440) Updating files: 70% (308/440) Updating files: 71% (313/440) Updating files: 72% (317/440) Updating files: 73% (322/440) Updating files: 74% (326/440) Updating files: 75% (330/440) Updating files: 76% (335/440) Updating files: 77% (339/440) Updating files: 78% (344/440) Updating files: 79% (348/440) Updating files: 80% (352/440) Updating files: 81% (357/440) Updating files: 82% (361/440) Updating files: 82% (363/440) Updating files: 83% (366/440) Updating files: 84% (370/440) Updating files: 85% (374/440) Updating files: 86% (379/440) Updating files: 87% (383/440) Updating files: 88% (388/440) Updating files: 89% (392/440) Updating files: 90% (396/440) Updating files: 91% (401/440) Updating files: 92% (405/440) Updating files: 93% (410/440) Updating files: 94% (414/440) Updating files: 95% (418/440) Updating files: 96% (423/440) Updating files: 97% (427/440) Updating files: 98% (432/440) Updating files: 99% (436/440) Updating files: 100% (440/440) Updating files: 100% (440/440), done. 2024-09-13T15:42:38.441 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at 9fa5c5fa big: test xfs + btrfs 2024-09-13T15:42:38.441 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:42:38.473 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:42:38.473 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:42:38.473 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:42:38.474 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:42:38.474 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:42:38.474 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:42:38.475 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=78fe15d313415acff3b4ab8491a32d57 2024-09-13T15:42:38.475 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_4/.snap/snap_3 cksum 2024-09-13T15:42:38.475 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:42:38.475 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:42:38.476 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_4/.snap/snap_3 -type f -exec md5sum '{}' + 2024-09-13T15:42:38.476 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:42:38.476 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:42:38.476 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:42:47.522 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:42:47.523 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:42:47.523 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:42:47.524 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:42:47.522+0000 7fe988f94640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 36738) UID: 1000 2024-09-13T15:42:59.553 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:42:59.865 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=2f928422514804cfae01b5bc763cf4b6 2024-09-13T15:42:59.865 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n 2f928422514804cfae01b5bc763cf4b6 2024-09-13T15:42:59.865 INFO:tasks.workunit.client.1.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:42:59.865 INFO:tasks.workunit.client.1.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:42:59.865 INFO:tasks.workunit.client.1.smithi040.stderr:+ r=68 2024-09-13T15:42:59.865 INFO:tasks.workunit.client.1.smithi040.stderr:+ arr=($repo_name "reset" "--hard" "HEAD~$r") 2024-09-13T15:42:59.866 INFO:tasks.workunit.client.1.smithi040.stderr:+ exec_git_cmd ceph_repo/ceph-qa-suite_4 reset --hard HEAD~68 2024-09-13T15:42:59.866 INFO:tasks.workunit.client.1.smithi040.stderr:+ arg=('ceph_repo/ceph-qa-suite_4' 'reset' '--hard' 'HEAD~68') 2024-09-13T15:42:59.866 INFO:tasks.workunit.client.1.smithi040.stderr:+ local arg 2024-09-13T15:42:59.866 INFO:tasks.workunit.client.1.smithi040.stderr:+ local repo_name=ceph_repo/ceph-qa-suite_4 2024-09-13T15:42:59.866 INFO:tasks.workunit.client.1.smithi040.stderr:+ local 'cmd=reset --hard HEAD~68' 2024-09-13T15:42:59.866 INFO:tasks.workunit.client.1.smithi040.stderr:+ git --git-dir ceph_repo/ceph-qa-suite_4/.git reset --hard HEAD~68 2024-09-13T15:43:02.090 INFO:tasks.workunit.client.1.smithi040.stderr:Updating files: 67% (180/266) Updating files: 68% (181/266) Updating files: 69% (184/266) Updating files: 70% (187/266) Updating files: 71% (189/266) Updating files: 72% (192/266) Updating files: 73% (195/266) Updating files: 74% (197/266) Updating files: 75% (200/266) Updating files: 76% (203/266) Updating files: 77% (205/266) Updating files: 78% (208/266) Updating files: 79% (211/266) Updating files: 80% (213/266) Updating files: 81% (216/266) Updating files: 82% (219/266) Updating files: 83% (221/266) Updating files: 84% (224/266) Updating files: 85% (227/266) Updating files: 86% (229/266) Updating files: 87% (232/266) Updating files: 88% (235/266) Updating files: 89% (237/266) Updating files: 90% (240/266) Updating files: 91% (243/266) Updating files: 92% (245/266) Updating files: 93% (248/266) Updating files: 94% (251/266) Updating files: 95% (253/266) Updating files: 96% (256/266) Updating files: 97% (259/266) Updating files: 98% (261/266) Updating files: 99% (264/266) Updating files: 100% (266/266) Updating files: 100% (266/266), done. 2024-09-13T15:43:02.315 INFO:tasks.workunit.client.1.smithi040.stdout:HEAD is now at d741cd99 Add missing fedora yamls. 2024-09-13T15:43:02.315 INFO:tasks.workunit.client.1.smithi040.stderr:+ mkdir ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:43:02.345 INFO:tasks.workunit.client.1.smithi040.stderr:+ store_checksum ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:43:02.345 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:43:02.345 INFO:tasks.workunit.client.1.smithi040.stderr:+ local cksum= 2024-09-13T15:43:02.345 INFO:tasks.workunit.client.1.smithi040.stderr:++ echo -n ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:43:02.346 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:43:02.346 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:43:02.347 INFO:tasks.workunit.client.1.smithi040.stderr:+ local fhash=649c91979e9b1f624b68619fd44e8b56 2024-09-13T15:43:02.347 INFO:tasks.workunit.client.1.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_4/.snap/snap_4 cksum 2024-09-13T15:43:02.347 INFO:tasks.workunit.client.1.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:43:02.347 INFO:tasks.workunit.client.1.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:43:02.348 INFO:tasks.workunit.client.1.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_4/.snap/snap_4 -type f -exec md5sum '{}' + 2024-09-13T15:43:02.348 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:43:02.348 INFO:tasks.workunit.client.1.smithi040.stderr:++ md5sum 2024-09-13T15:43:02.348 INFO:tasks.workunit.client.1.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:43:02.524 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:43:02.524 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:43:02.524 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:43:02.524 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:43:02.525 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:43:02.526 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:43:02.527 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:43:12.528 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:43:12.528 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:43:12.529 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:43:12.530 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:43:12.526+0000 7f3f24405640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 36881) UID: 1000 2024-09-13T15:43:18.532 INFO:tasks.workunit.client.1.smithi040.stderr:+ ref=40f9817373d2e2c707636a03995b3b1c 2024-09-13T15:43:18.533 INFO:tasks.workunit.client.1.smithi040.stderr:+ echo -n 40f9817373d2e2c707636a03995b3b1c 2024-09-13T15:43:18.533 INFO:tasks.workunit.client.1.smithi040.stderr:+ trap - EXIT 2024-09-13T15:43:18.533 INFO:tasks.workunit:Stopping ['fs/cephfs_mirror_ha_gen.sh'] on client.1... 2024-09-13T15:43:18.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-13T15:43:19.216 DEBUG:teuthology.parallel:result is None 2024-09-13T15:43:19.216 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T15:43:19.227 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T15:43:19.227 INFO:teuthology.task.exec:Running commands on role client.2 host ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:43:19.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'echo verifying synchronized snapshots...' 2024-09-13T15:43:19.237 INFO:teuthology.orchestra.run.smithi040.stdout:verifying synchronized snapshots... 2024-09-13T15:43:19.238 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T15:43:19.265 INFO:tasks.workunit:Pulling workunits from ref 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:43:19.265 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T15:43:19.265 DEBUG:teuthology.orchestra.run.smithi040:> stat -- /home/ubuntu/cephtest/mnt.2 2024-09-13T15:43:19.303 INFO:teuthology.orchestra.run.smithi040.stdout: File: /home/ubuntu/cephtest/mnt.2 2024-09-13T15:43:19.303 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 39813813 Blocks: 1 IO Block: 4194304 directory 2024-09-13T15:43:19.303 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 2eh/46d Inode: 1 Links: 3 2024-09-13T15:43:19.304 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:43:19.304 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T15:43:19.304 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-09-13 15:37:06.594064026 +0000 2024-09-13T15:43:19.304 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-09-13 15:37:06.594064026 +0000 2024-09-13T15:43:19.304 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2024-09-13T15:43:19.304 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.2 2024-09-13T15:43:19.304 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/mnt.2 && sudo install -d -m 0755 --owner=ubuntu -- mirror 2024-09-13T15:43:19.377 INFO:tasks.workunit:timeout=3h 2024-09-13T15:43:19.377 INFO:tasks.workunit:cleanup=False 2024-09-13T15:43:19.378 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf /home/ubuntu/cephtest/clone.client.2 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.2 && cd /home/ubuntu/cephtest/clone.client.2 && git checkout 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:43:19.439 INFO:tasks.workunit.client.2.smithi040.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.2'... 2024-09-13T15:43:27.529 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:43:27.529 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:43:27.530 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:43:27.530 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:43:27.530 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:43:27.533 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:43:27.533 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:43:29.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:43:37.534 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:43:37.534 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:43:37.535 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:43:37.535 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:43:37.533+0000 7f7d2000d640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 37019) UID: 1000 2024-09-13T15:43:52.536 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:43:52.536 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:43:52.536 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:43:52.536 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:43:52.536 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:43:52.539 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:43:52.539 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:43:59.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:44:02.540 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.7913356002966337) > weight (0.3333333333333333) 2024-09-13T15:44:02.541 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.6390358698503511) > weight (0.3333333333333333) 2024-09-13T15:44:02.541 INFO:tasks.cephfs_mirror_thrash:kill client.mirror3 2024-09-13T15:44:02.541 INFO:tasks.cephfs_mirror.client.mirror3:Sent signal 15 2024-09-13T15:44:02.541 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:44:02.542 INFO:tasks.cephfs_mirror.client.mirror3.smithi040.stderr:2024-09-13T15:44:02.537+0000 7fafa943c640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground (PID: 36321) UID: 1000 2024-09-13T15:44:17.542 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror3 2024-09-13T15:44:17.542 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:44:17.542 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror3 2024-09-13T15:44:17.542 INFO:tasks.cephfs_mirror.client.mirror3:Restarting daemon 2024-09-13T15:44:17.543 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground 2024-09-13T15:44:17.545 INFO:tasks.cephfs_mirror.client.mirror3:Started 2024-09-13T15:44:17.546 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:44:18.353 INFO:tasks.workunit.client.2.smithi040.stderr:Updating files: 95% (12107/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T15:44:19.147 INFO:tasks.workunit.client.2.smithi040.stderr:Note: switching to '50bbe7f395997dcd871813949c49addbbf630361'. 2024-09-13T15:44:19.147 INFO:tasks.workunit.client.2.smithi040.stderr: 2024-09-13T15:44:19.147 INFO:tasks.workunit.client.2.smithi040.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T15:44:19.147 INFO:tasks.workunit.client.2.smithi040.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T15:44:19.147 INFO:tasks.workunit.client.2.smithi040.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T15:44:19.148 INFO:tasks.workunit.client.2.smithi040.stderr: 2024-09-13T15:44:19.148 INFO:tasks.workunit.client.2.smithi040.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T15:44:19.148 INFO:tasks.workunit.client.2.smithi040.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T15:44:19.148 INFO:tasks.workunit.client.2.smithi040.stderr: 2024-09-13T15:44:19.148 INFO:tasks.workunit.client.2.smithi040.stderr: git switch -c 2024-09-13T15:44:19.148 INFO:tasks.workunit.client.2.smithi040.stderr: 2024-09-13T15:44:19.148 INFO:tasks.workunit.client.2.smithi040.stderr:Or undo this operation with: 2024-09-13T15:44:19.148 INFO:tasks.workunit.client.2.smithi040.stderr: 2024-09-13T15:44:19.148 INFO:tasks.workunit.client.2.smithi040.stderr: git switch - 2024-09-13T15:44:19.148 INFO:tasks.workunit.client.2.smithi040.stderr: 2024-09-13T15:44:19.148 INFO:tasks.workunit.client.2.smithi040.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T15:44:19.149 INFO:tasks.workunit.client.2.smithi040.stderr: 2024-09-13T15:44:19.149 INFO:tasks.workunit.client.2.smithi040.stderr:HEAD is now at 50bbe7f3959 Merge PR #58789 into wip-rishabh-testing-20240910.095512-reef 2024-09-13T15:44:19.156 DEBUG:teuthology.orchestra.run.smithi040:> cd -- /home/ubuntu/cephtest/clone.client.2/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.2 2024-09-13T15:44:19.203 INFO:tasks.workunit.client.2.smithi040.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T15:44:19.207 INFO:tasks.workunit.client.2.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/direct_io' 2024-09-13T15:44:19.207 INFO:tasks.workunit.client.2.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T15:44:19.449 INFO:tasks.workunit.client.2.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T15:44:19.517 INFO:tasks.workunit.client.2.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T15:44:19.562 INFO:tasks.workunit.client.2.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/direct_io' 2024-09-13T15:44:19.563 INFO:tasks.workunit.client.2.smithi040.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/fs' 2024-09-13T15:44:19.563 INFO:tasks.workunit.client.2.smithi040.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T15:44:19.613 INFO:tasks.workunit.client.2.smithi040.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/fs' 2024-09-13T15:44:19.617 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:44:19.617 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/workunits.list.client.2 of=/dev/stdout 2024-09-13T15:44:19.674 INFO:tasks.workunit:Running workunits matching fs/cephfs_mirror_ha_verify.sh on client.2... 2024-09-13T15:44:19.675 INFO:tasks.workunit:Running workunit fs/cephfs_mirror_ha_verify.sh... 2024-09-13T15:44:19.675 DEBUG:teuthology.orchestra.run.smithi040:workunit test fs/cephfs_mirror_ha_verify.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.2/mirror && cd -- /home/ubuntu/cephtest/mnt.2/mirror && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=50bbe7f395997dcd871813949c49addbbf630361 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 CEPH_MNT=/home/ubuntu/cephtest/mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.2/qa/workunits/fs/cephfs_mirror_ha_verify.sh 2024-09-13T15:44:19.743 INFO:tasks.workunit.client.2.smithi040.stderr:++ dirname /home/ubuntu/cephtest/clone.client.2/qa/workunits/fs/cephfs_mirror_ha_verify.sh 2024-09-13T15:44:19.749 INFO:tasks.workunit.client.2.smithi040.stderr:+ . /home/ubuntu/cephtest/clone.client.2/qa/workunits/fs/cephfs_mirror_helpers.sh 2024-09-13T15:44:19.750 INFO:tasks.workunit.client.2.smithi040.stderr:++ PRIMARY_FS=dc 2024-09-13T15:44:19.750 INFO:tasks.workunit.client.2.smithi040.stderr:++ BACKUP_FS=dc-backup 2024-09-13T15:44:19.750 INFO:tasks.workunit.client.2.smithi040.stderr:++ REPO=ceph-qa-suite 2024-09-13T15:44:19.750 INFO:tasks.workunit.client.2.smithi040.stderr:++ REPO_DIR=ceph_repo 2024-09-13T15:44:19.750 INFO:tasks.workunit.client.2.smithi040.stderr:++ REPO_PATH_PFX=ceph_repo/ceph-qa-suite 2024-09-13T15:44:19.750 INFO:tasks.workunit.client.2.smithi040.stderr:++ NR_DIRECTORIES=4 2024-09-13T15:44:19.750 INFO:tasks.workunit.client.2.smithi040.stderr:++ NR_SNAPSHOTS=4 2024-09-13T15:44:19.750 INFO:tasks.workunit.client.2.smithi040.stderr:++ MIRROR_SUBDIR=/mirror 2024-09-13T15:44:19.750 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'running verifier on secondary file system...' 2024-09-13T15:44:19.751 INFO:tasks.workunit.client.2.smithi040.stdout:running verifier on secondary file system... 2024-09-13T15:44:19.751 INFO:tasks.workunit.client.2.smithi040.stderr:++ seq 1 4 2024-09-13T15:44:19.751 INFO:tasks.workunit.client.2.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:44:19.752 INFO:tasks.workunit.client.2.smithi040.stderr:+ repo_name=ceph_repo/ceph-qa-suite_1 2024-09-13T15:44:19.752 INFO:tasks.workunit.client.2.smithi040.stderr:++ seq 1 4 2024-09-13T15:44:19.752 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:44:19.752 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:44:19.752 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:44:20.763 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:44:20.763 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_1 2024-09-13T15:44:20.767 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_1/.snap/snap_1] in ceph_repo/ceph-qa-suite_1 2024-09-13T15:44:20.767 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_1/.snap/snap_1] in ceph_repo/ceph-qa-suite_1' 2024-09-13T15:44:20.767 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:44:20.769 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:44:20.770 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_1/.snap/snap_1' 2024-09-13T15:44:20.770 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:44:20.770 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_1/.snap/snap_1 cksum 2024-09-13T15:44:20.770 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:44:20.770 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:44:20.770 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:44:20.771 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_1/.snap/snap_1 -type f -exec md5sum '{}' + 2024-09-13T15:44:20.771 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:44:20.771 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:44:27.547 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.773855996364518) > weight (0.3333333333333333) 2024-09-13T15:44:27.547 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.8435997986068265) > weight (0.3333333333333333) 2024-09-13T15:44:27.547 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.9135611358602054) > weight (0.3333333333333333) 2024-09-13T15:44:27.547 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:44:29.800 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:44:37.548 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.4670698929236746) > weight (0.3333333333333333) 2024-09-13T15:44:37.548 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.4122787585815152) > weight (0.3333333333333333) 2024-09-13T15:44:37.548 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.8512266652249705) > weight (0.3333333333333333) 2024-09-13T15:44:37.548 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:44:42.073 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=96af404e74d84fbe2f30c7e32b21afda 2024-09-13T15:44:42.073 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_1/.snap/snap_1 (96af404e74d84fbe2f30c7e32b21afda) 2024-09-13T15:44:42.074 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:44:42.074 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum 96af404e74d84fbe2f30c7e32b21afda ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:44:42.074 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:44:42.074 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=96af404e74d84fbe2f30c7e32b21afda 2024-09-13T15:44:42.074 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:44:42.074 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_1/.snap/snap_1 2024-09-13T15:44:42.074 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:44:42.074 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:44:42.074 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=d96e001595fadc67790d653012b2a388 2024-09-13T15:44:42.075 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-d96e001595fadc67790d653012b2a388 2024-09-13T15:44:42.075 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=96af404e74d84fbe2f30c7e32b21afda 2024-09-13T15:44:42.075 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' 96af404e74d84fbe2f30c7e32b21afda '!=' 96af404e74d84fbe2f30c7e32b21afda ']' 2024-09-13T15:44:42.075 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:44:42.075 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:44:42.075 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:44:42.075 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_1/.snap/snap_1 (96af404e74d84fbe2f30c7e32b21afda)' 2024-09-13T15:44:42.075 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:44:42.075 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_1/.snap/snap_1' 2024-09-13T15:44:42.075 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:44:42.075 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:44:42.075 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:44:43.046 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:44:43.046 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_1 2024-09-13T15:44:43.047 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_1/.snap/snap_2] in ceph_repo/ceph-qa-suite_1 2024-09-13T15:44:43.047 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_1/.snap/snap_2] in ceph_repo/ceph-qa-suite_1' 2024-09-13T15:44:43.047 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:44:43.051 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:44:43.051 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_1/.snap/snap_2' 2024-09-13T15:44:43.051 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:44:43.051 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_1/.snap/snap_2 cksum 2024-09-13T15:44:43.052 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:44:43.052 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:44:43.052 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_1/.snap/snap_2 -type f -exec md5sum '{}' + 2024-09-13T15:44:43.052 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:44:43.053 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:44:43.053 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:44:47.550 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.7812053819480655) > weight (0.3333333333333333) 2024-09-13T15:44:47.550 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.6867522206568113) > weight (0.3333333333333333) 2024-09-13T15:44:47.550 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.7292426284182454) > weight (0.3333333333333333) 2024-09-13T15:44:47.550 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:44:57.551 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.6600754545406506) > weight (0.3333333333333333) 2024-09-13T15:44:57.551 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.8317012426976482) > weight (0.3333333333333333) 2024-09-13T15:44:57.551 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.7715403367189125) > weight (0.3333333333333333) 2024-09-13T15:44:57.551 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:45:00.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:45:04.849 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=46aa6b2df97cd836e8cc88608992321d 2024-09-13T15:45:04.850 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum 46aa6b2df97cd836e8cc88608992321d ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:45:04.850 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:45:04.850 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=46aa6b2df97cd836e8cc88608992321d 2024-09-13T15:45:04.850 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:45:04.851 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:45:04.851 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:45:04.851 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:45:04.853 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=60f861d8bf2fe5b4ca2686aa4a55c969 2024-09-13T15:45:04.854 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-60f861d8bf2fe5b4ca2686aa4a55c969 2024-09-13T15:45:04.854 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=46aa6b2df97cd836e8cc88608992321d 2024-09-13T15:45:04.854 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' 46aa6b2df97cd836e8cc88608992321d '!=' 46aa6b2df97cd836e8cc88608992321d ']' 2024-09-13T15:45:04.855 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:45:04.856 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:45:04.856 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:45:04.856 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_1/.snap/snap_2 (46aa6b2df97cd836e8cc88608992321d)' 2024-09-13T15:45:04.856 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_1/.snap/snap_2 (46aa6b2df97cd836e8cc88608992321d) 2024-09-13T15:45:04.857 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:45:04.857 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_1/.snap/snap_2' 2024-09-13T15:45:04.857 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_1/.snap/snap_2 2024-09-13T15:45:04.857 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:45:04.857 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:45:04.857 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:45:05.857 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:45:05.857 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_1 2024-09-13T15:45:05.858 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_1/.snap/snap_3] in ceph_repo/ceph-qa-suite_1 2024-09-13T15:45:05.858 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_1/.snap/snap_3] in ceph_repo/ceph-qa-suite_1' 2024-09-13T15:45:05.858 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:45:05.862 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:45:05.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_1/.snap/snap_3' 2024-09-13T15:45:05.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:45:05.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_1/.snap/snap_3 cksum 2024-09-13T15:45:05.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:45:05.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:45:05.864 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_1/.snap/snap_3 -type f -exec md5sum '{}' + 2024-09-13T15:45:05.864 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:45:05.864 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:45:05.864 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:45:07.552 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.5666676374331019) > weight (0.3333333333333333) 2024-09-13T15:45:07.552 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.48940142071081183) > weight (0.3333333333333333) 2024-09-13T15:45:07.552 INFO:tasks.cephfs_mirror_thrash:kill client.mirror3 2024-09-13T15:45:07.553 INFO:tasks.cephfs_mirror.client.mirror3:Sent signal 15 2024-09-13T15:45:07.553 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:45:07.554 INFO:tasks.cephfs_mirror.client.mirror3.smithi040.stderr:2024-09-13T15:45:07.552+0000 7ff5df349640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground (PID: 37262) UID: 1000 2024-09-13T15:45:22.554 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror3 2024-09-13T15:45:22.554 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:45:22.555 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror3 2024-09-13T15:45:22.555 INFO:tasks.cephfs_mirror.client.mirror3:Restarting daemon 2024-09-13T15:45:22.555 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground 2024-09-13T15:45:22.558 INFO:tasks.cephfs_mirror.client.mirror3:Started 2024-09-13T15:45:22.558 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:45:25.859 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=96a3155f140bbb8b294e8cc36b62436d 2024-09-13T15:45:25.859 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum 96a3155f140bbb8b294e8cc36b62436d ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:45:25.859 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:45:25.859 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=96a3155f140bbb8b294e8cc36b62436d 2024-09-13T15:45:25.859 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:45:25.860 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:45:25.860 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:45:25.860 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:45:25.862 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=e9645d7fafcb6cbc659d5acd0a395859 2024-09-13T15:45:25.862 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-e9645d7fafcb6cbc659d5acd0a395859 2024-09-13T15:45:25.863 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=96a3155f140bbb8b294e8cc36b62436d 2024-09-13T15:45:25.863 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' 96a3155f140bbb8b294e8cc36b62436d '!=' 96a3155f140bbb8b294e8cc36b62436d ']' 2024-09-13T15:45:25.863 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:45:25.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:45:25.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:45:25.863 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_1/.snap/snap_3 (96a3155f140bbb8b294e8cc36b62436d) 2024-09-13T15:45:25.864 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_1/.snap/snap_3 (96a3155f140bbb8b294e8cc36b62436d)' 2024-09-13T15:45:25.864 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:45:25.864 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_1/.snap/snap_3' 2024-09-13T15:45:25.864 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_1/.snap/snap_3 2024-09-13T15:45:25.864 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:45:25.864 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:45:25.865 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:45:26.864 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:45:26.864 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_1 2024-09-13T15:45:26.865 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_1/.snap/snap_4] in ceph_repo/ceph-qa-suite_1 2024-09-13T15:45:26.866 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_1/.snap/snap_4] in ceph_repo/ceph-qa-suite_1' 2024-09-13T15:45:26.866 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:45:26.869 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:45:26.870 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_1/.snap/snap_4' 2024-09-13T15:45:26.870 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:45:26.870 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_1/.snap/snap_4 cksum 2024-09-13T15:45:26.870 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:45:26.870 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:45:26.871 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_1/.snap/snap_4 -type f -exec md5sum '{}' + 2024-09-13T15:45:26.871 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:45:26.871 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:45:26.871 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:45:30.343 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:45:32.559 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:45:32.559 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:45:32.559 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:45:32.560 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:45:32.556+0000 7faea2c8b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 37144) UID: 1000 2024-09-13T15:45:47.560 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:45:47.560 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:45:47.561 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:45:47.561 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:45:47.561 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:45:47.564 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:45:47.564 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:45:48.403 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=89249e9344c22e98e86b8d831d014ddb 2024-09-13T15:45:48.403 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum 89249e9344c22e98e86b8d831d014ddb ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:45:48.403 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:45:48.404 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=89249e9344c22e98e86b8d831d014ddb 2024-09-13T15:45:48.404 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:45:48.404 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:45:48.404 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:45:48.404 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:45:48.406 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=50bbdc15c793b73ca67a2f45fe1ba36a 2024-09-13T15:45:48.407 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-50bbdc15c793b73ca67a2f45fe1ba36a 2024-09-13T15:45:48.408 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=89249e9344c22e98e86b8d831d014ddb 2024-09-13T15:45:48.408 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' 89249e9344c22e98e86b8d831d014ddb '!=' 89249e9344c22e98e86b8d831d014ddb ']' 2024-09-13T15:45:48.408 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:45:48.408 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:45:48.408 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:45:48.409 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_1/.snap/snap_4 (89249e9344c22e98e86b8d831d014ddb) 2024-09-13T15:45:48.409 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_1/.snap/snap_4 (89249e9344c22e98e86b8d831d014ddb)' 2024-09-13T15:45:48.409 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:45:48.409 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_1/.snap/snap_4 2024-09-13T15:45:48.410 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_1/.snap/snap_4' 2024-09-13T15:45:48.410 INFO:tasks.workunit.client.2.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:45:48.410 INFO:tasks.workunit.client.2.smithi040.stderr:+ repo_name=ceph_repo/ceph-qa-suite_2 2024-09-13T15:45:48.410 INFO:tasks.workunit.client.2.smithi040.stderr:++ seq 1 4 2024-09-13T15:45:48.417 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:45:48.417 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:45:48.417 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:45:49.418 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:45:49.418 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_2 2024-09-13T15:45:49.421 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_2/.snap/snap_1] in ceph_repo/ceph-qa-suite_2 2024-09-13T15:45:49.421 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_2/.snap/snap_1] in ceph_repo/ceph-qa-suite_2' 2024-09-13T15:45:49.421 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:45:49.425 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:45:49.425 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_2/.snap/snap_1' 2024-09-13T15:45:49.426 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:45:49.426 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_2/.snap/snap_1 cksum 2024-09-13T15:45:49.426 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:45:49.426 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:45:49.426 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_2/.snap/snap_1 -type f -exec md5sum '{}' + 2024-09-13T15:45:49.427 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:45:49.427 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:45:49.427 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:45:57.565 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:45:57.566 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:45:57.566 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:45:57.567 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:45:57.564+0000 7f4994108640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 37671) UID: 1000 2024-09-13T15:46:00.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:46:07.936 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=99ed4fd6963497f2e9262bcde9a76d52 2024-09-13T15:46:07.937 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum 99ed4fd6963497f2e9262bcde9a76d52 ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:46:07.937 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:46:07.937 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=99ed4fd6963497f2e9262bcde9a76d52 2024-09-13T15:46:07.937 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:46:07.938 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:46:07.938 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:46:07.938 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:46:07.940 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=c524cf5cc479c4e40566f250556aa0f7 2024-09-13T15:46:07.941 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-c524cf5cc479c4e40566f250556aa0f7 2024-09-13T15:46:07.942 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=99ed4fd6963497f2e9262bcde9a76d52 2024-09-13T15:46:07.942 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' 99ed4fd6963497f2e9262bcde9a76d52 '!=' 99ed4fd6963497f2e9262bcde9a76d52 ']' 2024-09-13T15:46:07.942 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:46:07.942 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:46:07.942 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:46:07.942 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_2/.snap/snap_1 (99ed4fd6963497f2e9262bcde9a76d52) 2024-09-13T15:46:07.942 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_2/.snap/snap_1 (99ed4fd6963497f2e9262bcde9a76d52)' 2024-09-13T15:46:07.942 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:46:07.943 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_2/.snap/snap_1 2024-09-13T15:46:07.943 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_2/.snap/snap_1' 2024-09-13T15:46:07.943 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:46:07.943 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:46:07.943 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:46:08.943 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:46:08.943 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_2 2024-09-13T15:46:08.944 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_2/.snap/snap_2] in ceph_repo/ceph-qa-suite_2 2024-09-13T15:46:08.944 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_2/.snap/snap_2] in ceph_repo/ceph-qa-suite_2' 2024-09-13T15:46:08.944 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:46:08.949 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:46:08.949 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_2/.snap/snap_2' 2024-09-13T15:46:08.949 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:46:08.949 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_2/.snap/snap_2 cksum 2024-09-13T15:46:08.949 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:46:08.949 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:46:08.950 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_2/.snap/snap_2 -type f -exec md5sum '{}' + 2024-09-13T15:46:08.950 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:46:08.950 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:46:08.950 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:46:12.567 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:46:12.567 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:46:12.568 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:46:12.568 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:46:12.568 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:46:12.571 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:46:12.571 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:46:22.572 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.7997447489213642) > weight (0.3333333333333333) 2024-09-13T15:46:22.572 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.5957400816039142) > weight (0.3333333333333333) 2024-09-13T15:46:22.572 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.7639311388277155) > weight (0.3333333333333333) 2024-09-13T15:46:22.572 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:46:26.325 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=8da4739a394a4ffc6a32e632d80d481c 2024-09-13T15:46:26.325 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum 8da4739a394a4ffc6a32e632d80d481c ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:46:26.325 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:46:26.325 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=8da4739a394a4ffc6a32e632d80d481c 2024-09-13T15:46:26.326 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:46:26.326 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:46:26.326 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:46:26.326 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:46:26.328 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=e11652dd527663b91a3979316e87da38 2024-09-13T15:46:26.329 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-e11652dd527663b91a3979316e87da38 2024-09-13T15:46:26.330 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=8da4739a394a4ffc6a32e632d80d481c 2024-09-13T15:46:26.331 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' 8da4739a394a4ffc6a32e632d80d481c '!=' 8da4739a394a4ffc6a32e632d80d481c ']' 2024-09-13T15:46:26.331 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:46:26.331 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:46:26.331 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:46:26.332 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_2/.snap/snap_2 (8da4739a394a4ffc6a32e632d80d481c) 2024-09-13T15:46:26.332 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_2/.snap/snap_2 (8da4739a394a4ffc6a32e632d80d481c)' 2024-09-13T15:46:26.333 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:46:26.333 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_2/.snap/snap_2' 2024-09-13T15:46:26.333 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_2/.snap/snap_2 2024-09-13T15:46:26.333 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:46:26.333 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:46:26.334 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:46:27.331 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:46:27.331 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_2 2024-09-13T15:46:27.332 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_2/.snap/snap_3] in ceph_repo/ceph-qa-suite_2 2024-09-13T15:46:27.332 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_2/.snap/snap_3] in ceph_repo/ceph-qa-suite_2' 2024-09-13T15:46:27.333 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:46:27.336 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:46:27.337 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_2/.snap/snap_3' 2024-09-13T15:46:27.337 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:46:27.337 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_2/.snap/snap_3 cksum 2024-09-13T15:46:27.337 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:46:27.337 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:46:27.337 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_2/.snap/snap_3 -type f -exec md5sum '{}' + 2024-09-13T15:46:27.338 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:46:27.338 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:46:27.338 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:46:30.457 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:46:32.573 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.828584241261439) > weight (0.3333333333333333) 2024-09-13T15:46:32.573 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.39378301157571294) > weight (0.3333333333333333) 2024-09-13T15:46:32.573 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.671665699340131) > weight (0.3333333333333333) 2024-09-13T15:46:32.573 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:46:42.574 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.47471111708817837) > weight (0.3333333333333333) 2024-09-13T15:46:42.574 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.7497128253981494) > weight (0.3333333333333333) 2024-09-13T15:46:42.574 INFO:tasks.cephfs_mirror_thrash:kill client.mirror3 2024-09-13T15:46:42.575 INFO:tasks.cephfs_mirror.client.mirror3:Sent signal 15 2024-09-13T15:46:42.575 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:46:42.576 INFO:tasks.cephfs_mirror.client.mirror3.smithi040.stderr:2024-09-13T15:46:42.575+0000 7fc4f7e78640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground (PID: 37539) UID: 1000 2024-09-13T15:46:48.777 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=b0d2df37a009577e7edcfd3ce9e9f60d 2024-09-13T15:46:48.778 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum b0d2df37a009577e7edcfd3ce9e9f60d ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:46:48.778 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:46:48.778 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=b0d2df37a009577e7edcfd3ce9e9f60d 2024-09-13T15:46:48.778 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:46:48.779 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:46:48.779 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:46:48.779 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:46:48.781 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=3d17b914142381451cdd0b7235b5a02e 2024-09-13T15:46:48.781 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-3d17b914142381451cdd0b7235b5a02e 2024-09-13T15:46:48.783 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=b0d2df37a009577e7edcfd3ce9e9f60d 2024-09-13T15:46:48.783 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' b0d2df37a009577e7edcfd3ce9e9f60d '!=' b0d2df37a009577e7edcfd3ce9e9f60d ']' 2024-09-13T15:46:48.783 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:46:48.783 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:46:48.783 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:46:48.783 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_2/.snap/snap_3 (b0d2df37a009577e7edcfd3ce9e9f60d) 2024-09-13T15:46:48.783 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_2/.snap/snap_3 (b0d2df37a009577e7edcfd3ce9e9f60d)' 2024-09-13T15:46:48.784 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:46:48.784 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_2/.snap/snap_3 2024-09-13T15:46:48.784 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_2/.snap/snap_3' 2024-09-13T15:46:48.784 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:46:48.784 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:46:48.784 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:46:49.784 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:46:49.784 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_2 2024-09-13T15:46:49.785 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_2/.snap/snap_4] in ceph_repo/ceph-qa-suite_2 2024-09-13T15:46:49.785 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_2/.snap/snap_4] in ceph_repo/ceph-qa-suite_2' 2024-09-13T15:46:49.785 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:46:49.789 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:46:49.789 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_2/.snap/snap_4' 2024-09-13T15:46:49.789 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:46:49.789 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_2/.snap/snap_4 cksum 2024-09-13T15:46:49.789 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:46:49.790 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:46:49.790 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_2/.snap/snap_4 -type f -exec md5sum '{}' + 2024-09-13T15:46:49.790 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:46:49.790 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:46:49.790 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:46:57.576 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror3 2024-09-13T15:46:57.576 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:46:57.576 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror3 2024-09-13T15:46:57.576 INFO:tasks.cephfs_mirror.client.mirror3:Restarting daemon 2024-09-13T15:46:57.577 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground 2024-09-13T15:46:57.579 INFO:tasks.cephfs_mirror.client.mirror3:Started 2024-09-13T15:46:57.580 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:47:00.939 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:47:07.580 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.5254202001023142) > weight (0.3333333333333333) 2024-09-13T15:47:07.581 INFO:tasks.cephfs_mirror_thrash:kill client.mirror2 2024-09-13T15:47:07.581 INFO:tasks.cephfs_mirror.client.mirror2:Sent signal 15 2024-09-13T15:47:07.581 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:47:07.582 INFO:tasks.cephfs_mirror.client.mirror2.smithi040.stderr:2024-09-13T15:47:07.583+0000 7ff28fd14640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground (PID: 36451) UID: 1000 2024-09-13T15:47:08.789 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=23df78d79e77eb4c8753999fba25957b 2024-09-13T15:47:08.789 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum 23df78d79e77eb4c8753999fba25957b ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:47:08.789 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:47:08.789 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=23df78d79e77eb4c8753999fba25957b 2024-09-13T15:47:08.789 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:47:08.790 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:47:08.790 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:47:08.790 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:47:08.792 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=4b28b013e9076873b5ef626f8ffba7d8 2024-09-13T15:47:08.792 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-4b28b013e9076873b5ef626f8ffba7d8 2024-09-13T15:47:08.793 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=23df78d79e77eb4c8753999fba25957b 2024-09-13T15:47:08.794 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' 23df78d79e77eb4c8753999fba25957b '!=' 23df78d79e77eb4c8753999fba25957b ']' 2024-09-13T15:47:08.794 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:47:08.794 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:47:08.794 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:47:08.794 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_2/.snap/snap_4 (23df78d79e77eb4c8753999fba25957b) 2024-09-13T15:47:08.794 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_2/.snap/snap_4 (23df78d79e77eb4c8753999fba25957b)' 2024-09-13T15:47:08.795 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:47:08.795 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_2/.snap/snap_4 2024-09-13T15:47:08.795 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_2/.snap/snap_4' 2024-09-13T15:47:08.795 INFO:tasks.workunit.client.2.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:47:08.795 INFO:tasks.workunit.client.2.smithi040.stderr:+ repo_name=ceph_repo/ceph-qa-suite_3 2024-09-13T15:47:08.796 INFO:tasks.workunit.client.2.smithi040.stderr:++ seq 1 4 2024-09-13T15:47:08.796 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:47:08.796 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:47:08.796 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:47:09.796 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:47:09.796 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_3 2024-09-13T15:47:09.798 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_3/.snap/snap_1] in ceph_repo/ceph-qa-suite_3 2024-09-13T15:47:09.799 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_3/.snap/snap_1] in ceph_repo/ceph-qa-suite_3' 2024-09-13T15:47:09.799 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:47:09.802 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:47:09.803 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_3/.snap/snap_1' 2024-09-13T15:47:09.803 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:47:09.803 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_3/.snap/snap_1 cksum 2024-09-13T15:47:09.803 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:47:09.803 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:47:09.804 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_3/.snap/snap_1 -type f -exec md5sum '{}' + 2024-09-13T15:47:09.804 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:47:09.804 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:47:09.804 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:47:22.582 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror2 2024-09-13T15:47:22.582 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:47:22.583 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror2 2024-09-13T15:47:22.583 INFO:tasks.cephfs_mirror.client.mirror2:Restarting daemon 2024-09-13T15:47:22.583 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground 2024-09-13T15:47:22.586 INFO:tasks.cephfs_mirror.client.mirror2:Started 2024-09-13T15:47:22.586 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:47:28.449 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=5f4816837a5020e931ea1c4d2b06a051 2024-09-13T15:47:28.449 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum 5f4816837a5020e931ea1c4d2b06a051 ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:47:28.449 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:47:28.449 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=5f4816837a5020e931ea1c4d2b06a051 2024-09-13T15:47:28.449 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:47:28.450 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:47:28.450 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:47:28.450 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:47:28.452 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=fca2516c8f0507d23bb18b097445be80 2024-09-13T15:47:28.453 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-fca2516c8f0507d23bb18b097445be80 2024-09-13T15:47:28.453 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=5f4816837a5020e931ea1c4d2b06a051 2024-09-13T15:47:28.453 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' 5f4816837a5020e931ea1c4d2b06a051 '!=' 5f4816837a5020e931ea1c4d2b06a051 ']' 2024-09-13T15:47:28.453 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:47:28.454 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:47:28.454 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:47:28.454 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_3/.snap/snap_1 (5f4816837a5020e931ea1c4d2b06a051) 2024-09-13T15:47:28.455 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_3/.snap/snap_1 (5f4816837a5020e931ea1c4d2b06a051)' 2024-09-13T15:47:28.455 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:47:28.455 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_3/.snap/snap_1' 2024-09-13T15:47:28.455 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_3/.snap/snap_1 2024-09-13T15:47:28.455 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:47:28.455 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:47:28.455 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:47:29.456 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:47:29.456 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_3 2024-09-13T15:47:29.456 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_3/.snap/snap_2] in ceph_repo/ceph-qa-suite_3 2024-09-13T15:47:29.457 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_3/.snap/snap_2] in ceph_repo/ceph-qa-suite_3' 2024-09-13T15:47:29.457 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:47:29.460 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:47:29.461 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_3/.snap/snap_2' 2024-09-13T15:47:29.461 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:47:29.461 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_3/.snap/snap_2 cksum 2024-09-13T15:47:29.461 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:47:29.461 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:47:29.462 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_3/.snap/snap_2 -type f -exec md5sum '{}' + 2024-09-13T15:47:29.462 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:47:29.462 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:47:29.462 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:47:30.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:47:32.586 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.5228906423648136) > weight (0.3333333333333333) 2024-09-13T15:47:32.587 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.8573914183605099) > weight (0.3333333333333333) 2024-09-13T15:47:32.587 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.6476870643426023) > weight (0.3333333333333333) 2024-09-13T15:47:32.587 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:47:42.587 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.7299445164397874) > weight (0.3333333333333333) 2024-09-13T15:47:42.588 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.6747058209587037) > weight (0.3333333333333333) 2024-09-13T15:47:42.588 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.523069757867018) > weight (0.3333333333333333) 2024-09-13T15:47:42.588 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:47:52.552 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=fcc22cc3ce574f239413e91058dfc806 2024-09-13T15:47:52.553 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum fcc22cc3ce574f239413e91058dfc806 ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:47:52.553 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:47:52.553 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=fcc22cc3ce574f239413e91058dfc806 2024-09-13T15:47:52.553 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:47:52.554 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:47:52.554 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:47:52.554 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:47:52.555 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=7685357004d198934dfa68b5a214fb2a 2024-09-13T15:47:52.555 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-7685357004d198934dfa68b5a214fb2a 2024-09-13T15:47:52.556 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=fcc22cc3ce574f239413e91058dfc806 2024-09-13T15:47:52.556 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' fcc22cc3ce574f239413e91058dfc806 '!=' fcc22cc3ce574f239413e91058dfc806 ']' 2024-09-13T15:47:52.556 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:47:52.556 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:47:52.556 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:47:52.557 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_3/.snap/snap_2 (fcc22cc3ce574f239413e91058dfc806) 2024-09-13T15:47:52.557 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_3/.snap/snap_2 (fcc22cc3ce574f239413e91058dfc806)' 2024-09-13T15:47:52.557 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:47:52.557 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_3/.snap/snap_2 2024-09-13T15:47:52.558 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_3/.snap/snap_2' 2024-09-13T15:47:52.558 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:47:52.558 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:47:52.558 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:47:52.588 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.38928103642222434) > weight (0.3333333333333333) 2024-09-13T15:47:52.588 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.5353418725415647) > weight (0.3333333333333333) 2024-09-13T15:47:52.589 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.44158063944364256) > weight (0.3333333333333333) 2024-09-13T15:47:52.589 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:47:53.558 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:47:53.558 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_3 2024-09-13T15:47:53.559 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_3/.snap/snap_3] in ceph_repo/ceph-qa-suite_3 2024-09-13T15:47:53.559 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_3/.snap/snap_3] in ceph_repo/ceph-qa-suite_3' 2024-09-13T15:47:53.559 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:47:53.563 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:47:53.563 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_3/.snap/snap_3' 2024-09-13T15:47:53.563 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:47:53.563 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_3/.snap/snap_3 cksum 2024-09-13T15:47:53.563 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:47:53.564 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:47:53.564 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_3/.snap/snap_3 -type f -exec md5sum '{}' + 2024-09-13T15:47:53.564 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:47:53.564 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:47:53.565 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:48:01.028 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:48:02.589 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.6997412933809778) > weight (0.3333333333333333) 2024-09-13T15:48:02.590 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.8020391804358518) > weight (0.3333333333333333) 2024-09-13T15:48:02.590 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.7634218639403645) > weight (0.3333333333333333) 2024-09-13T15:48:02.590 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:48:12.590 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:48:12.591 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:48:12.592 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:48:12.593 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:48:12.590+0000 7f337ae27640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 37818) UID: 1000 2024-09-13T15:48:15.856 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=b8a2ee7d01f6db35f96acb36eaf07a78 2024-09-13T15:48:15.857 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum b8a2ee7d01f6db35f96acb36eaf07a78 ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:48:15.857 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:48:15.857 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=b8a2ee7d01f6db35f96acb36eaf07a78 2024-09-13T15:48:15.857 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:48:15.858 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:48:15.858 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:48:15.858 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:48:15.860 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=5f0e6f1ab4f0b84a8a31feaf9233254d 2024-09-13T15:48:15.860 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-5f0e6f1ab4f0b84a8a31feaf9233254d 2024-09-13T15:48:15.862 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=b8a2ee7d01f6db35f96acb36eaf07a78 2024-09-13T15:48:15.862 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' b8a2ee7d01f6db35f96acb36eaf07a78 '!=' b8a2ee7d01f6db35f96acb36eaf07a78 ']' 2024-09-13T15:48:15.862 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:48:15.862 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:48:15.862 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:48:15.862 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_3/.snap/snap_3 (b8a2ee7d01f6db35f96acb36eaf07a78) 2024-09-13T15:48:15.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_3/.snap/snap_3 (b8a2ee7d01f6db35f96acb36eaf07a78)' 2024-09-13T15:48:15.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:48:15.863 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_3/.snap/snap_3 2024-09-13T15:48:15.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_3/.snap/snap_3' 2024-09-13T15:48:15.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:48:15.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:48:15.864 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:48:16.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:48:16.863 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_3 2024-09-13T15:48:16.864 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_3/.snap/snap_4] in ceph_repo/ceph-qa-suite_3 2024-09-13T15:48:16.864 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_3/.snap/snap_4] in ceph_repo/ceph-qa-suite_3' 2024-09-13T15:48:16.864 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:48:16.869 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:48:16.870 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_3/.snap/snap_4' 2024-09-13T15:48:16.870 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:48:16.870 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_3/.snap/snap_4 cksum 2024-09-13T15:48:16.870 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:48:16.870 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:48:16.871 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_3/.snap/snap_4 -type f -exec md5sum '{}' + 2024-09-13T15:48:16.871 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:48:16.871 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:48:16.871 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:48:27.592 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:48:27.593 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:48:27.593 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:48:27.593 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:48:27.594 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:48:27.596 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:48:27.596 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:48:31.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:48:34.499 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=30cdedad0495361becb9de69d0f2902f 2024-09-13T15:48:34.500 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum 30cdedad0495361becb9de69d0f2902f ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:48:34.501 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:48:34.501 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=30cdedad0495361becb9de69d0f2902f 2024-09-13T15:48:34.501 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:48:34.501 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:48:34.501 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:48:34.501 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:48:34.504 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=a4a1c36b9f53d18d85119930c5d402d2 2024-09-13T15:48:34.504 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-a4a1c36b9f53d18d85119930c5d402d2 2024-09-13T15:48:34.505 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=30cdedad0495361becb9de69d0f2902f 2024-09-13T15:48:34.505 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' 30cdedad0495361becb9de69d0f2902f '!=' 30cdedad0495361becb9de69d0f2902f ']' 2024-09-13T15:48:34.505 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:48:34.506 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:48:34.506 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:48:34.506 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_3/.snap/snap_4 (30cdedad0495361becb9de69d0f2902f) 2024-09-13T15:48:34.506 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_3/.snap/snap_4 (30cdedad0495361becb9de69d0f2902f)' 2024-09-13T15:48:34.507 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:48:34.507 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_3/.snap/snap_4' 2024-09-13T15:48:34.507 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_3/.snap/snap_4 2024-09-13T15:48:34.507 INFO:tasks.workunit.client.2.smithi040.stderr:+ for i in `seq 1 $NR_DIRECTORIES` 2024-09-13T15:48:34.508 INFO:tasks.workunit.client.2.smithi040.stderr:+ repo_name=ceph_repo/ceph-qa-suite_4 2024-09-13T15:48:34.508 INFO:tasks.workunit.client.2.smithi040.stderr:++ seq 1 4 2024-09-13T15:48:34.508 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:48:34.508 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:48:34.508 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:48:35.508 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:48:35.508 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_4 2024-09-13T15:48:35.511 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_4/.snap/snap_1] in ceph_repo/ceph-qa-suite_4 2024-09-13T15:48:35.511 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_4/.snap/snap_1] in ceph_repo/ceph-qa-suite_4' 2024-09-13T15:48:35.511 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:48:35.514 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:48:35.515 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_4/.snap/snap_1' 2024-09-13T15:48:35.515 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:48:35.515 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_4/.snap/snap_1 cksum 2024-09-13T15:48:35.515 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:48:35.515 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:48:35.515 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_4/.snap/snap_1 -type f -exec md5sum '{}' + 2024-09-13T15:48:35.516 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:48:35.516 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:48:35.516 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:48:37.597 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.7389182433918784) > weight (0.3333333333333333) 2024-09-13T15:48:37.597 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.8247339934127662) > weight (0.3333333333333333) 2024-09-13T15:48:37.597 INFO:tasks.cephfs_mirror_thrash:kill client.mirror3 2024-09-13T15:48:37.597 INFO:tasks.cephfs_mirror.client.mirror3:Sent signal 15 2024-09-13T15:48:37.598 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:48:37.599 INFO:tasks.cephfs_mirror.client.mirror3.smithi040.stderr:2024-09-13T15:48:37.598+0000 7f9bd8b24640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground (PID: 37986) UID: 1000 2024-09-13T15:48:52.599 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror3 2024-09-13T15:48:52.599 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:48:52.599 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror3 2024-09-13T15:48:52.599 INFO:tasks.cephfs_mirror.client.mirror3:Restarting daemon 2024-09-13T15:48:52.600 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground 2024-09-13T15:48:52.602 INFO:tasks.cephfs_mirror.client.mirror3:Started 2024-09-13T15:48:52.602 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:48:56.135 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=c4eb55752f20f5a44c42d69f3f7835c8 2024-09-13T15:48:56.135 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum c4eb55752f20f5a44c42d69f3f7835c8 ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:48:56.135 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:48:56.135 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=c4eb55752f20f5a44c42d69f3f7835c8 2024-09-13T15:48:56.136 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:48:56.136 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:48:56.136 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:48:56.136 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:48:56.138 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=99efa01e0c3ea92844b3543ae4334258 2024-09-13T15:48:56.138 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-99efa01e0c3ea92844b3543ae4334258 2024-09-13T15:48:56.139 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=c4eb55752f20f5a44c42d69f3f7835c8 2024-09-13T15:48:56.139 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' c4eb55752f20f5a44c42d69f3f7835c8 '!=' c4eb55752f20f5a44c42d69f3f7835c8 ']' 2024-09-13T15:48:56.139 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:48:56.139 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:48:56.139 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:48:56.140 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_4/.snap/snap_1 (c4eb55752f20f5a44c42d69f3f7835c8) 2024-09-13T15:48:56.140 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_4/.snap/snap_1 (c4eb55752f20f5a44c42d69f3f7835c8)' 2024-09-13T15:48:56.140 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:48:56.140 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_4/.snap/snap_1 2024-09-13T15:48:56.141 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_4/.snap/snap_1' 2024-09-13T15:48:56.141 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:48:56.141 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:48:56.141 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:48:57.141 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:48:57.141 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_4 2024-09-13T15:48:57.141 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_4/.snap/snap_2] in ceph_repo/ceph-qa-suite_4 2024-09-13T15:48:57.142 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_4/.snap/snap_2] in ceph_repo/ceph-qa-suite_4' 2024-09-13T15:48:57.142 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:48:57.145 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:48:57.146 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_4/.snap/snap_2' 2024-09-13T15:48:57.146 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:48:57.146 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_4/.snap/snap_2 cksum 2024-09-13T15:48:57.146 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:48:57.146 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:48:57.147 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_4/.snap/snap_2 -type f -exec md5sum '{}' + 2024-09-13T15:48:57.147 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:48:57.147 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:48:57.147 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:49:01.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:49:02.603 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.43123966694663374) > weight (0.3333333333333333) 2024-09-13T15:49:02.603 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.49597592970969817) > weight (0.3333333333333333) 2024-09-13T15:49:02.603 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.8033297569311246) > weight (0.3333333333333333) 2024-09-13T15:49:02.603 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:49:12.605 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.9685700725384621) > weight (0.3333333333333333) 2024-09-13T15:49:12.605 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.5437409612798784) > weight (0.3333333333333333) 2024-09-13T15:49:12.605 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.5509339672487752) > weight (0.3333333333333333) 2024-09-13T15:49:12.605 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:49:20.050 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=4c84bf6097f8a4cf83289a5cebbaae9a 2024-09-13T15:49:20.050 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum 4c84bf6097f8a4cf83289a5cebbaae9a ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:49:20.050 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:49:20.050 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=4c84bf6097f8a4cf83289a5cebbaae9a 2024-09-13T15:49:20.050 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:49:20.051 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:49:20.051 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:49:20.051 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:49:20.052 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=7d4bec9eceadf626bdfb7360c9ab76cf 2024-09-13T15:49:20.053 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-7d4bec9eceadf626bdfb7360c9ab76cf 2024-09-13T15:49:20.054 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=4c84bf6097f8a4cf83289a5cebbaae9a 2024-09-13T15:49:20.054 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' 4c84bf6097f8a4cf83289a5cebbaae9a '!=' 4c84bf6097f8a4cf83289a5cebbaae9a ']' 2024-09-13T15:49:20.054 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:49:20.054 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:49:20.054 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:49:20.055 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_4/.snap/snap_2 (4c84bf6097f8a4cf83289a5cebbaae9a) 2024-09-13T15:49:20.055 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_4/.snap/snap_2 (4c84bf6097f8a4cf83289a5cebbaae9a)' 2024-09-13T15:49:20.055 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:49:20.055 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_4/.snap/snap_2 2024-09-13T15:49:20.056 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_4/.snap/snap_2' 2024-09-13T15:49:20.056 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:49:20.056 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:49:20.056 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:49:21.055 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:49:21.056 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_4 2024-09-13T15:49:21.056 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_4/.snap/snap_3] in ceph_repo/ceph-qa-suite_4 2024-09-13T15:49:21.057 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_4/.snap/snap_3] in ceph_repo/ceph-qa-suite_4' 2024-09-13T15:49:21.057 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:49:21.061 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:49:21.061 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_4/.snap/snap_3' 2024-09-13T15:49:21.061 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:49:21.061 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_4/.snap/snap_3 cksum 2024-09-13T15:49:21.062 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:49:21.062 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:49:21.062 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_4/.snap/snap_3 -type f -exec md5sum '{}' + 2024-09-13T15:49:21.062 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:49:21.063 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:49:21.063 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:49:22.606 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.8691842131166564) > weight (0.3333333333333333) 2024-09-13T15:49:22.606 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.870741686105531) > weight (0.3333333333333333) 2024-09-13T15:49:22.607 INFO:tasks.cephfs_mirror_thrash:kill client.mirror3 2024-09-13T15:49:22.607 INFO:tasks.cephfs_mirror.client.mirror3:Sent signal 15 2024-09-13T15:49:22.607 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:49:22.608 INFO:tasks.cephfs_mirror.client.mirror3.smithi040.stderr:2024-09-13T15:49:22.605+0000 7f3968a55640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground (PID: 38456) UID: 1000 2024-09-13T15:49:31.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:49:37.608 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror3 2024-09-13T15:49:37.608 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:49:37.608 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror3 2024-09-13T15:49:37.608 INFO:tasks.cephfs_mirror.client.mirror3:Restarting daemon 2024-09-13T15:49:37.608 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground 2024-09-13T15:49:37.611 INFO:tasks.cephfs_mirror.client.mirror3:Started 2024-09-13T15:49:37.611 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:49:40.910 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=2f928422514804cfae01b5bc763cf4b6 2024-09-13T15:49:40.910 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum 2f928422514804cfae01b5bc763cf4b6 ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:49:40.910 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:49:40.910 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=2f928422514804cfae01b5bc763cf4b6 2024-09-13T15:49:40.910 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:49:40.910 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:49:40.910 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:49:40.910 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:49:40.911 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=78fe15d313415acff3b4ab8491a32d57 2024-09-13T15:49:40.911 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-78fe15d313415acff3b4ab8491a32d57 2024-09-13T15:49:40.922 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=2f928422514804cfae01b5bc763cf4b6 2024-09-13T15:49:40.922 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' 2f928422514804cfae01b5bc763cf4b6 '!=' 2f928422514804cfae01b5bc763cf4b6 ']' 2024-09-13T15:49:40.922 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:49:40.922 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:49:40.923 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:49:40.923 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_4/.snap/snap_3 (2f928422514804cfae01b5bc763cf4b6) 2024-09-13T15:49:40.923 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_4/.snap/snap_3 (2f928422514804cfae01b5bc763cf4b6)' 2024-09-13T15:49:40.923 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:49:40.923 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_4/.snap/snap_3 2024-09-13T15:49:40.924 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_4/.snap/snap_3' 2024-09-13T15:49:40.924 INFO:tasks.workunit.client.2.smithi040.stderr:+ for j in `seq 1 $NR_SNAPSHOTS` 2024-09-13T15:49:40.924 INFO:tasks.workunit.client.2.smithi040.stderr:+ for s in 1 1 2 4 4 4 4 4 8 8 8 8 16 16 32 64 64 128 128 2024-09-13T15:49:40.924 INFO:tasks.workunit.client.2.smithi040.stderr:+ sleep 1 2024-09-13T15:49:41.924 INFO:tasks.workunit.client.2.smithi040.stderr:+ snap_name=ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:49:41.924 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_4 2024-09-13T15:49:41.924 INFO:tasks.workunit.client.2.smithi040.stdout:checking snapshot [ceph_repo/ceph-qa-suite_4/.snap/snap_4] in ceph_repo/ceph-qa-suite_4 2024-09-13T15:49:41.925 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checking snapshot [ceph_repo/ceph-qa-suite_4/.snap/snap_4] in ceph_repo/ceph-qa-suite_4' 2024-09-13T15:49:41.925 INFO:tasks.workunit.client.2.smithi040.stderr:+ test -d ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:49:41.928 INFO:tasks.workunit.client.2.smithi040.stdout:generating hash for ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:49:41.929 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'generating hash for ceph_repo/ceph-qa-suite_4/.snap/snap_4' 2024-09-13T15:49:41.929 INFO:tasks.workunit.client.2.smithi040.stderr:+ cksum= 2024-09-13T15:49:41.929 INFO:tasks.workunit.client.2.smithi040.stderr:+ calc_checksum ceph_repo/ceph-qa-suite_4/.snap/snap_4 cksum 2024-09-13T15:49:41.929 INFO:tasks.workunit.client.2.smithi040.stderr:+ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:49:41.929 INFO:tasks.workunit.client.2.smithi040.stderr:+ local -n ref=cksum 2024-09-13T15:49:41.929 INFO:tasks.workunit.client.2.smithi040.stderr:++ find -L ceph_repo/ceph-qa-suite_4/.snap/snap_4 -type f -exec md5sum '{}' + 2024-09-13T15:49:41.930 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:49:41.930 INFO:tasks.workunit.client.2.smithi040.stderr:++ md5sum 2024-09-13T15:49:41.930 INFO:tasks.workunit.client.2.smithi040.stderr:++ awk '{ print $1 }' 2024-09-13T15:49:47.613 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror1 with skip (0.8953947460267773) > weight (0.3333333333333333) 2024-09-13T15:49:47.613 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror2 with skip (0.5581119945566644) > weight (0.3333333333333333) 2024-09-13T15:49:47.613 INFO:tasks.cephfs_mirror_thrash:skipping daemon client.mirror3 with skip (0.8269693599621677) > weight (0.3333333333333333) 2024-09-13T15:49:47.613 INFO:tasks.cephfs_mirror_thrash:waiting for 10.0 secs before thrashing 2024-09-13T15:49:57.614 INFO:tasks.cephfs_mirror_thrash:kill client.mirror1 2024-09-13T15:49:57.615 INFO:tasks.cephfs_mirror.client.mirror1:Sent signal 15 2024-09-13T15:49:57.615 INFO:tasks.cephfs_mirror_thrash:waiting for 15.0 secs before reviving daemons 2024-09-13T15:49:57.616 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:49:57.613+0000 7ff2e2f1f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 38321) UID: 1000 2024-09-13T15:50:01.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:50:04.610 INFO:tasks.workunit.client.2.smithi040.stderr:+ ref=40f9817373d2e2c707636a03995b3b1c 2024-09-13T15:50:04.611 INFO:tasks.workunit.client.2.smithi040.stderr:++ compare_checksum 40f9817373d2e2c707636a03995b3b1c ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:50:04.611 INFO:tasks.workunit.client.2.smithi040.stderr:++ local ret=0 2024-09-13T15:50:04.611 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum=40f9817373d2e2c707636a03995b3b1c 2024-09-13T15:50:04.611 INFO:tasks.workunit.client.2.smithi040.stderr:++ local path=ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:50:04.612 INFO:tasks.workunit.client.2.smithi040.stderr:+++ echo -n ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:50:04.612 INFO:tasks.workunit.client.2.smithi040.stderr:+++ md5sum 2024-09-13T15:50:04.612 INFO:tasks.workunit.client.2.smithi040.stderr:+++ awk '{ print $1 }' 2024-09-13T15:50:04.623 INFO:tasks.workunit.client.2.smithi040.stderr:++ local fhash=649c91979e9b1f624b68619fd44e8b56 2024-09-13T15:50:04.624 INFO:tasks.workunit.client.2.smithi040.stderr:+++ cat /tmp/primary-649c91979e9b1f624b68619fd44e8b56 2024-09-13T15:50:04.625 INFO:tasks.workunit.client.2.smithi040.stderr:++ local cksum_ondisk=40f9817373d2e2c707636a03995b3b1c 2024-09-13T15:50:04.625 INFO:tasks.workunit.client.2.smithi040.stderr:++ '[' 40f9817373d2e2c707636a03995b3b1c '!=' 40f9817373d2e2c707636a03995b3b1c ']' 2024-09-13T15:50:04.625 INFO:tasks.workunit.client.2.smithi040.stderr:++ echo 0 2024-09-13T15:50:04.625 INFO:tasks.workunit.client.2.smithi040.stderr:+ ret=0 2024-09-13T15:50:04.625 INFO:tasks.workunit.client.2.smithi040.stderr:+ '[' 0 -ne 0 ']' 2024-09-13T15:50:04.625 INFO:tasks.workunit.client.2.smithi040.stdout:checksum matched ceph_repo/ceph-qa-suite_4/.snap/snap_4 (40f9817373d2e2c707636a03995b3b1c) 2024-09-13T15:50:04.626 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'checksum matched ceph_repo/ceph-qa-suite_4/.snap/snap_4 (40f9817373d2e2c707636a03995b3b1c)' 2024-09-13T15:50:04.626 INFO:tasks.workunit.client.2.smithi040.stderr:+ break 2024-09-13T15:50:04.626 INFO:tasks.workunit.client.2.smithi040.stdout:couldn't complete verification for: ceph_repo/ceph-qa-suite_4/.snap/snap_4 2024-09-13T15:50:04.627 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'couldn'\''t complete verification for: ceph_repo/ceph-qa-suite_4/.snap/snap_4' 2024-09-13T15:50:04.627 INFO:tasks.workunit.client.2.smithi040.stdout:verify done! 2024-09-13T15:50:04.628 INFO:tasks.workunit.client.2.smithi040.stderr:+ echo 'verify done!' 2024-09-13T15:50:04.628 INFO:tasks.workunit:Stopping ['fs/cephfs_mirror_ha_verify.sh'] on client.2... 2024-09-13T15:50:04.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.2 /home/ubuntu/cephtest/clone.client.2 2024-09-13T15:50:04.926 DEBUG:teuthology.parallel:result is None 2024-09-13T15:50:04.926 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_mirror_thrash 2024-09-13T15:50:04.938 INFO:tasks.cephfs_mirror_thrash:joining cephfs_mirror_thrash 2024-09-13T15:50:12.616 INFO:tasks.cephfs_mirror_thrash:waiting for client.mirror1 2024-09-13T15:50:12.616 INFO:teuthology.orchestra.run:waiting for 600 2024-09-13T15:50:12.617 INFO:tasks.cephfs_mirror_thrash:reviving client.mirror1 2024-09-13T15:50:12.617 INFO:tasks.cephfs_mirror.client.mirror1:Restarting daemon 2024-09-13T15:50:12.617 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground 2024-09-13T15:50:12.621 INFO:tasks.cephfs_mirror.client.mirror1:Started 2024-09-13T15:50:12.621 INFO:tasks.cephfs_mirror_thrash:stat['kill'] = 29 2024-09-13T15:50:12.621 INFO:tasks.cephfs_mirror_thrash:done joining 2024-09-13T15:50:12.621 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T15:50:12.631 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T15:50:12.632 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:50:12.632 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:50:12.639 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:50:12.639 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:50:12.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:50:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.893+0000 7fa312137640 1 Processor -- start 2024-09-13T15:50:12.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.893+0000 7fa312137640 1 -- start start 2024-09-13T15:50:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa312137640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa30c153f60 0x7fa30c0c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa312137640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c0a7850 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa312137640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c08c4f0 con 0x7fa30c153f60 2024-09-13T15:50:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa30b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa30c153f60 0x7fa30c0c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:12.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa30affd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa30c0b7bd0 0x7fa30c0c06e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37748/0 (socket says 172.21.15.40:37748) 2024-09-13T15:50:12.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa30affd640 1 -- 172.21.15.40:0/1730100533 learned_addr learned my addr 172.21.15.40:0/1730100533 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:12.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa30a7fc640 1 -- 172.21.15.40:0/1730100533 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039094816 0 0) 0x7fa30c0a7850 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa30a7fc640 1 -- 172.21.15.40:0/1730100533 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2f8003530 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa30b7fe640 1 -- 172.21.15.40:0/1730100533 >> v1:172.21.15.40:6789/0 conn(0x7fa30c0b7bd0 legacy=0x7fa30c0c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:12.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa30b7fe640 1 -- 172.21.15.40:0/1730100533 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c08bdb0 con 0x7fa30c153f60 2024-09-13T15:50:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa30b7fe640 1 --2- 172.21.15.40:0/1730100533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c153f60 0x7fa30c0c4b90 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009770 tx=0x7fa2fc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f115f941f073bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa30a7fc640 1 -- 172.21.15.40:0/1730100533 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2fc0ab530 con 0x7fa30c153f60 2024-09-13T15:50:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa30a7fc640 1 -- 172.21.15.40:0/1730100533 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc0a7050 con 0x7fa30c153f60 2024-09-13T15:50:12.902 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.897+0000 7fa30a7fc640 1 -- 172.21.15.40:0/1730100533 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2fc0ab7e0 con 0x7fa30c153f60 2024-09-13T15:50:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 -- 172.21.15.40:0/1730100533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c153f60 msgr2=0x7fa30c0c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 --2- 172.21.15.40:0/1730100533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c153f60 0x7fa30c0c4b90 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009770 tx=0x7fa2fc01c420 comp rx=0 tx=0).stop 2024-09-13T15:50:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 -- 172.21.15.40:0/1730100533 shutdown_connections 2024-09-13T15:50:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 --2- 172.21.15.40:0/1730100533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c153f60 0x7fa30c0c4b90 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 -- 172.21.15.40:0/1730100533 >> 172.21.15.40:0/1730100533 conn(0x7fa30c0a8640 msgr2=0x7fa30c065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:12.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 -- 172.21.15.40:0/1730100533 shutdown_connections 2024-09-13T15:50:12.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 -- 172.21.15.40:0/1730100533 wait complete. 2024-09-13T15:50:12.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 Processor -- start 2024-09-13T15:50:12.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 -- start start 2024-09-13T15:50:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b7bd0 0x7fa30c155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c15c8f0 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa30b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b7bd0 0x7fa30c155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa30b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b7bd0 0x7fa30c155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37248/0 (socket says 172.21.15.40:37248) 2024-09-13T15:50:12.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa30b7fe640 1 -- 172.21.15.40:0/1059511864 learned_addr learned my addr 172.21.15.40:0/1059511864 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa30b7fe640 1 -- 172.21.15.40:0/1059511864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc009420 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa30b7fe640 1 --2- 172.21.15.40:0/1059511864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b7bd0 0x7fa30c155290 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc01a050 tx=0x7fa2fc01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa303fff640 1 -- 172.21.15.40:0/1059511864 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2fc0abe10 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa303fff640 1 -- 172.21.15.40:0/1059511864 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2fc0b7450 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 -- 172.21.15.40:0/1059511864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30c155880 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa303fff640 1 -- 172.21.15.40:0/1059511864 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2fc0b76f0 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.901+0000 7fa312137640 1 -- 172.21.15.40:0/1059511864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c15f7b0 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.905+0000 7fa312137640 1 -- 172.21.15.40:0/1059511864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30c067510 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.905+0000 7fa303fff640 1 -- 172.21.15.40:0/1059511864 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7fa2fc0b7850 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.905+0000 7fa303fff640 1 --2- 172.21.15.40:0/1059511864 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fa2ec035530 0x7fa2ec0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.905+0000 7fa303fff640 1 -- 172.21.15.40:0/1059511864 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fa2fc0e2bd0 con 0x7fa30c0b7bd0 2024-09-13T15:50:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.905+0000 7fa30affd640 1 --2- 172.21.15.40:0/1059511864 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fa2ec035530 0x7fa2ec0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:12.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.905+0000 7fa30affd640 1 --2- 172.21.15.40:0/1059511864 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fa2ec035530 0x7fa2ec0379f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4007fd0 tx=0x7fa2f4007980 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:12.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:12.909+0000 7fa303fff640 1 -- 172.21.15.40:0/1059511864 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa2fc0c74e0 con 0x7fa30c0b7bd0 2024-09-13T15:50:13.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.069+0000 7fa312137640 1 -- 172.21.15.40:0/1059511864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa30c0720a0 con 0x7fa30c0b7bd0 2024-09-13T15:50:13.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.073+0000 7fa303fff640 1 -- 172.21.15.40:0/1059511864 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+19969 (secure 0 0 0) 0x7fa2fc0b0090 con 0x7fa30c0b7bd0 2024-09-13T15:50:13.074 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:50:13.074 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":51,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:49:52.917821+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.2699999809265137,"score_stable":1.2699999809265137,"optimal_score":1,"raw_score_acting":1.2699999809265137,"raw_score_stable":1.2699999809265137,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs.dc.meta","create_time":"2024-09-13T15:34:54.455347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"dc"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs.dc.data","create_time":"2024-09-13T15:34:55.209802+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"dc"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs.dc-backup.meta","create_time":"2024-09-13T15:34:56.580392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"dc-backup"}},"read_balance":{"score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs.dc-backup.data","create_time":"2024-09-13T15:34:57.245673+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"dc-backup"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1c","mappings":[{"from":0,"to":2}]},{"pgid":"3.24","mappings":[{"from":0,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3464899269":"2024-09-13T16:49:52.021920+0000","172.21.15.40:0/2020191347":"2024-09-13T16:39:12.695853+0000","172.21.15.40:0/3215060720":"2024-09-13T16:37:48.656072+0000","172.21.15.40:0/2096071371":"2024-09-13T16:41:43.833379+0000","172.21.15.40:0/1024811135":"2024-09-13T16:46:02.884335+0000","172.21.15.40:0/1371435748":"2024-09-13T16:49:08.427332+0000","172.21.15.40:0/1725367853":"2024-09-13T16:38:36.652988+0000","172.21.15.40:0/2070755866":"2024-09-13T16:38:12.598575+0000","172.21.15.40:0/695475091":"2024-09-13T16:40:02.785567+0000","172.21.15.40:0/276304017":"2024-09-13T16:45:37.498754+0000","172.21.15.40:0/3286012502":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/2241829794":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/2301478808":"2024-09-13T16:40:27.738146+0000","172.21.15.40:6824/3185150828":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/690822190":"2024-09-13T16:39:37.683949+0000","172.21.15.40:0/414904326":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/3777702470":"2024-09-13T16:43:17.229644+0000","172.21.15.40:0/3514360215":"2024-09-13T16:44:32.325869+0000","172.21.15.40:0/3853947452":"2024-09-13T16:46:26.907170+0000","172.21.15.40:0/1991235795":"2024-09-13T16:40:52.760615+0000","172.21.15.40:6825/3185150828":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/1455634917":"2024-09-13T16:47:13.340610+0000","172.21.15.40:0/2753473479":"2024-09-13T16:42:16.865910+0000","172.21.15.40:0/3230130657":"2024-09-13T16:42:51.908956+0000","172.21.15.40:0/3833267415":"2024-09-13T16:48:42.495533+0000","172.21.15.40:0/1708466797":"2024-09-13T16:43:42.271124+0000","172.21.15.40:0/3629684271":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/3494260782":"2024-09-13T16:41:17.861368+0000","172.21.15.40:0/1861863246":"2024-09-13T16:44:07.288889+0000","172.21.15.40:0/1129415438":"2024-09-13T16:47:37.323733+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:50:13.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.073+0000 7fa312137640 1 -- 172.21.15.40:0/1059511864 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fa2ec035530 msgr2=0x7fa2ec0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:13.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.073+0000 7fa312137640 1 --2- 172.21.15.40:0/1059511864 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fa2ec035530 0x7fa2ec0379f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4007fd0 tx=0x7fa2f4007980 comp rx=0 tx=0).stop 2024-09-13T15:50:13.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.073+0000 7fa312137640 1 -- 172.21.15.40:0/1059511864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b7bd0 msgr2=0x7fa30c155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:13.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.073+0000 7fa312137640 1 --2- 172.21.15.40:0/1059511864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b7bd0 0x7fa30c155290 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc01a050 tx=0x7fa2fc01ac60 comp rx=0 tx=0).stop 2024-09-13T15:50:13.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.073+0000 7fa312137640 1 -- 172.21.15.40:0/1059511864 shutdown_connections 2024-09-13T15:50:13.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.073+0000 7fa312137640 1 --2- 172.21.15.40:0/1059511864 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fa2ec035530 0x7fa2ec0379f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:13.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.073+0000 7fa312137640 1 --2- 172.21.15.40:0/1059511864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa30c0b7bd0 0x7fa30c155290 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:13.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.073+0000 7fa312137640 1 -- 172.21.15.40:0/1059511864 >> 172.21.15.40:0/1059511864 conn(0x7fa30c0a8640 msgr2=0x7fa30c153540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:13.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.073+0000 7fa312137640 1 -- 172.21.15.40:0/1059511864 shutdown_connections 2024-09-13T15:50:13.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.073+0000 7fa312137640 1 -- 172.21.15.40:0/1059511864 wait complete. 2024-09-13T15:50:13.092 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:34:25.125767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:34:33.833957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:34:34.276037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.2699999809265137, 'score_stable': 1.2699999809265137, 'optimal_score': 1, 'raw_score_acting': 1.2699999809265137, 'raw_score_stable': 1.2699999809265137, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs.dc.meta', 'create_time': '2024-09-13T15:34:54.455347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'dc'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs.dc.data', 'create_time': '2024-09-13T15:34:55.209802+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'dc'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs.dc-backup.meta', 'create_time': '2024-09-13T15:34:56.580392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'dc-backup'}}, 'read_balance': {'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs.dc-backup.data', 'create_time': '2024-09-13T15:34:57.245673+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'dc-backup'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:50:13.093 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:50:13.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.221+0000 7f95a5d3f640 1 Processor -- start 2024-09-13T15:50:13.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.221+0000 7f95a5d3f640 1 -- start start 2024-09-13T15:50:13.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.221+0000 7f95a5d3f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95a00b4600 0x7f95a014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:13.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.221+0000 7f95a5d3f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a00c1130 con 0x7f95a014e280 2024-09-13T15:50:13.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.221+0000 7f95a5d3f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a014e780 con 0x7f95a00b4600 2024-09-13T15:50:13.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.221+0000 7f959f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95a00b4600 0x7f95a014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:13.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.221+0000 7f959effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f95a014e280 0x7f95a00bf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37760/0 (socket says 172.21.15.40:37760) 2024-09-13T15:50:13.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.221+0000 7f959effd640 1 -- 172.21.15.40:0/410461775 learned_addr learned my addr 172.21.15.40:0/410461775 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:13.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.221+0000 7f959f7fe640 1 -- 172.21.15.40:0/410461775 >> v1:172.21.15.40:6789/0 conn(0x7f95a014e280 legacy=0x7f95a00bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:13.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.221+0000 7f959f7fe640 1 -- 172.21.15.40:0/410461775 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a00b59f0 con 0x7f95a00b4600 2024-09-13T15:50:13.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.221+0000 7f959e7fc640 1 -- 172.21.15.40:0/410461775 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077272098 0 0) 0x7f95a00c1130 con 0x7f95a014e280 2024-09-13T15:50:13.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.221+0000 7f959f7fe640 1 --2- 172.21.15.40:0/410461775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a00b4600 0x7f95a014dd40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f9590009740 tx=0x7f959001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb8a2b5bea80c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:13.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f959e7fc640 1 -- 172.21.15.40:0/410461775 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95900ab530 con 0x7f95a00b4600 2024-09-13T15:50:13.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f959e7fc640 1 -- 172.21.15.40:0/410461775 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95900a7050 con 0x7f95a00b4600 2024-09-13T15:50:13.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f959e7fc640 1 -- 172.21.15.40:0/410461775 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95900ab7e0 con 0x7f95a00b4600 2024-09-13T15:50:13.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 -- 172.21.15.40:0/410461775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a00b4600 msgr2=0x7f95a014dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:13.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 --2- 172.21.15.40:0/410461775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a00b4600 0x7f95a014dd40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f9590009740 tx=0x7f959001c390 comp rx=0 tx=0).stop 2024-09-13T15:50:13.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 -- 172.21.15.40:0/410461775 shutdown_connections 2024-09-13T15:50:13.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 --2- 172.21.15.40:0/410461775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a00b4600 0x7f95a014dd40 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:13.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 -- 172.21.15.40:0/410461775 >> 172.21.15.40:0/410461775 conn(0x7f95a006a540 msgr2=0x7f95a00a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:13.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 -- 172.21.15.40:0/410461775 shutdown_connections 2024-09-13T15:50:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 -- 172.21.15.40:0/410461775 wait complete. 2024-09-13T15:50:13.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 Processor -- start 2024-09-13T15:50:13.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 -- start start 2024-09-13T15:50:13.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a00b4600 0x7f95a006ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:13.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a006e570 con 0x7f95a00b4600 2024-09-13T15:50:13.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f959f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a00b4600 0x7f95a006ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:13.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f959f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a00b4600 0x7f95a006ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37274/0 (socket says 172.21.15.40:37274) 2024-09-13T15:50:13.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f959f7fe640 1 -- 172.21.15.40:0/4133371404 learned_addr learned my addr 172.21.15.40:0/4133371404 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:13.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f959f7fe640 1 -- 172.21.15.40:0/4133371404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9590009420 con 0x7f95a00b4600 2024-09-13T15:50:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f959f7fe640 1 --2- 172.21.15.40:0/4133371404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a00b4600 0x7f95a006ea30 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f9590019fc0 tx=0x7f959001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f9587fff640 1 -- 172.21.15.40:0/4133371404 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95900b7450 con 0x7f95a00b4600 2024-09-13T15:50:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f9587fff640 1 -- 172.21.15.40:0/4133371404 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95900b75b0 con 0x7f95a00b4600 2024-09-13T15:50:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f9587fff640 1 -- 172.21.15.40:0/4133371404 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f95900b7850 con 0x7f95a00b4600 2024-09-13T15:50:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 -- 172.21.15.40:0/4133371404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a00b77b0 con 0x7f95a00b4600 2024-09-13T15:50:13.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.225+0000 7f95a5d3f640 1 -- 172.21.15.40:0/4133371404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a0140b80 con 0x7f95a00b4600 2024-09-13T15:50:13.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.229+0000 7f95a5d3f640 1 -- 172.21.15.40:0/4133371404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a014dd40 con 0x7f95a00b4600 2024-09-13T15:50:13.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.229+0000 7f9587fff640 1 -- 172.21.15.40:0/4133371404 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f95900b79b0 con 0x7f95a00b4600 2024-09-13T15:50:13.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.229+0000 7f9587fff640 1 --2- 172.21.15.40:0/4133371404 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f958c035530 0x7f958c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:13.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.229+0000 7f9587fff640 1 -- 172.21.15.40:0/4133371404 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f95900e2f20 con 0x7f95a00b4600 2024-09-13T15:50:13.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.229+0000 7f959effd640 1 --2- 172.21.15.40:0/4133371404 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f958c035530 0x7f958c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:13.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.229+0000 7f959effd640 1 --2- 172.21.15.40:0/4133371404 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f958c035530 0x7f958c0379f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9594007fd0 tx=0x7f9594007920 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:13.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.233+0000 7f9587fff640 1 -- 172.21.15.40:0/4133371404 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f95900c76c0 con 0x7f95a00b4600 2024-09-13T15:50:13.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.385+0000 7f95a5d3f640 1 -- 172.21.15.40:0/4133371404 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95a00a3b40 con 0x7f95a00b4600 2024-09-13T15:50:13.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.385+0000 7f9587fff640 1 -- 172.21.15.40:0/4133371404 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95900b0070 con 0x7f95a00b4600 2024-09-13T15:50:13.389 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-09-13T15:50:13.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.389+0000 7f95a5d3f640 1 -- 172.21.15.40:0/4133371404 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f958c035530 msgr2=0x7f958c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:13.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.389+0000 7f95a5d3f640 1 --2- 172.21.15.40:0/4133371404 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f958c035530 0x7f958c0379f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9594007fd0 tx=0x7f9594007920 comp rx=0 tx=0).stop 2024-09-13T15:50:13.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.389+0000 7f95a5d3f640 1 -- 172.21.15.40:0/4133371404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a00b4600 msgr2=0x7f95a006ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:13.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.389+0000 7f95a5d3f640 1 --2- 172.21.15.40:0/4133371404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a00b4600 0x7f95a006ea30 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f9590019fc0 tx=0x7f959001abd0 comp rx=0 tx=0).stop 2024-09-13T15:50:13.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.389+0000 7f95a5d3f640 1 -- 172.21.15.40:0/4133371404 shutdown_connections 2024-09-13T15:50:13.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.389+0000 7f95a5d3f640 1 --2- 172.21.15.40:0/4133371404 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f958c035530 0x7f958c0379f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:13.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.389+0000 7f95a5d3f640 1 --2- 172.21.15.40:0/4133371404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95a00b4600 0x7f95a006ea30 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:13.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.389+0000 7f95a5d3f640 1 -- 172.21.15.40:0/4133371404 >> 172.21.15.40:0/4133371404 conn(0x7f95a006a540 msgr2=0x7f95a0143a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:13.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.389+0000 7f95a5d3f640 1 -- 172.21.15.40:0/4133371404 shutdown_connections 2024-09-13T15:50:13.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.389+0000 7f95a5d3f640 1 -- 172.21.15.40:0/4133371404 wait complete. 2024-09-13T15:50:13.407 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:50:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.529+0000 7ff40a7d5640 1 Processor -- start 2024-09-13T15:50:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.533+0000 7ff40a7d5640 1 -- start start 2024-09-13T15:50:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.533+0000 7ff40a7d5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff40414f3d0 0x7ff4040b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.533+0000 7ff40a7d5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4040b48d0 con 0x7ff40406f400 2024-09-13T15:50:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.533+0000 7ff40a7d5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4040b5240 con 0x7ff40414f3d0 2024-09-13T15:50:13.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.533+0000 7ff403fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff40414f3d0 0x7ff4040b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.533+0000 7ff3fb7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff40406f400 0x7ff40406e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37764/0 (socket says 172.21.15.40:37764) 2024-09-13T15:50:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.533+0000 7ff3fb7fe640 1 -- 172.21.15.40:0/2680220411 learned_addr learned my addr 172.21.15.40:0/2680220411 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.533+0000 7ff403fff640 1 -- 172.21.15.40:0/2680220411 >> v1:172.21.15.40:6789/0 conn(0x7ff40406f400 legacy=0x7ff40406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:13.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.533+0000 7ff403fff640 1 -- 172.21.15.40:0/2680220411 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40414e7b0 con 0x7ff40414f3d0 2024-09-13T15:50:13.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.533+0000 7ff403fff640 1 --2- 172.21.15.40:0/2680220411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40414f3d0 0x7ff4040b4d00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009740 tx=0x7ff3f401c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2689762f7e2ffe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:13.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.533+0000 7ff4037fe640 1 -- 172.21.15.40:0/2680220411 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3f40ab530 con 0x7ff40414f3d0 2024-09-13T15:50:13.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff4037fe640 1 -- 172.21.15.40:0/2680220411 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f40a7050 con 0x7ff40414f3d0 2024-09-13T15:50:13.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff4037fe640 1 -- 172.21.15.40:0/2680220411 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3f40ab7e0 con 0x7ff40414f3d0 2024-09-13T15:50:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 -- 172.21.15.40:0/2680220411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40414f3d0 msgr2=0x7ff4040b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 --2- 172.21.15.40:0/2680220411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40414f3d0 0x7ff4040b4d00 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009740 tx=0x7ff3f401c220 comp rx=0 tx=0).stop 2024-09-13T15:50:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 -- 172.21.15.40:0/2680220411 shutdown_connections 2024-09-13T15:50:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 --2- 172.21.15.40:0/2680220411 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40414f3d0 0x7ff4040b4d00 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 -- 172.21.15.40:0/2680220411 >> 172.21.15.40:0/2680220411 conn(0x7ff40406a540 msgr2=0x7ff4040a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 -- 172.21.15.40:0/2680220411 shutdown_connections 2024-09-13T15:50:13.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 -- 172.21.15.40:0/2680220411 wait complete. 2024-09-13T15:50:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 Processor -- start 2024-09-13T15:50:13.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 -- start start 2024-09-13T15:50:13.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40406f400 0x7ff4040a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:13.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40414b2a0 con 0x7ff40406f400 2024-09-13T15:50:13.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff403fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40406f400 0x7ff4040a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:13.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff403fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40406f400 0x7ff4040a3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37294/0 (socket says 172.21.15.40:37294) 2024-09-13T15:50:13.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff403fff640 1 -- 172.21.15.40:0/3594302325 learned_addr learned my addr 172.21.15.40:0/3594302325 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:13.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff403fff640 1 -- 172.21.15.40:0/3594302325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f4009420 con 0x7ff40406f400 2024-09-13T15:50:13.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff403fff640 1 --2- 172.21.15.40:0/3594302325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40406f400 0x7ff4040a3900 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4018e30 tx=0x7ff3f401aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:13.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff4017fa640 1 -- 172.21.15.40:0/3594302325 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3f40b7450 con 0x7ff40406f400 2024-09-13T15:50:13.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff4017fa640 1 -- 172.21.15.40:0/3594302325 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f40b75d0 con 0x7ff40406f400 2024-09-13T15:50:13.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 -- 172.21.15.40:0/3594302325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40414ade0 con 0x7ff40406f400 2024-09-13T15:50:13.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff4017fa640 1 -- 172.21.15.40:0/3594302325 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3f40b78b0 con 0x7ff40406f400 2024-09-13T15:50:13.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.537+0000 7ff40a7d5640 1 -- 172.21.15.40:0/3594302325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff404070030 con 0x7ff40406f400 2024-09-13T15:50:13.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.541+0000 7ff40a7d5640 1 -- 172.21.15.40:0/3594302325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4040b4d00 con 0x7ff40406f400 2024-09-13T15:50:13.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.541+0000 7ff4017fa640 1 -- 172.21.15.40:0/3594302325 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7ff3f40b7a10 con 0x7ff40406f400 2024-09-13T15:50:13.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.541+0000 7ff4017fa640 1 --2- 172.21.15.40:0/3594302325 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff3e4035530 0x7ff3e40379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:13.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.541+0000 7ff4017fa640 1 -- 172.21.15.40:0/3594302325 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7ff3f40e2cc0 con 0x7ff40406f400 2024-09-13T15:50:13.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.541+0000 7ff3fb7fe640 1 --2- 172.21.15.40:0/3594302325 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff3e4035530 0x7ff3e40379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:13.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.541+0000 7ff3fb7fe640 1 --2- 172.21.15.40:0/3594302325 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff3e4035530 0x7ff3e40379f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec001800 tx=0x7ff3ec007a10 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:13.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.545+0000 7ff4017fa640 1 -- 172.21.15.40:0/3594302325 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3f40c74e0 con 0x7ff40406f400 2024-09-13T15:50:13.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.705+0000 7ff40a7d5640 1 -- 172.21.15.40:0/3594302325 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff40414af70 con 0x7ff40406f400 2024-09-13T15:50:13.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.705+0000 7ff4017fa640 1 -- 172.21.15.40:0/3594302325 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3f40b00a0 con 0x7ff40406f400 2024-09-13T15:50:13.709 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.709+0000 7ff40a7d5640 1 -- 172.21.15.40:0/3594302325 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff3e4035530 msgr2=0x7ff3e40379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.709+0000 7ff40a7d5640 1 --2- 172.21.15.40:0/3594302325 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff3e4035530 0x7ff3e40379f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec001800 tx=0x7ff3ec007a10 comp rx=0 tx=0).stop 2024-09-13T15:50:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.709+0000 7ff40a7d5640 1 -- 172.21.15.40:0/3594302325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40406f400 msgr2=0x7ff4040a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.709+0000 7ff40a7d5640 1 --2- 172.21.15.40:0/3594302325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40406f400 0x7ff4040a3900 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4018e30 tx=0x7ff3f401aa60 comp rx=0 tx=0).stop 2024-09-13T15:50:13.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.709+0000 7ff40a7d5640 1 -- 172.21.15.40:0/3594302325 shutdown_connections 2024-09-13T15:50:13.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.709+0000 7ff40a7d5640 1 --2- 172.21.15.40:0/3594302325 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff3e4035530 0x7ff3e40379f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:13.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.709+0000 7ff40a7d5640 1 --2- 172.21.15.40:0/3594302325 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff40406f400 0x7ff4040a3900 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:13.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.709+0000 7ff40a7d5640 1 -- 172.21.15.40:0/3594302325 >> 172.21.15.40:0/3594302325 conn(0x7ff40406a540 msgr2=0x7ff4040a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:13.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.709+0000 7ff40a7d5640 1 -- 172.21.15.40:0/3594302325 shutdown_connections 2024-09-13T15:50:13.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.709+0000 7ff40a7d5640 1 -- 172.21.15.40:0/3594302325 wait complete. 2024-09-13T15:50:13.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:50:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.841+0000 7f2e704ab640 1 Processor -- start 2024-09-13T15:50:13.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.841+0000 7f2e704ab640 1 -- start start 2024-09-13T15:50:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.841+0000 7f2e704ab640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e6806c390 0x7f2e680be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:13.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.841+0000 7f2e704ab640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e680b8480 con 0x7f2e6806c770 2024-09-13T15:50:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.841+0000 7f2e704ab640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e680ba640 con 0x7f2e6806c390 2024-09-13T15:50:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.841+0000 7f2e6e247640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e6806c390 0x7f2e680be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.841+0000 7f2e6da46640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2e6806c770 0x7f2e680b9640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54204/0 (socket says 172.21.15.40:54204) 2024-09-13T15:50:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.841+0000 7f2e6da46640 1 -- 172.21.15.40:0/233842914 learned_addr learned my addr 172.21.15.40:0/233842914 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.841+0000 7f2e6e247640 1 -- 172.21.15.40:0/233842914 >> v1:172.21.15.40:6789/0 conn(0x7f2e6806c770 legacy=0x7f2e680b9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.841+0000 7f2e6d245640 1 -- 172.21.15.40:0/233842914 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995523608 0 0) 0x7f2e680b8480 con 0x7f2e6806c770 2024-09-13T15:50:13.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.841+0000 7f2e6e247640 1 -- 172.21.15.40:0/233842914 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e680bf000 con 0x7f2e6806c390 2024-09-13T15:50:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.841+0000 7f2e6e247640 1 --2- 172.21.15.40:0/233842914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e6806c390 0x7f2e680be1a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009740 tx=0x7f2e6401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267b1dd81fdcd335 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e6d245640 1 -- 172.21.15.40:0/233842914 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e640ab400 con 0x7f2e6806c390 2024-09-13T15:50:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e6d245640 1 -- 172.21.15.40:0/233842914 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e640ab560 con 0x7f2e6806c390 2024-09-13T15:50:13.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e6d245640 1 -- 172.21.15.40:0/233842914 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e640ab820 con 0x7f2e6806c390 2024-09-13T15:50:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 -- 172.21.15.40:0/233842914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e6806c390 msgr2=0x7f2e680be1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 --2- 172.21.15.40:0/233842914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e6806c390 0x7f2e680be1a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009740 tx=0x7f2e6401c420 comp rx=0 tx=0).stop 2024-09-13T15:50:13.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 -- 172.21.15.40:0/233842914 shutdown_connections 2024-09-13T15:50:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 --2- 172.21.15.40:0/233842914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e6806c390 0x7f2e680be1a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 -- 172.21.15.40:0/233842914 >> 172.21.15.40:0/233842914 conn(0x7f2e68070c80 msgr2=0x7f2e68071090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 -- 172.21.15.40:0/233842914 shutdown_connections 2024-09-13T15:50:13.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 -- 172.21.15.40:0/233842914 wait complete. 2024-09-13T15:50:13.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 Processor -- start 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 -- start start 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e6806c390 0x7f2e681548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e68154e30 con 0x7f2e6806c390 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e6e247640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e6806c390 0x7f2e681548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e6e247640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e6806c390 0x7f2e681548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41438/0 (socket says 172.21.15.40:41438) 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e6e247640 1 -- 172.21.15.40:0/3431611957 learned_addr learned my addr 172.21.15.40:0/3431611957 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e6e247640 1 -- 172.21.15.40:0/3431611957 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64009420 con 0x7f2e6806c390 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e6e247640 1 --2- 172.21.15.40:0/3431611957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e6806c390 0x7f2e681548f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2e6401a050 tx=0x7f2e6401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e5effd640 1 -- 172.21.15.40:0/3431611957 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e64006e20 con 0x7f2e6806c390 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e5effd640 1 -- 172.21.15.40:0/3431611957 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e640b9070 con 0x7f2e6806c390 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 -- 172.21.15.40:0/3431611957 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e68154450 con 0x7f2e6806c390 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e5effd640 1 -- 172.21.15.40:0/3431611957 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e64004150 con 0x7f2e6806c390 2024-09-13T15:50:13.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.845+0000 7f2e704ab640 1 -- 172.21.15.40:0/3431611957 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e68154090 con 0x7f2e6806c390 2024-09-13T15:50:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.849+0000 7f2e704ab640 1 -- 172.21.15.40:0/3431611957 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e680be1a0 con 0x7f2e6806c390 2024-09-13T15:50:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.849+0000 7f2e5effd640 1 -- 172.21.15.40:0/3431611957 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f2e640042b0 con 0x7f2e6806c390 2024-09-13T15:50:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.849+0000 7f2e5effd640 1 --2- 172.21.15.40:0/3431611957 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2e4c035530 0x7f2e4c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.849+0000 7f2e5effd640 1 -- 172.21.15.40:0/3431611957 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f2e640bb070 con 0x7f2e6806c390 2024-09-13T15:50:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.849+0000 7f2e6da46640 1 --2- 172.21.15.40:0/3431611957 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2e4c035530 0x7f2e4c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:13.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.849+0000 7f2e6da46640 1 --2- 172.21.15.40:0/3431611957 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2e4c035530 0x7f2e4c0379f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2e58007fd0 tx=0x7f2e58007920 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:13.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:13.853+0000 7f2e5effd640 1 -- 172.21.15.40:0/3431611957 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2e640c77c0 con 0x7f2e6806c390 2024-09-13T15:50:14.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.013+0000 7f2e704ab640 1 -- 172.21.15.40:0/3431611957 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e68160330 con 0x7f2e6806c390 2024-09-13T15:50:14.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.013+0000 7f2e5effd640 1 -- 172.21.15.40:0/3431611957 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e640c77c0 con 0x7f2e6806c390 2024-09-13T15:50:14.018 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-09-13T15:50:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.017+0000 7f2e704ab640 1 -- 172.21.15.40:0/3431611957 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2e4c035530 msgr2=0x7f2e4c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.017+0000 7f2e704ab640 1 --2- 172.21.15.40:0/3431611957 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2e4c035530 0x7f2e4c0379f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2e58007fd0 tx=0x7f2e58007920 comp rx=0 tx=0).stop 2024-09-13T15:50:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.017+0000 7f2e704ab640 1 -- 172.21.15.40:0/3431611957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e6806c390 msgr2=0x7f2e681548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.017+0000 7f2e704ab640 1 --2- 172.21.15.40:0/3431611957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e6806c390 0x7f2e681548f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f2e6401a050 tx=0x7f2e6401ac60 comp rx=0 tx=0).stop 2024-09-13T15:50:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.017+0000 7f2e704ab640 1 -- 172.21.15.40:0/3431611957 shutdown_connections 2024-09-13T15:50:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.017+0000 7f2e704ab640 1 --2- 172.21.15.40:0/3431611957 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2e4c035530 0x7f2e4c0379f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.017+0000 7f2e704ab640 1 --2- 172.21.15.40:0/3431611957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e6806c390 0x7f2e681548f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.017+0000 7f2e704ab640 1 -- 172.21.15.40:0/3431611957 >> 172.21.15.40:0/3431611957 conn(0x7f2e68070c80 msgr2=0x7f2e6814c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.017+0000 7f2e704ab640 1 -- 172.21.15.40:0/3431611957 shutdown_connections 2024-09-13T15:50:14.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.017+0000 7f2e704ab640 1 -- 172.21.15.40:0/3431611957 wait complete. 2024-09-13T15:50:14.037 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc.meta pg_num 2024-09-13T15:50:14.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.161+0000 7f564c16d640 1 Processor -- start 2024-09-13T15:50:14.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.161+0000 7f564c16d640 1 -- start start 2024-09-13T15:50:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.161+0000 7f564c16d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56440c0910 0x7f564406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.161+0000 7f564c16d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564406c600 con 0x7f56440a5f10 2024-09-13T15:50:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.161+0000 7f564c16d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564406c910 con 0x7f56440c0910 2024-09-13T15:50:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.161+0000 7f5649f09640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56440c0910 0x7f564406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.161+0000 7f5649708640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f56440a5f10 0x7f56440ba2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54214/0 (socket says 172.21.15.40:54214) 2024-09-13T15:50:14.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.161+0000 7f5649708640 1 -- 172.21.15.40:0/2612504878 learned_addr learned my addr 172.21.15.40:0/2612504878 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:14.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.161+0000 7f5649f09640 1 -- 172.21.15.40:0/2612504878 >> v1:172.21.15.40:6789/0 conn(0x7f56440a5f10 legacy=0x7f56440ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.161+0000 7f5649f09640 1 -- 172.21.15.40:0/2612504878 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440baf70 con 0x7f56440c0910 2024-09-13T15:50:14.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.161+0000 7f5648f07640 1 -- 172.21.15.40:0/2612504878 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478214445 0 0) 0x7f564406c600 con 0x7f56440a5f10 2024-09-13T15:50:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.165+0000 7f5649f09640 1 --2- 172.21.15.40:0/2612504878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56440c0910 0x7f564406cb70 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5640009740 tx=0x7f564001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d0d932178616c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.165+0000 7f5648f07640 1 -- 172.21.15.40:0/2612504878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56400ab530 con 0x7f56440c0910 2024-09-13T15:50:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.165+0000 7f5648f07640 1 -- 172.21.15.40:0/2612504878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56400a7050 con 0x7f56440c0910 2024-09-13T15:50:14.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.165+0000 7f5648f07640 1 -- 172.21.15.40:0/2612504878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56400ab7e0 con 0x7f56440c0910 2024-09-13T15:50:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.165+0000 7f564c16d640 1 -- 172.21.15.40:0/2612504878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56440c0910 msgr2=0x7f564406cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.165+0000 7f564c16d640 1 --2- 172.21.15.40:0/2612504878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56440c0910 0x7f564406cb70 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f5640009740 tx=0x7f564001c420 comp rx=0 tx=0).stop 2024-09-13T15:50:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.165+0000 7f564c16d640 1 -- 172.21.15.40:0/2612504878 shutdown_connections 2024-09-13T15:50:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.165+0000 7f564c16d640 1 --2- 172.21.15.40:0/2612504878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56440c0910 0x7f564406cb70 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.165+0000 7f564c16d640 1 -- 172.21.15.40:0/2612504878 >> 172.21.15.40:0/2612504878 conn(0x7f5644065d40 msgr2=0x7f5644066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.165+0000 7f564c16d640 1 -- 172.21.15.40:0/2612504878 shutdown_connections 2024-09-13T15:50:14.169 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.165+0000 7f564c16d640 1 -- 172.21.15.40:0/2612504878 wait complete. 2024-09-13T15:50:14.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.165+0000 7f564c16d640 1 Processor -- start 2024-09-13T15:50:14.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f564c16d640 1 -- start start 2024-09-13T15:50:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f564c16d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56440a5f10 0x7f5644149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f564c16d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5644149510 con 0x7f56440a5f10 2024-09-13T15:50:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f5649f09640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56440a5f10 0x7f5644149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f5649f09640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56440a5f10 0x7f5644149be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41458/0 (socket says 172.21.15.40:41458) 2024-09-13T15:50:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f5649f09640 1 -- 172.21.15.40:0/1215637523 learned_addr learned my addr 172.21.15.40:0/1215637523 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f5649f09640 1 -- 172.21.15.40:0/1215637523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5640009420 con 0x7f56440a5f10 2024-09-13T15:50:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f5649f09640 1 --2- 172.21.15.40:0/1215637523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56440a5f10 0x7f5644149be0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f56400ae040 tx=0x7f56400191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f563a7fc640 1 -- 172.21.15.40:0/1215637523 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56400b4410 con 0x7f56440a5f10 2024-09-13T15:50:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f563a7fc640 1 -- 172.21.15.40:0/1215637523 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56400b4570 con 0x7f56440a5f10 2024-09-13T15:50:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f564c16d640 1 -- 172.21.15.40:0/1215637523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564414fb30 con 0x7f56440a5f10 2024-09-13T15:50:14.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f563a7fc640 1 -- 172.21.15.40:0/1215637523 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56400b4850 con 0x7f56440a5f10 2024-09-13T15:50:14.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f564c16d640 1 -- 172.21.15.40:0/1215637523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5644145990 con 0x7f56440a5f10 2024-09-13T15:50:14.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f564c16d640 1 -- 172.21.15.40:0/1215637523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56440bf620 con 0x7f56440a5f10 2024-09-13T15:50:14.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f563a7fc640 1 -- 172.21.15.40:0/1215637523 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f56400b2040 con 0x7f56440a5f10 2024-09-13T15:50:14.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f563a7fc640 1 --2- 172.21.15.40:0/1215637523 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f5628035530 0x7f56280379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:14.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f563a7fc640 1 -- 172.21.15.40:0/1215637523 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f56400e2630 con 0x7f56440a5f10 2024-09-13T15:50:14.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f5649708640 1 --2- 172.21.15.40:0/1215637523 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f5628035530 0x7f56280379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:14.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.169+0000 7f5649708640 1 --2- 172.21.15.40:0/1215637523 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f5628035530 0x7f56280379f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5634007fd0 tx=0x7f5634007920 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:14.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.173+0000 7f563a7fc640 1 -- 172.21.15.40:0/1215637523 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56400b4d30 con 0x7f56440a5f10 2024-09-13T15:50:14.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.333+0000 7f564c16d640 1 -- 172.21.15.40:0/1215637523 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc.meta", "var": "pg_num"} v 0) v1 -- 0x7f564406c600 con 0x7f56440a5f10 2024-09-13T15:50:14.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.333+0000 7f563a7fc640 1 -- 172.21.15.40:0/1215637523 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc.meta", "var": "pg_num"}]=0 v51) v1 ==== 103+0+11 (secure 0 0 0) 0x7f56400b0020 con 0x7f56440a5f10 2024-09-13T15:50:14.337 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:14.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.337+0000 7f564c16d640 1 -- 172.21.15.40:0/1215637523 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f5628035530 msgr2=0x7f56280379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.337+0000 7f564c16d640 1 --2- 172.21.15.40:0/1215637523 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f5628035530 0x7f56280379f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5634007fd0 tx=0x7f5634007920 comp rx=0 tx=0).stop 2024-09-13T15:50:14.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.337+0000 7f564c16d640 1 -- 172.21.15.40:0/1215637523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56440a5f10 msgr2=0x7f5644149be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.337+0000 7f564c16d640 1 --2- 172.21.15.40:0/1215637523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56440a5f10 0x7f5644149be0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f56400ae040 tx=0x7f56400191c0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.337+0000 7f564c16d640 1 -- 172.21.15.40:0/1215637523 shutdown_connections 2024-09-13T15:50:14.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.337+0000 7f564c16d640 1 --2- 172.21.15.40:0/1215637523 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f5628035530 0x7f56280379f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.337+0000 7f564c16d640 1 --2- 172.21.15.40:0/1215637523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56440a5f10 0x7f5644149be0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.337+0000 7f564c16d640 1 -- 172.21.15.40:0/1215637523 >> 172.21.15.40:0/1215637523 conn(0x7f5644065d40 msgr2=0x7f5644150800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:14.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.337+0000 7f564c16d640 1 -- 172.21.15.40:0/1215637523 shutdown_connections 2024-09-13T15:50:14.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.337+0000 7f564c16d640 1 -- 172.21.15.40:0/1215637523 wait complete. 2024-09-13T15:50:14.356 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc.data pg_num 2024-09-13T15:50:14.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.473+0000 7f0a86787640 1 Processor -- start 2024-09-13T15:50:14.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.473+0000 7f0a86787640 1 -- start start 2024-09-13T15:50:14.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.473+0000 7f0a86787640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0a80153f60 0x7f0a800c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:14.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.473+0000 7f0a86787640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a800a7850 con 0x7f0a800b7bd0 2024-09-13T15:50:14.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.473+0000 7f0a86787640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8008c4f0 con 0x7f0a80153f60 2024-09-13T15:50:14.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.473+0000 7f0a7ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0a80153f60 0x7f0a800c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:14.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.473+0000 7f0a7f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0a800b7bd0 0x7f0a800c06e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54224/0 (socket says 172.21.15.40:54224) 2024-09-13T15:50:14.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.473+0000 7f0a7f7fe640 1 -- 172.21.15.40:0/898114943 learned_addr learned my addr 172.21.15.40:0/898114943 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:14.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.473+0000 7f0a7ffff640 1 -- 172.21.15.40:0/898114943 >> v1:172.21.15.40:6789/0 conn(0x7f0a800b7bd0 legacy=0x7f0a800c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.473+0000 7f0a7ffff640 1 -- 172.21.15.40:0/898114943 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8008bdb0 con 0x7f0a80153f60 2024-09-13T15:50:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a7ffff640 1 --2- 172.21.15.40:0/898114943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80153f60 0x7f0a800c4b90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009770 tx=0x7f0a7001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831571a45d5c1768 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a7effd640 1 -- 172.21.15.40:0/898114943 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a700ab530 con 0x7f0a80153f60 2024-09-13T15:50:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a7effd640 1 -- 172.21.15.40:0/898114943 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a700a7050 con 0x7f0a80153f60 2024-09-13T15:50:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a7effd640 1 -- 172.21.15.40:0/898114943 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a700ab7e0 con 0x7f0a80153f60 2024-09-13T15:50:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 -- 172.21.15.40:0/898114943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80153f60 msgr2=0x7f0a800c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 --2- 172.21.15.40:0/898114943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80153f60 0x7f0a800c4b90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0a70009770 tx=0x7f0a7001c420 comp rx=0 tx=0).stop 2024-09-13T15:50:14.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 -- 172.21.15.40:0/898114943 shutdown_connections 2024-09-13T15:50:14.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 --2- 172.21.15.40:0/898114943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a80153f60 0x7f0a800c4b90 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 -- 172.21.15.40:0/898114943 >> 172.21.15.40:0/898114943 conn(0x7f0a800a8640 msgr2=0x7f0a80065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:14.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 -- 172.21.15.40:0/898114943 shutdown_connections 2024-09-13T15:50:14.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 -- 172.21.15.40:0/898114943 wait complete. 2024-09-13T15:50:14.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 Processor -- start 2024-09-13T15:50:14.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 -- start start 2024-09-13T15:50:14.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a800b7bd0 0x7f0a80156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:14.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a800c07e0 con 0x7f0a800b7bd0 2024-09-13T15:50:14.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a7ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a800b7bd0 0x7f0a80156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:14.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a7ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a800b7bd0 0x7f0a80156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41478/0 (socket says 172.21.15.40:41478) 2024-09-13T15:50:14.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a7ffff640 1 -- 172.21.15.40:0/2999737540 learned_addr learned my addr 172.21.15.40:0/2999737540 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:14.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a7ffff640 1 -- 172.21.15.40:0/2999737540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a70009420 con 0x7f0a800b7bd0 2024-09-13T15:50:14.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a7ffff640 1 --2- 172.21.15.40:0/2999737540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a800b7bd0 0x7f0a80156f30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0a7001a050 tx=0x7f0a7001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:14.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a7cff9640 1 -- 172.21.15.40:0/2999737540 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a700b7450 con 0x7f0a800b7bd0 2024-09-13T15:50:14.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a7cff9640 1 -- 172.21.15.40:0/2999737540 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a700b75b0 con 0x7f0a800b7bd0 2024-09-13T15:50:14.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 -- 172.21.15.40:0/2999737540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a801ea790 con 0x7f0a800b7bd0 2024-09-13T15:50:14.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a7cff9640 1 -- 172.21.15.40:0/2999737540 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a700b7870 con 0x7f0a800b7bd0 2024-09-13T15:50:14.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.477+0000 7f0a86787640 1 -- 172.21.15.40:0/2999737540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a801ebf60 con 0x7f0a800b7bd0 2024-09-13T15:50:14.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.481+0000 7f0a7cff9640 1 -- 172.21.15.40:0/2999737540 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f0a700b79d0 con 0x7f0a800b7bd0 2024-09-13T15:50:14.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.481+0000 7f0a86787640 1 -- 172.21.15.40:0/2999737540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a80067510 con 0x7f0a800b7bd0 2024-09-13T15:50:14.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.481+0000 7f0a7cff9640 1 --2- 172.21.15.40:0/2999737540 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f0a6c035530 0x7f0a6c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:14.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.481+0000 7f0a7cff9640 1 -- 172.21.15.40:0/2999737540 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f0a700e2df0 con 0x7f0a800b7bd0 2024-09-13T15:50:14.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.481+0000 7f0a7f7fe640 1 --2- 172.21.15.40:0/2999737540 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f0a6c035530 0x7f0a6c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:14.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.481+0000 7f0a7f7fe640 1 --2- 172.21.15.40:0/2999737540 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f0a6c035530 0x7f0a6c0379f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0a74001610 tx=0x7f0a74007ad0 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:14.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.485+0000 7f0a7cff9640 1 -- 172.21.15.40:0/2999737540 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0a700c76c0 con 0x7f0a800b7bd0 2024-09-13T15:50:14.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.637+0000 7f0a86787640 1 -- 172.21.15.40:0/2999737540 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc.data", "var": "pg_num"} v 0) v1 -- 0x7f0a80161e20 con 0x7f0a800b7bd0 2024-09-13T15:50:14.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.637+0000 7f0a7cff9640 1 -- 172.21.15.40:0/2999737540 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc.data", "var": "pg_num"}]=0 v51) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0a700b0020 con 0x7f0a800b7bd0 2024-09-13T15:50:14.639 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:14.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.637+0000 7f0a86787640 1 -- 172.21.15.40:0/2999737540 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f0a6c035530 msgr2=0x7f0a6c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.637+0000 7f0a86787640 1 --2- 172.21.15.40:0/2999737540 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f0a6c035530 0x7f0a6c0379f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0a74001610 tx=0x7f0a74007ad0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.637+0000 7f0a86787640 1 -- 172.21.15.40:0/2999737540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a800b7bd0 msgr2=0x7f0a80156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.637+0000 7f0a86787640 1 --2- 172.21.15.40:0/2999737540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a800b7bd0 0x7f0a80156f30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f0a7001a050 tx=0x7f0a7001ac60 comp rx=0 tx=0).stop 2024-09-13T15:50:14.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.637+0000 7f0a86787640 1 -- 172.21.15.40:0/2999737540 shutdown_connections 2024-09-13T15:50:14.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.637+0000 7f0a86787640 1 --2- 172.21.15.40:0/2999737540 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f0a6c035530 0x7f0a6c0379f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.637+0000 7f0a86787640 1 --2- 172.21.15.40:0/2999737540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a800b7bd0 0x7f0a80156f30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.637+0000 7f0a86787640 1 -- 172.21.15.40:0/2999737540 >> 172.21.15.40:0/2999737540 conn(0x7f0a800a8640 msgr2=0x7f0a800c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:14.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.641+0000 7f0a86787640 1 -- 172.21.15.40:0/2999737540 shutdown_connections 2024-09-13T15:50:14.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.641+0000 7f0a86787640 1 -- 172.21.15.40:0/2999737540 wait complete. 2024-09-13T15:50:14.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc-backup.meta pg_num 2024-09-13T15:50:14.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.773+0000 7f629a745640 1 Processor -- start 2024-09-13T15:50:14.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.773+0000 7f629a745640 1 -- start start 2024-09-13T15:50:14.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.773+0000 7f629a745640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6294070a00 0x7f629414fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:14.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.773+0000 7f629a745640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6294071370 con 0x7f6294070de0 2024-09-13T15:50:14.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.773+0000 7f629a745640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62940b6720 con 0x7f6294070a00 2024-09-13T15:50:14.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.773+0000 7f6293fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6294070a00 0x7f629414fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:14.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.773+0000 7f6293fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6294070a00 0x7f629414fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41536/0 (socket says 172.21.15.40:41536) 2024-09-13T15:50:14.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.773+0000 7f62937fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6294070de0 0x7f6294150040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54236/0 (socket says 172.21.15.40:54236) 2024-09-13T15:50:14.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.773+0000 7f6293fff640 1 -- 172.21.15.40:0/772920350 learned_addr learned my addr 172.21.15.40:0/772920350 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:14.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.773+0000 7f6293fff640 1 -- 172.21.15.40:0/772920350 >> v1:172.21.15.40:6789/0 conn(0x7f6294070de0 legacy=0x7f6294150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.773+0000 7f6293fff640 1 -- 172.21.15.40:0/772920350 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62941508c0 con 0x7f6294070a00 2024-09-13T15:50:14.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f6293fff640 1 --2- 172.21.15.40:0/772920350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6294070a00 0x7f629414fb00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f62840097f0 tx=0x7f628401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7803bd201addce99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:14.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f6292ffd640 1 -- 172.21.15.40:0/772920350 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62840ab470 con 0x7f6294070a00 2024-09-13T15:50:14.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f6292ffd640 1 -- 172.21.15.40:0/772920350 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62940c3a60 con 0x7f6294070a00 2024-09-13T15:50:14.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f6292ffd640 1 -- 172.21.15.40:0/772920350 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62840ab720 con 0x7f6294070a00 2024-09-13T15:50:14.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 -- 172.21.15.40:0/772920350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6294070a00 msgr2=0x7f629414fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 --2- 172.21.15.40:0/772920350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6294070a00 0x7f629414fb00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f62840097f0 tx=0x7f628401c450 comp rx=0 tx=0).stop 2024-09-13T15:50:14.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 -- 172.21.15.40:0/772920350 shutdown_connections 2024-09-13T15:50:14.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 --2- 172.21.15.40:0/772920350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6294070a00 0x7f629414fb00 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 -- 172.21.15.40:0/772920350 >> 172.21.15.40:0/772920350 conn(0x7f6294065d40 msgr2=0x7f6294066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:14.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 -- 172.21.15.40:0/772920350 shutdown_connections 2024-09-13T15:50:14.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 -- 172.21.15.40:0/772920350 wait complete. 2024-09-13T15:50:14.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 Processor -- start 2024-09-13T15:50:14.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 -- start start 2024-09-13T15:50:14.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6294070a00 0x7f6294142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:14.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629414aa00 con 0x7f6294070a00 2024-09-13T15:50:14.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f6293fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6294070a00 0x7f6294142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:14.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f6293fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6294070a00 0x7f6294142dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41538/0 (socket says 172.21.15.40:41538) 2024-09-13T15:50:14.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f6293fff640 1 -- 172.21.15.40:0/1152757699 learned_addr learned my addr 172.21.15.40:0/1152757699 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:14.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f6293fff640 1 -- 172.21.15.40:0/1152757699 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62840094d0 con 0x7f6294070a00 2024-09-13T15:50:14.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f6293fff640 1 --2- 172.21.15.40:0/1152757699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6294070a00 0x7f6294142dd0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6284019060 tx=0x7f628401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:14.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f6290ff9640 1 -- 172.21.15.40:0/1152757699 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62840abea0 con 0x7f6294070a00 2024-09-13T15:50:14.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f6290ff9640 1 -- 172.21.15.40:0/1152757699 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62840be3f0 con 0x7f6294070a00 2024-09-13T15:50:14.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 -- 172.21.15.40:0/1152757699 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6294153490 con 0x7f6294070a00 2024-09-13T15:50:14.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f6290ff9640 1 -- 172.21.15.40:0/1152757699 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f62840be690 con 0x7f6294070a00 2024-09-13T15:50:14.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.777+0000 7f629a745640 1 -- 172.21.15.40:0/1152757699 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6294153b60 con 0x7f6294070a00 2024-09-13T15:50:14.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.781+0000 7f6290ff9640 1 -- 172.21.15.40:0/1152757699 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f62840c7430 con 0x7f6294070a00 2024-09-13T15:50:14.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.781+0000 7f629a745640 1 -- 172.21.15.40:0/1152757699 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629414fb00 con 0x7f6294070a00 2024-09-13T15:50:14.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.781+0000 7f6290ff9640 1 --2- 172.21.15.40:0/1152757699 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6280035530 0x7f62800379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:14.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.781+0000 7f6290ff9640 1 -- 172.21.15.40:0/1152757699 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f62840e2ea0 con 0x7f6294070a00 2024-09-13T15:50:14.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.781+0000 7f62937fe640 1 --2- 172.21.15.40:0/1152757699 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6280035530 0x7f62800379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:14.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.781+0000 7f62937fe640 1 --2- 172.21.15.40:0/1152757699 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6280035530 0x7f62800379f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6288001600 tx=0x7f6288007a50 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:14.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.785+0000 7f6290ff9640 1 -- 172.21.15.40:0/1152757699 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f62840aa9c0 con 0x7f6294070a00 2024-09-13T15:50:14.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.937+0000 7f629a745640 1 -- 172.21.15.40:0/1152757699 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc-backup.meta", "var": "pg_num"} v 0) v1 -- 0x7f62940b6eb0 con 0x7f6294070a00 2024-09-13T15:50:14.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.937+0000 7f6290ff9640 1 -- 172.21.15.40:0/1152757699 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc-backup.meta", "var": "pg_num"}]=0 v51) v1 ==== 110+0+11 (secure 0 0 0) 0x7f62840aa3d0 con 0x7f6294070a00 2024-09-13T15:50:14.940 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:14.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.937+0000 7f629a745640 1 -- 172.21.15.40:0/1152757699 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6280035530 msgr2=0x7f62800379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.937+0000 7f629a745640 1 --2- 172.21.15.40:0/1152757699 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6280035530 0x7f62800379f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6288001600 tx=0x7f6288007a50 comp rx=0 tx=0).stop 2024-09-13T15:50:14.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.941+0000 7f629a745640 1 -- 172.21.15.40:0/1152757699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6294070a00 msgr2=0x7f6294142dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:14.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.941+0000 7f629a745640 1 --2- 172.21.15.40:0/1152757699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6294070a00 0x7f6294142dd0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6284019060 tx=0x7f628401ac90 comp rx=0 tx=0).stop 2024-09-13T15:50:14.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.941+0000 7f629a745640 1 -- 172.21.15.40:0/1152757699 shutdown_connections 2024-09-13T15:50:14.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.941+0000 7f629a745640 1 --2- 172.21.15.40:0/1152757699 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6280035530 0x7f62800379f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.941+0000 7f629a745640 1 --2- 172.21.15.40:0/1152757699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6294070a00 0x7f6294142dd0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:14.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.941+0000 7f629a745640 1 -- 172.21.15.40:0/1152757699 >> 172.21.15.40:0/1152757699 conn(0x7f6294065d40 msgr2=0x7f629414de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:14.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.941+0000 7f629a745640 1 -- 172.21.15.40:0/1152757699 shutdown_connections 2024-09-13T15:50:14.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:14.941+0000 7f629a745640 1 -- 172.21.15.40:0/1152757699 wait complete. 2024-09-13T15:50:14.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc-backup.data pg_num 2024-09-13T15:50:15.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.085+0000 7f1594ef9640 1 Processor -- start 2024-09-13T15:50:15.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.085+0000 7f1594ef9640 1 -- start start 2024-09-13T15:50:15.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.085+0000 7f1594ef9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15900b8910 0x7f159006e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:15.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.085+0000 7f1594ef9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15900be820 con 0x7f15900b8530 2024-09-13T15:50:15.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.085+0000 7f1594ef9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1590153940 con 0x7f15900b8910 2024-09-13T15:50:15.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.085+0000 7f158e59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f15900b8530 0x7f159006f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54252/0 (socket says 172.21.15.40:54252) 2024-09-13T15:50:15.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.085+0000 7f1587fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f15900b8910 0x7f159006e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:15.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.085+0000 7f158e59c640 1 -- 172.21.15.40:0/3492015576 learned_addr learned my addr 172.21.15.40:0/3492015576 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:15.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.085+0000 7f1587fff640 1 -- 172.21.15.40:0/3492015576 >> v1:172.21.15.40:6789/0 conn(0x7f15900b8530 legacy=0x7f159006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:15.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.085+0000 7f1587fff640 1 -- 172.21.15.40:0/3492015576 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15900c1290 con 0x7f15900b8910 2024-09-13T15:50:15.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.085+0000 7f158dd9b640 1 -- 172.21.15.40:0/3492015576 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227051426 0 0) 0x7f15900be820 con 0x7f15900b8530 2024-09-13T15:50:15.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1587fff640 1 --2- 172.21.15.40:0/3492015576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15900b8910 0x7f159006e4d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1578009740 tx=0x7f157801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275d51e921e49407 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:15.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f158dd9b640 1 -- 172.21.15.40:0/3492015576 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15780ab530 con 0x7f15900b8910 2024-09-13T15:50:15.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f158dd9b640 1 -- 172.21.15.40:0/3492015576 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15780a7050 con 0x7f15900b8910 2024-09-13T15:50:15.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f158dd9b640 1 -- 172.21.15.40:0/3492015576 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15780ab7e0 con 0x7f15900b8910 2024-09-13T15:50:15.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 -- 172.21.15.40:0/3492015576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15900b8910 msgr2=0x7f159006e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:15.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 --2- 172.21.15.40:0/3492015576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15900b8910 0x7f159006e4d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1578009740 tx=0x7f157801c420 comp rx=0 tx=0).stop 2024-09-13T15:50:15.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 -- 172.21.15.40:0/3492015576 shutdown_connections 2024-09-13T15:50:15.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 --2- 172.21.15.40:0/3492015576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15900b8910 0x7f159006e4d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:15.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 -- 172.21.15.40:0/3492015576 >> 172.21.15.40:0/3492015576 conn(0x7f159006a540 msgr2=0x7f15900a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:15.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 -- 172.21.15.40:0/3492015576 shutdown_connections 2024-09-13T15:50:15.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 -- 172.21.15.40:0/3492015576 wait complete. 2024-09-13T15:50:15.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 Processor -- start 2024-09-13T15:50:15.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 -- start start 2024-09-13T15:50:15.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15900b8530 0x7f1590149c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:15.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159014ca60 con 0x7f15900b8530 2024-09-13T15:50:15.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f158e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15900b8530 0x7f1590149c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:15.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f158e59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15900b8530 0x7f1590149c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41550/0 (socket says 172.21.15.40:41550) 2024-09-13T15:50:15.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f158e59c640 1 -- 172.21.15.40:0/2939286570 learned_addr learned my addr 172.21.15.40:0/2939286570 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:15.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f158e59c640 1 -- 172.21.15.40:0/2939286570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578009420 con 0x7f15900b8530 2024-09-13T15:50:15.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f158e59c640 1 --2- 172.21.15.40:0/2939286570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15900b8530 0x7f1590149c90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f158000c420 tx=0x7f158000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:15.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1586ffd640 1 -- 172.21.15.40:0/2939286570 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15800074d0 con 0x7f15900b8530 2024-09-13T15:50:15.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1586ffd640 1 -- 172.21.15.40:0/2939286570 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1580007630 con 0x7f15900b8530 2024-09-13T15:50:15.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 -- 172.21.15.40:0/2939286570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15900ba750 con 0x7f15900b8530 2024-09-13T15:50:15.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1586ffd640 1 -- 172.21.15.40:0/2939286570 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1580004960 con 0x7f15900b8530 2024-09-13T15:50:15.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.089+0000 7f1594ef9640 1 -- 172.21.15.40:0/2939286570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1590141680 con 0x7f15900b8530 2024-09-13T15:50:15.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.093+0000 7f1586ffd640 1 -- 172.21.15.40:0/2939286570 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f1580004ac0 con 0x7f15900b8530 2024-09-13T15:50:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.093+0000 7f1594ef9640 1 -- 172.21.15.40:0/2939286570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15900c0000 con 0x7f15900b8530 2024-09-13T15:50:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.093+0000 7f1586ffd640 1 --2- 172.21.15.40:0/2939286570 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f1570035580 0x7f1570037a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.093+0000 7f1586ffd640 1 -- 172.21.15.40:0/2939286570 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f15800479e0 con 0x7f15900b8530 2024-09-13T15:50:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.093+0000 7f1587fff640 1 --2- 172.21.15.40:0/2939286570 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f1570035580 0x7f1570037a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:15.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.093+0000 7f1587fff640 1 --2- 172.21.15.40:0/2939286570 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f1570035580 0x7f1570037a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f15780ad000 tx=0x7f15780a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:15.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.097+0000 7f1586ffd640 1 -- 172.21.15.40:0/2939286570 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f158001acd0 con 0x7f15900b8530 2024-09-13T15:50:15.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.261+0000 7f1594ef9640 1 -- 172.21.15.40:0/2939286570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc-backup.data", "var": "pg_num"} v 0) v1 -- 0x7f15900ba8e0 con 0x7f15900b8530 2024-09-13T15:50:15.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.261+0000 7f1586ffd640 1 -- 172.21.15.40:0/2939286570 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc-backup.data", "var": "pg_num"}]=0 v51) v1 ==== 110+0+11 (secure 0 0 0) 0x7f1580018030 con 0x7f15900b8530 2024-09-13T15:50:15.263 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.261+0000 7f1594ef9640 1 -- 172.21.15.40:0/2939286570 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f1570035580 msgr2=0x7f1570037a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.261+0000 7f1594ef9640 1 --2- 172.21.15.40:0/2939286570 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f1570035580 0x7f1570037a40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f15780ad000 tx=0x7f15780a6000 comp rx=0 tx=0).stop 2024-09-13T15:50:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.261+0000 7f1594ef9640 1 -- 172.21.15.40:0/2939286570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15900b8530 msgr2=0x7f1590149c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.261+0000 7f1594ef9640 1 --2- 172.21.15.40:0/2939286570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15900b8530 0x7f1590149c90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f158000c420 tx=0x7f158000c8e0 comp rx=0 tx=0).stop 2024-09-13T15:50:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.261+0000 7f1594ef9640 1 -- 172.21.15.40:0/2939286570 shutdown_connections 2024-09-13T15:50:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.261+0000 7f1594ef9640 1 --2- 172.21.15.40:0/2939286570 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f1570035580 0x7f1570037a40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.261+0000 7f1594ef9640 1 --2- 172.21.15.40:0/2939286570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f15900b8530 0x7f1590149c90 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.261+0000 7f1594ef9640 1 -- 172.21.15.40:0/2939286570 >> 172.21.15.40:0/2939286570 conn(0x7f159006a540 msgr2=0x7f15900b9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:15.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.261+0000 7f1594ef9640 1 -- 172.21.15.40:0/2939286570 shutdown_connections 2024-09-13T15:50:15.267 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.261+0000 7f1594ef9640 1 -- 172.21.15.40:0/2939286570 wait complete. 2024-09-13T15:50:15.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:50:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b12e2a640 1 Processor -- start 2024-09-13T15:50:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b12e2a640 1 -- start start 2024-09-13T15:50:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b12e2a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b0c0c0fb0 0x7f3b0c0bdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b12e2a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c06f220 con 0x7f3b0c0bc890 2024-09-13T15:50:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b12e2a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c0a2220 con 0x7f3b0c0c0fb0 2024-09-13T15:50:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b0bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b0c0c0fb0 0x7f3b0c0bdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b10bc6640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3b0c0bc890 0x7f3b0c06b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54256/0 (socket says 172.21.15.40:54256) 2024-09-13T15:50:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b0bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b0c0c0fb0 0x7f3b0c0bdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41558/0 (socket says 172.21.15.40:41558) 2024-09-13T15:50:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b10bc6640 1 -- 172.21.15.40:0/750315409 learned_addr learned my addr 172.21.15.40:0/750315409 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b0bfff640 1 -- 172.21.15.40:0/750315409 >> v1:172.21.15.40:6789/0 conn(0x7f3b0c0bc890 legacy=0x7f3b0c06b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b0bfff640 1 -- 172.21.15.40:0/750315409 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c0bfcb0 con 0x7f3b0c0c0fb0 2024-09-13T15:50:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b0b7fe640 1 -- 172.21.15.40:0/750315409 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428731096 0 0) 0x7f3b0c06f220 con 0x7f3b0c0bc890 2024-09-13T15:50:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.393+0000 7f3b0bfff640 1 --2- 172.21.15.40:0/750315409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0c0c0fb0 0x7f3b0c0bdea0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009d90 tx=0x7f3afc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeca1134ed39d8cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:15.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b0b7fe640 1 -- 172.21.15.40:0/750315409 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3afc0a57e0 con 0x7f3b0c0c0fb0 2024-09-13T15:50:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b0b7fe640 1 -- 172.21.15.40:0/750315409 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc0a5940 con 0x7f3b0c0c0fb0 2024-09-13T15:50:15.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b0b7fe640 1 -- 172.21.15.40:0/750315409 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3afc0a5c00 con 0x7f3b0c0c0fb0 2024-09-13T15:50:15.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 -- 172.21.15.40:0/750315409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0c0c0fb0 msgr2=0x7f3b0c0bdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:15.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 --2- 172.21.15.40:0/750315409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0c0c0fb0 0x7f3b0c0bdea0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009d90 tx=0x7f3afc01c850 comp rx=0 tx=0).stop 2024-09-13T15:50:15.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 -- 172.21.15.40:0/750315409 shutdown_connections 2024-09-13T15:50:15.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 --2- 172.21.15.40:0/750315409 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0c0c0fb0 0x7f3b0c0bdea0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:15.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 -- 172.21.15.40:0/750315409 >> 172.21.15.40:0/750315409 conn(0x7f3b0c06a370 msgr2=0x7f3b0c06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:15.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 -- 172.21.15.40:0/750315409 shutdown_connections 2024-09-13T15:50:15.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 -- 172.21.15.40:0/750315409 wait complete. 2024-09-13T15:50:15.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 Processor -- start 2024-09-13T15:50:15.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 -- start start 2024-09-13T15:50:15.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0c0bc890 0x7f3b0c1505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:15.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0bc4a0 con 0x7f3b0c0bc890 2024-09-13T15:50:15.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b10bc6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0c0bc890 0x7f3b0c1505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:15.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b10bc6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0c0bc890 0x7f3b0c1505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41566/0 (socket says 172.21.15.40:41566) 2024-09-13T15:50:15.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b10bc6640 1 -- 172.21.15.40:0/3837271154 learned_addr learned my addr 172.21.15.40:0/3837271154 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:15.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b10bc6640 1 -- 172.21.15.40:0/3837271154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc009a70 con 0x7f3b0c0bc890 2024-09-13T15:50:15.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b10bc6640 1 --2- 172.21.15.40:0/3837271154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0c0bc890 0x7f3b0c1505b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000c420 tx=0x7f3b0000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:15.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b097fa640 1 -- 172.21.15.40:0/3837271154 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b000074d0 con 0x7f3b0c0bc890 2024-09-13T15:50:15.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b097fa640 1 -- 172.21.15.40:0/3837271154 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b00007630 con 0x7f3b0c0bc890 2024-09-13T15:50:15.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b097fa640 1 -- 172.21.15.40:0/3837271154 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b00004960 con 0x7f3b0c0bc890 2024-09-13T15:50:15.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 -- 172.21.15.40:0/3837271154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c0bbfc0 con 0x7f3b0c0bc890 2024-09-13T15:50:15.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.397+0000 7f3b12e2a640 1 -- 172.21.15.40:0/3837271154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c1efef0 con 0x7f3b0c0bc890 2024-09-13T15:50:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.401+0000 7f3b12e2a640 1 -- 172.21.15.40:0/3837271154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c0bdea0 con 0x7f3b0c0bc890 2024-09-13T15:50:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.401+0000 7f3b097fa640 1 -- 172.21.15.40:0/3837271154 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f3b00004ac0 con 0x7f3b0c0bc890 2024-09-13T15:50:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.401+0000 7f3b097fa640 1 --2- 172.21.15.40:0/3837271154 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3af8035530 0x7f3af80379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.401+0000 7f3b097fa640 1 -- 172.21.15.40:0/3837271154 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f3b00047920 con 0x7f3b0c0bc890 2024-09-13T15:50:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.401+0000 7f3b0bfff640 1 --2- 172.21.15.40:0/3837271154 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3af8035530 0x7f3af80379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:15.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.401+0000 7f3b0bfff640 1 --2- 172.21.15.40:0/3837271154 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3af8035530 0x7f3af80379f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0af000 tx=0x7f3afc0a7070 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:15.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.405+0000 7f3b097fa640 1 -- 172.21.15.40:0/3837271154 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3b0001acd0 con 0x7f3b0c0bc890 2024-09-13T15:50:15.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.569+0000 7f3b12e2a640 1 -- 172.21.15.40:0/3837271154 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3b0c066920 con 0x7f3b0c0bc890 2024-09-13T15:50:15.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.569+0000 7f3b097fa640 1 -- 172.21.15.40:0/3837271154 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 30 entries v51) v1 ==== 81+0+1742 (secure 0 0 0) 0x7f3b00018070 con 0x7f3b0c0bc890 2024-09-13T15:50:15.571 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3464899269 2024-09-13T16:49:52.021920+0000 2024-09-13T15:50:15.571 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2020191347 2024-09-13T16:39:12.695853+0000 2024-09-13T15:50:15.571 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3215060720 2024-09-13T16:37:48.656072+0000 2024-09-13T15:50:15.571 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2096071371 2024-09-13T16:41:43.833379+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1024811135 2024-09-13T16:46:02.884335+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1371435748 2024-09-13T16:49:08.427332+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1725367853 2024-09-13T16:38:36.652988+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2070755866 2024-09-13T16:38:12.598575+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/695475091 2024-09-13T16:40:02.785567+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/276304017 2024-09-13T16:45:37.498754+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3286012502 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2241829794 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2301478808 2024-09-13T16:40:27.738146+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6824/3185150828 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/690822190 2024-09-13T16:39:37.683949+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/414904326 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:15.572 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3777702470 2024-09-13T16:43:17.229644+0000 2024-09-13T15:50:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3514360215 2024-09-13T16:44:32.325869+0000 2024-09-13T15:50:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3853947452 2024-09-13T16:46:26.907170+0000 2024-09-13T15:50:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1991235795 2024-09-13T16:40:52.760615+0000 2024-09-13T15:50:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6825/3185150828 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1455634917 2024-09-13T16:47:13.340610+0000 2024-09-13T15:50:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2753473479 2024-09-13T16:42:16.865910+0000 2024-09-13T15:50:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3230130657 2024-09-13T16:42:51.908956+0000 2024-09-13T15:50:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3833267415 2024-09-13T16:48:42.495533+0000 2024-09-13T15:50:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1708466797 2024-09-13T16:43:42.271124+0000 2024-09-13T15:50:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3629684271 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3494260782 2024-09-13T16:41:17.861368+0000 2024-09-13T15:50:15.573 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1861863246 2024-09-13T16:44:07.288889+0000 2024-09-13T15:50:15.574 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1129415438 2024-09-13T16:47:37.323733+0000 2024-09-13T15:50:15.574 INFO:teuthology.orchestra.run.smithi040.stderr:listed 30 entries 2024-09-13T15:50:15.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.569+0000 7f3b12e2a640 1 -- 172.21.15.40:0/3837271154 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3af8035530 msgr2=0x7f3af80379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:15.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.569+0000 7f3b12e2a640 1 --2- 172.21.15.40:0/3837271154 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3af8035530 0x7f3af80379f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3afc0af000 tx=0x7f3afc0a7070 comp rx=0 tx=0).stop 2024-09-13T15:50:15.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.569+0000 7f3b12e2a640 1 -- 172.21.15.40:0/3837271154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0c0bc890 msgr2=0x7f3b0c1505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.569+0000 7f3b12e2a640 1 --2- 172.21.15.40:0/3837271154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0c0bc890 0x7f3b0c1505b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f3b0000c420 tx=0x7f3b0000c8e0 comp rx=0 tx=0).stop 2024-09-13T15:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.569+0000 7f3b12e2a640 1 -- 172.21.15.40:0/3837271154 shutdown_connections 2024-09-13T15:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.569+0000 7f3b12e2a640 1 --2- 172.21.15.40:0/3837271154 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3af8035530 0x7f3af80379f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.569+0000 7f3b12e2a640 1 --2- 172.21.15.40:0/3837271154 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b0c0bc890 0x7f3b0c1505b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.569+0000 7f3b12e2a640 1 -- 172.21.15.40:0/3837271154 >> 172.21.15.40:0/3837271154 conn(0x7f3b0c06a370 msgr2=0x7f3b0c06a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.569+0000 7f3b12e2a640 1 -- 172.21.15.40:0/3837271154 shutdown_connections 2024-09-13T15:50:15.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.569+0000 7f3b12e2a640 1 -- 172.21.15.40:0/3837271154 wait complete. 2024-09-13T15:50:15.589 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:50:15.590 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:50:15.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:50:15.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.765+0000 7efe7ea0e640 1 Processor -- start 2024-09-13T15:50:15.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.765+0000 7efe7ea0e640 1 -- start start 2024-09-13T15:50:15.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.765+0000 7efe7ea0e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe780b4600 0x7efe7814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:15.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.765+0000 7efe7ea0e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe780c1130 con 0x7efe7814e280 2024-09-13T15:50:15.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.765+0000 7efe7ea0e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7814e780 con 0x7efe780b4600 2024-09-13T15:50:15.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.769+0000 7efe77fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efe780b4600 0x7efe7814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:15.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.769+0000 7efe777fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efe7814e280 0x7efe780bf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54264/0 (socket says 172.21.15.40:54264) 2024-09-13T15:50:15.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.769+0000 7efe777fe640 1 -- 172.21.15.40:0/1843972540 learned_addr learned my addr 172.21.15.40:0/1843972540 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:15.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.769+0000 7efe77fff640 1 -- 172.21.15.40:0/1843972540 >> v1:172.21.15.40:6789/0 conn(0x7efe7814e280 legacy=0x7efe780bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:15.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.769+0000 7efe77fff640 1 -- 172.21.15.40:0/1843972540 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe780b59f0 con 0x7efe780b4600 2024-09-13T15:50:15.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.769+0000 7efe77fff640 1 --2- 172.21.15.40:0/1843972540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780b4600 0x7efe7814dd40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009740 tx=0x7efe6c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d33f51fc7ab193 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:15.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.769+0000 7efe76ffd640 1 -- 172.21.15.40:0/1843972540 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe6c0ab530 con 0x7efe780b4600 2024-09-13T15:50:15.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.769+0000 7efe76ffd640 1 -- 172.21.15.40:0/1843972540 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c0a7050 con 0x7efe780b4600 2024-09-13T15:50:15.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.769+0000 7efe76ffd640 1 -- 172.21.15.40:0/1843972540 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe6c0ab7e0 con 0x7efe780b4600 2024-09-13T15:50:15.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1843972540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780b4600 msgr2=0x7efe7814dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:15.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 --2- 172.21.15.40:0/1843972540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780b4600 0x7efe7814dd40 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009740 tx=0x7efe6c01c390 comp rx=0 tx=0).stop 2024-09-13T15:50:15.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1843972540 shutdown_connections 2024-09-13T15:50:15.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 --2- 172.21.15.40:0/1843972540 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780b4600 0x7efe7814dd40 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:15.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1843972540 >> 172.21.15.40:0/1843972540 conn(0x7efe7806a540 msgr2=0x7efe780a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:15.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1843972540 shutdown_connections 2024-09-13T15:50:15.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1843972540 wait complete. 2024-09-13T15:50:15.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 Processor -- start 2024-09-13T15:50:15.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 -- start start 2024-09-13T15:50:15.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780b4600 0x7efe78147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:15.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe781480d0 con 0x7efe780b4600 2024-09-13T15:50:15.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe77fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780b4600 0x7efe78147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:15.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe77fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780b4600 0x7efe78147b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41580/0 (socket says 172.21.15.40:41580) 2024-09-13T15:50:15.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe77fff640 1 -- 172.21.15.40:0/1967645946 learned_addr learned my addr 172.21.15.40:0/1967645946 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:15.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe77fff640 1 -- 172.21.15.40:0/1967645946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c009420 con 0x7efe780b4600 2024-09-13T15:50:15.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe77fff640 1 --2- 172.21.15.40:0/1967645946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780b4600 0x7efe78147b90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0ae040 tx=0x7efe6c019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:15.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe74ff9640 1 -- 172.21.15.40:0/1967645946 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe6c0b4410 con 0x7efe780b4600 2024-09-13T15:50:15.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe74ff9640 1 -- 172.21.15.40:0/1967645946 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c0b4570 con 0x7efe780b4600 2024-09-13T15:50:15.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe74ff9640 1 -- 172.21.15.40:0/1967645946 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe6c0b4850 con 0x7efe780b4600 2024-09-13T15:50:15.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1967645946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe78159aa0 con 0x7efe780b4600 2024-09-13T15:50:15.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1967645946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7814b810 con 0x7efe780b4600 2024-09-13T15:50:15.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.773+0000 7efe74ff9640 1 -- 172.21.15.40:0/1967645946 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7efe6c0b2040 con 0x7efe780b4600 2024-09-13T15:50:15.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.777+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1967645946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7814bac0 con 0x7efe780b4600 2024-09-13T15:50:15.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.777+0000 7efe74ff9640 1 --2- 172.21.15.40:0/1967645946 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7efe64035530 0x7efe640379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:15.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.777+0000 7efe74ff9640 1 -- 172.21.15.40:0/1967645946 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7efe6c0e26f0 con 0x7efe780b4600 2024-09-13T15:50:15.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.777+0000 7efe777fe640 1 --2- 172.21.15.40:0/1967645946 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7efe64035530 0x7efe640379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:15.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.777+0000 7efe777fe640 1 --2- 172.21.15.40:0/1967645946 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7efe64035530 0x7efe640379f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efe70002090 tx=0x7efe70001680 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:15.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.781+0000 7efe74ff9640 1 -- 172.21.15.40:0/1967645946 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efe6c0b4d30 con 0x7efe780b4600 2024-09-13T15:50:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.941+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1967645946 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe7814dd40 con 0x7efe780b4600 2024-09-13T15:50:15.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.945+0000 7efe74ff9640 1 -- 172.21.15.40:0/1967645946 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+19969 (secure 0 0 0) 0x7efe6c0b0020 con 0x7efe780b4600 2024-09-13T15:50:15.948 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:50:15.948 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":51,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:49:52.917821+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.2699999809265137,"score_stable":1.2699999809265137,"optimal_score":1,"raw_score_acting":1.2699999809265137,"raw_score_stable":1.2699999809265137,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs.dc.meta","create_time":"2024-09-13T15:34:54.455347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"dc"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs.dc.data","create_time":"2024-09-13T15:34:55.209802+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"dc"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs.dc-backup.meta","create_time":"2024-09-13T15:34:56.580392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"dc-backup"}},"read_balance":{"score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs.dc-backup.data","create_time":"2024-09-13T15:34:57.245673+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"dc-backup"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1c","mappings":[{"from":0,"to":2}]},{"pgid":"3.24","mappings":[{"from":0,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3464899269":"2024-09-13T16:49:52.021920+0000","172.21.15.40:0/2020191347":"2024-09-13T16:39:12.695853+0000","172.21.15.40:0/3215060720":"2024-09-13T16:37:48.656072+0000","172.21.15.40:0/2096071371":"2024-09-13T16:41:43.833379+0000","172.21.15.40:0/1024811135":"2024-09-13T16:46:02.884335+0000","172.21.15.40:0/1371435748":"2024-09-13T16:49:08.427332+0000","172.21.15.40:0/1725367853":"2024-09-13T16:38:36.652988+0000","172.21.15.40:0/2070755866":"2024-09-13T16:38:12.598575+0000","172.21.15.40:0/695475091":"2024-09-13T16:40:02.785567+0000","172.21.15.40:0/276304017":"2024-09-13T16:45:37.498754+0000","172.21.15.40:0/3286012502":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/2241829794":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/2301478808":"2024-09-13T16:40:27.738146+0000","172.21.15.40:6824/3185150828":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/690822190":"2024-09-13T16:39:37.683949+0000","172.21.15.40:0/414904326":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/3777702470":"2024-09-13T16:43:17.229644+0000","172.21.15.40:0/3514360215":"2024-09-13T16:44:32.325869+0000","172.21.15.40:0/3853947452":"2024-09-13T16:46:26.907170+0000","172.21.15.40:0/1991235795":"2024-09-13T16:40:52.760615+0000","172.21.15.40:6825/3185150828":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/1455634917":"2024-09-13T16:47:13.340610+0000","172.21.15.40:0/2753473479":"2024-09-13T16:42:16.865910+0000","172.21.15.40:0/3230130657":"2024-09-13T16:42:51.908956+0000","172.21.15.40:0/3833267415":"2024-09-13T16:48:42.495533+0000","172.21.15.40:0/1708466797":"2024-09-13T16:43:42.271124+0000","172.21.15.40:0/3629684271":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/3494260782":"2024-09-13T16:41:17.861368+0000","172.21.15.40:0/1861863246":"2024-09-13T16:44:07.288889+0000","172.21.15.40:0/1129415438":"2024-09-13T16:47:37.323733+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:50:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.945+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1967645946 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7efe64035530 msgr2=0x7efe640379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.945+0000 7efe7ea0e640 1 --2- 172.21.15.40:0/1967645946 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7efe64035530 0x7efe640379f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7efe70002090 tx=0x7efe70001680 comp rx=0 tx=0).stop 2024-09-13T15:50:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.945+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1967645946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780b4600 msgr2=0x7efe78147b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.945+0000 7efe7ea0e640 1 --2- 172.21.15.40:0/1967645946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780b4600 0x7efe78147b90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0ae040 tx=0x7efe6c019130 comp rx=0 tx=0).stop 2024-09-13T15:50:15.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.945+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1967645946 shutdown_connections 2024-09-13T15:50:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.945+0000 7efe7ea0e640 1 --2- 172.21.15.40:0/1967645946 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7efe64035530 0x7efe640379f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.945+0000 7efe7ea0e640 1 --2- 172.21.15.40:0/1967645946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe780b4600 0x7efe78147b90 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.945+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1967645946 >> 172.21.15.40:0/1967645946 conn(0x7efe7806a540 msgr2=0x7efe780bf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.945+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1967645946 shutdown_connections 2024-09-13T15:50:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:15.945+0000 7efe7ea0e640 1 -- 172.21.15.40:0/1967645946 wait complete. 2024-09-13T15:50:15.966 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:34:25.125767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:34:33.833957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:34:34.276037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.2699999809265137, 'score_stable': 1.2699999809265137, 'optimal_score': 1, 'raw_score_acting': 1.2699999809265137, 'raw_score_stable': 1.2699999809265137, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs.dc.meta', 'create_time': '2024-09-13T15:34:54.455347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'dc'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs.dc.data', 'create_time': '2024-09-13T15:34:55.209802+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'dc'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs.dc-backup.meta', 'create_time': '2024-09-13T15:34:56.580392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'dc-backup'}}, 'read_balance': {'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs.dc-backup.data', 'create_time': '2024-09-13T15:34:57.245673+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'dc-backup'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:50:15.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:50:16.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.077+0000 7f644ef37640 1 Processor -- start 2024-09-13T15:50:16.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.077+0000 7f644ef37640 1 -- start start 2024-09-13T15:50:16.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.077+0000 7f644ef37640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f64480b4010 0x7f64480a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.077+0000 7f644ef37640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64481515b0 con 0x7f64480bebb0 2024-09-13T15:50:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.077+0000 7f644ef37640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644814e2c0 con 0x7f64480b4010 2024-09-13T15:50:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.077+0000 7f6447fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f64480b4010 0x7f64480a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.077+0000 7f644ccd3640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f64480bebb0 0x7f644806e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54274/0 (socket says 172.21.15.40:54274) 2024-09-13T15:50:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.077+0000 7f644ccd3640 1 -- 172.21.15.40:0/1180082563 learned_addr learned my addr 172.21.15.40:0/1180082563 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.077+0000 7f6447fff640 1 -- 172.21.15.40:0/1180082563 >> v1:172.21.15.40:6789/0 conn(0x7f64480bebb0 legacy=0x7f644806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:16.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.077+0000 7f6447fff640 1 -- 172.21.15.40:0/1180082563 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644806f830 con 0x7f64480b4010 2024-09-13T15:50:16.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.077+0000 7f64477fe640 1 -- 172.21.15.40:0/1180082563 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602333837 0 0) 0x7f64481515b0 con 0x7f64480bebb0 2024-09-13T15:50:16.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f6447fff640 1 --2- 172.21.15.40:0/1180082563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64480b4010 0x7f64480a4d70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f643c009740 tx=0x7f643c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a623b1c84a4d736b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:16.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f64477fe640 1 -- 172.21.15.40:0/1180082563 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64480b6bc0 con 0x7f64480b4010 2024-09-13T15:50:16.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f64477fe640 1 -- 172.21.15.40:0/1180082563 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c0a7050 con 0x7f64480b4010 2024-09-13T15:50:16.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f64477fe640 1 -- 172.21.15.40:0/1180082563 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f643c0ab680 con 0x7f64480b4010 2024-09-13T15:50:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ef37640 1 -- 172.21.15.40:0/1180082563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64480b4010 msgr2=0x7f64480a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ef37640 1 --2- 172.21.15.40:0/1180082563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64480b4010 0x7f64480a4d70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f643c009740 tx=0x7f643c01c420 comp rx=0 tx=0).stop 2024-09-13T15:50:16.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ef37640 1 -- 172.21.15.40:0/1180082563 shutdown_connections 2024-09-13T15:50:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ef37640 1 --2- 172.21.15.40:0/1180082563 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64480b4010 0x7f64480a4d70 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ef37640 1 -- 172.21.15.40:0/1180082563 >> 172.21.15.40:0/1180082563 conn(0x7f644806a540 msgr2=0x7f64480a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ef37640 1 -- 172.21.15.40:0/1180082563 shutdown_connections 2024-09-13T15:50:16.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ef37640 1 -- 172.21.15.40:0/1180082563 wait complete. 2024-09-13T15:50:16.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ef37640 1 Processor -- start 2024-09-13T15:50:16.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ef37640 1 -- start start 2024-09-13T15:50:16.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ef37640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64480b4010 0x7f64480c0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:16.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ef37640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644814b110 con 0x7f64480b4010 2024-09-13T15:50:16.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ccd3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64480b4010 0x7f64480c0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:16.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ccd3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64480b4010 0x7f64480c0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41592/0 (socket says 172.21.15.40:41592) 2024-09-13T15:50:16.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.081+0000 7f644ccd3640 1 -- 172.21.15.40:0/3696130646 learned_addr learned my addr 172.21.15.40:0/3696130646 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:16.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f644ccd3640 1 -- 172.21.15.40:0/3696130646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c009420 con 0x7f64480b4010 2024-09-13T15:50:16.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f644ccd3640 1 --2- 172.21.15.40:0/3696130646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64480b4010 0x7f64480c0eb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f643800c420 tx=0x7f643800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:16.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f64457fa640 1 -- 172.21.15.40:0/3696130646 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64380074d0 con 0x7f64480b4010 2024-09-13T15:50:16.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f64457fa640 1 -- 172.21.15.40:0/3696130646 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6438007630 con 0x7f64480b4010 2024-09-13T15:50:16.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f64457fa640 1 -- 172.21.15.40:0/3696130646 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6438004960 con 0x7f64480b4010 2024-09-13T15:50:16.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f644ef37640 1 -- 172.21.15.40:0/3696130646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644814ae70 con 0x7f64480b4010 2024-09-13T15:50:16.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f644ef37640 1 -- 172.21.15.40:0/3696130646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6448099c60 con 0x7f64480b4010 2024-09-13T15:50:16.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f644ef37640 1 -- 172.21.15.40:0/3696130646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64480a4d70 con 0x7f64480b4010 2024-09-13T15:50:16.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f64457fa640 1 -- 172.21.15.40:0/3696130646 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f6438004ac0 con 0x7f64480b4010 2024-09-13T15:50:16.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f64457fa640 1 --2- 172.21.15.40:0/3696130646 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6434035530 0x7f64340379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:16.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f64457fa640 1 -- 172.21.15.40:0/3696130646 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f6438047e20 con 0x7f64480b4010 2024-09-13T15:50:16.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f6447fff640 1 --2- 172.21.15.40:0/3696130646 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6434035530 0x7f64340379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:16.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.085+0000 7f6447fff640 1 --2- 172.21.15.40:0/3696130646 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6434035530 0x7f64340379f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f643c0ad000 tx=0x7f643c008040 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:16.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.089+0000 7f64457fa640 1 -- 172.21.15.40:0/3696130646 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f643801ab40 con 0x7f64480b4010 2024-09-13T15:50:16.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.249+0000 7f644ef37640 1 -- 172.21.15.40:0/3696130646 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f644814bfc0 con 0x7f64480b4010 2024-09-13T15:50:16.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.249+0000 7f64457fa640 1 -- 172.21.15.40:0/3696130646 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6438018070 con 0x7f64480b4010 2024-09-13T15:50:16.251 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-09-13T15:50:16.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.249+0000 7f644ef37640 1 -- 172.21.15.40:0/3696130646 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6434035530 msgr2=0x7f64340379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.249+0000 7f644ef37640 1 --2- 172.21.15.40:0/3696130646 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6434035530 0x7f64340379f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f643c0ad000 tx=0x7f643c008040 comp rx=0 tx=0).stop 2024-09-13T15:50:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.249+0000 7f644ef37640 1 -- 172.21.15.40:0/3696130646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64480b4010 msgr2=0x7f64480c0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.249+0000 7f644ef37640 1 --2- 172.21.15.40:0/3696130646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64480b4010 0x7f64480c0eb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f643800c420 tx=0x7f643800c8e0 comp rx=0 tx=0).stop 2024-09-13T15:50:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.249+0000 7f644ef37640 1 -- 172.21.15.40:0/3696130646 shutdown_connections 2024-09-13T15:50:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.249+0000 7f644ef37640 1 --2- 172.21.15.40:0/3696130646 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6434035530 0x7f64340379f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.249+0000 7f644ef37640 1 --2- 172.21.15.40:0/3696130646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64480b4010 0x7f64480c0eb0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.249+0000 7f644ef37640 1 -- 172.21.15.40:0/3696130646 >> 172.21.15.40:0/3696130646 conn(0x7f644806a540 msgr2=0x7f644806fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.249+0000 7f644ef37640 1 -- 172.21.15.40:0/3696130646 shutdown_connections 2024-09-13T15:50:16.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.249+0000 7f644ef37640 1 -- 172.21.15.40:0/3696130646 wait complete. 2024-09-13T15:50:16.268 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:50:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.393+0000 7fe5971cc640 1 Processor -- start 2024-09-13T15:50:16.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.393+0000 7fe5971cc640 1 -- start start 2024-09-13T15:50:16.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.393+0000 7fe5971cc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe59006d7d0 0x7fe5900b8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.393+0000 7fe5971cc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5900b6870 con 0x7fe59006dbb0 2024-09-13T15:50:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.393+0000 7fe5971cc640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5900c0e00 con 0x7fe59006d7d0 2024-09-13T15:50:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.393+0000 7fe594f68640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe59006d7d0 0x7fe5900b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.393+0000 7fe58ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe59006dbb0 0x7fe590070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54282/0 (socket says 172.21.15.40:54282) 2024-09-13T15:50:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.393+0000 7fe58ffff640 1 -- 172.21.15.40:0/2726104422 learned_addr learned my addr 172.21.15.40:0/2726104422 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.393+0000 7fe594f68640 1 -- 172.21.15.40:0/2726104422 >> v1:172.21.15.40:6789/0 conn(0x7fe59006dbb0 legacy=0x7fe590070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:16.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.393+0000 7fe594f68640 1 -- 172.21.15.40:0/2726104422 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900b8bb0 con 0x7fe59006d7d0 2024-09-13T15:50:16.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe594f68640 1 --2- 172.21.15.40:0/2726104422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59006d7d0 0x7fe5900b8000 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe580009740 tx=0x7fe58001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc7ab78dc78eb6a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:16.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe58f7fe640 1 -- 172.21.15.40:0/2726104422 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5800ab530 con 0x7fe59006d7d0 2024-09-13T15:50:16.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe58f7fe640 1 -- 172.21.15.40:0/2726104422 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5800a7050 con 0x7fe59006d7d0 2024-09-13T15:50:16.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe58f7fe640 1 -- 172.21.15.40:0/2726104422 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5800ab7e0 con 0x7fe59006d7d0 2024-09-13T15:50:16.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe5971cc640 1 -- 172.21.15.40:0/2726104422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59006d7d0 msgr2=0x7fe5900b8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe5971cc640 1 --2- 172.21.15.40:0/2726104422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59006d7d0 0x7fe5900b8000 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe580009740 tx=0x7fe58001c390 comp rx=0 tx=0).stop 2024-09-13T15:50:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe5971cc640 1 -- 172.21.15.40:0/2726104422 shutdown_connections 2024-09-13T15:50:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe5971cc640 1 --2- 172.21.15.40:0/2726104422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59006d7d0 0x7fe5900b8000 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe5971cc640 1 -- 172.21.15.40:0/2726104422 >> 172.21.15.40:0/2726104422 conn(0x7fe5900a64c0 msgr2=0x7fe5900a68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe5971cc640 1 -- 172.21.15.40:0/2726104422 shutdown_connections 2024-09-13T15:50:16.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe5971cc640 1 -- 172.21.15.40:0/2726104422 wait complete. 2024-09-13T15:50:16.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe5971cc640 1 Processor -- start 2024-09-13T15:50:16.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe5971cc640 1 -- start start 2024-09-13T15:50:16.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe5971cc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59006d7d0 0x7fe59006caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:16.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.397+0000 7fe5971cc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe590148440 con 0x7fe59006d7d0 2024-09-13T15:50:16.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe594f68640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59006d7d0 0x7fe59006caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:16.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe594f68640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59006d7d0 0x7fe59006caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41614/0 (socket says 172.21.15.40:41614) 2024-09-13T15:50:16.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe594f68640 1 -- 172.21.15.40:0/1789664713 learned_addr learned my addr 172.21.15.40:0/1789664713 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:16.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe594f68640 1 -- 172.21.15.40:0/1789664713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580009420 con 0x7fe59006d7d0 2024-09-13T15:50:16.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe594f68640 1 --2- 172.21.15.40:0/1789664713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59006d7d0 0x7fe59006caf0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe5800ae040 tx=0x7fe58001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:16.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe58d7fa640 1 -- 172.21.15.40:0/1789664713 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5800b7850 con 0x7fe59006d7d0 2024-09-13T15:50:16.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe58d7fa640 1 -- 172.21.15.40:0/1789664713 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5800b79b0 con 0x7fe59006d7d0 2024-09-13T15:50:16.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe5971cc640 1 -- 172.21.15.40:0/1789664713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5900bb720 con 0x7fe59006d7d0 2024-09-13T15:50:16.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe58d7fa640 1 -- 172.21.15.40:0/1789664713 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5800b7c50 con 0x7fe59006d7d0 2024-09-13T15:50:16.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe5971cc640 1 -- 172.21.15.40:0/1789664713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5901605f0 con 0x7fe59006d7d0 2024-09-13T15:50:16.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe58d7fa640 1 -- 172.21.15.40:0/1789664713 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7fe5800b5400 con 0x7fe59006d7d0 2024-09-13T15:50:16.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe5971cc640 1 -- 172.21.15.40:0/1789664713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5900b8e00 con 0x7fe59006d7d0 2024-09-13T15:50:16.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe58d7fa640 1 --2- 172.21.15.40:0/1789664713 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fe57c035530 0x7fe57c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:16.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe58d7fa640 1 -- 172.21.15.40:0/1789664713 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fe5800e3250 con 0x7fe59006d7d0 2024-09-13T15:50:16.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe58ffff640 1 --2- 172.21.15.40:0/1789664713 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fe57c035530 0x7fe57c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:16.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.401+0000 7fe58ffff640 1 --2- 172.21.15.40:0/1789664713 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fe57c035530 0x7fe57c0379f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe59006df90 tx=0x7fe584007ad0 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:16.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.405+0000 7fe58d7fa640 1 -- 172.21.15.40:0/1789664713 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe5800b7db0 con 0x7fe59006d7d0 2024-09-13T15:50:16.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.565+0000 7fe5971cc640 1 -- 172.21.15.40:0/1789664713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe590067510 con 0x7fe59006d7d0 2024-09-13T15:50:16.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.565+0000 7fe58d7fa640 1 -- 172.21.15.40:0/1789664713 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe5800c7af0 con 0x7fe59006d7d0 2024-09-13T15:50:16.569 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.569+0000 7fe5971cc640 1 -- 172.21.15.40:0/1789664713 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fe57c035530 msgr2=0x7fe57c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.569+0000 7fe5971cc640 1 --2- 172.21.15.40:0/1789664713 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fe57c035530 0x7fe57c0379f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe59006df90 tx=0x7fe584007ad0 comp rx=0 tx=0).stop 2024-09-13T15:50:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.569+0000 7fe5971cc640 1 -- 172.21.15.40:0/1789664713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59006d7d0 msgr2=0x7fe59006caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.569+0000 7fe5971cc640 1 --2- 172.21.15.40:0/1789664713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59006d7d0 0x7fe59006caf0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe5800ae040 tx=0x7fe58001abd0 comp rx=0 tx=0).stop 2024-09-13T15:50:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.569+0000 7fe5971cc640 1 -- 172.21.15.40:0/1789664713 shutdown_connections 2024-09-13T15:50:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.569+0000 7fe5971cc640 1 --2- 172.21.15.40:0/1789664713 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fe57c035530 0x7fe57c0379f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.569+0000 7fe5971cc640 1 --2- 172.21.15.40:0/1789664713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe59006d7d0 0x7fe59006caf0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.569+0000 7fe5971cc640 1 -- 172.21.15.40:0/1789664713 >> 172.21.15.40:0/1789664713 conn(0x7fe5900a64c0 msgr2=0x7fe590070630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.569+0000 7fe5971cc640 1 -- 172.21.15.40:0/1789664713 shutdown_connections 2024-09-13T15:50:16.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.569+0000 7fe5971cc640 1 -- 172.21.15.40:0/1789664713 wait complete. 2024-09-13T15:50:16.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:50:16.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.709+0000 7fd0c1796640 1 Processor -- start 2024-09-13T15:50:16.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.709+0000 7fd0c1796640 1 -- start start 2024-09-13T15:50:16.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0c1796640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0bc0bebb0 0x7fd0bc0a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:16.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0c1796640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0bc1515b0 con 0x7fd0bc0b4010 2024-09-13T15:50:16.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0c1796640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0bc14e2c0 con 0x7fd0bc0bebb0 2024-09-13T15:50:16.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0baffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0bc0bebb0 0x7fd0bc0a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:16.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0ba7fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd0bc0b4010 0x7fd0bc06e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54284/0 (socket says 172.21.15.40:54284) 2024-09-13T15:50:16.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0ba7fc640 1 -- 172.21.15.40:0/3720587671 learned_addr learned my addr 172.21.15.40:0/3720587671 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:16.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0b9ffb640 1 -- 172.21.15.40:0/3720587671 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054801154 0 0) 0x7fd0bc1515b0 con 0x7fd0bc0b4010 2024-09-13T15:50:16.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0b9ffb640 1 -- 172.21.15.40:0/3720587671 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a4003530 con 0x7fd0bc0b4010 2024-09-13T15:50:16.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0baffd640 1 -- 172.21.15.40:0/3720587671 >> v1:172.21.15.40:6789/0 conn(0x7fd0bc0b4010 legacy=0x7fd0bc06e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:16.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0baffd640 1 -- 172.21.15.40:0/3720587671 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc06f830 con 0x7fd0bc0bebb0 2024-09-13T15:50:16.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0baffd640 1 --2- 172.21.15.40:0/3720587671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc0bebb0 0x7fd0bc0a4d70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac009d90 tx=0x7fd0ac01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662e463bb75270c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:16.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0b9ffb640 1 -- 172.21.15.40:0/3720587671 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0bc0b6bc0 con 0x7fd0bc0bebb0 2024-09-13T15:50:16.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0b9ffb640 1 -- 172.21.15.40:0/3720587671 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac0a56e0 con 0x7fd0bc0bebb0 2024-09-13T15:50:16.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.713+0000 7fd0b9ffb640 1 -- 172.21.15.40:0/3720587671 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0ac0a59a0 con 0x7fd0bc0bebb0 2024-09-13T15:50:16.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 -- 172.21.15.40:0/3720587671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc0bebb0 msgr2=0x7fd0bc0a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:16.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 --2- 172.21.15.40:0/3720587671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc0bebb0 0x7fd0bc0a4d70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac009d90 tx=0x7fd0ac01c970 comp rx=0 tx=0).stop 2024-09-13T15:50:16.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 -- 172.21.15.40:0/3720587671 shutdown_connections 2024-09-13T15:50:16.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 --2- 172.21.15.40:0/3720587671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc0bebb0 0x7fd0bc0a4d70 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:16.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 -- 172.21.15.40:0/3720587671 >> 172.21.15.40:0/3720587671 conn(0x7fd0bc06a540 msgr2=0x7fd0bc0a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:16.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 -- 172.21.15.40:0/3720587671 shutdown_connections 2024-09-13T15:50:16.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 -- 172.21.15.40:0/3720587671 wait complete. 2024-09-13T15:50:16.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 Processor -- start 2024-09-13T15:50:16.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 -- start start 2024-09-13T15:50:16.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc0b4010 0x7fd0bc1423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:16.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc0c1050 con 0x7fd0bc0b4010 2024-09-13T15:50:16.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0baffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc0b4010 0x7fd0bc1423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:16.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0baffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc0b4010 0x7fd0bc1423a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41634/0 (socket says 172.21.15.40:41634) 2024-09-13T15:50:16.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0baffd640 1 -- 172.21.15.40:0/1741905877 learned_addr learned my addr 172.21.15.40:0/1741905877 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:16.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0baffd640 1 -- 172.21.15.40:0/1741905877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac009a70 con 0x7fd0bc0b4010 2024-09-13T15:50:16.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0baffd640 1 --2- 172.21.15.40:0/1741905877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc0b4010 0x7fd0bc1423a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac019580 tx=0x7fd0ac019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:16.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0a37fe640 1 -- 172.21.15.40:0/1741905877 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0ac009450 con 0x7fd0bc0b4010 2024-09-13T15:50:16.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0a37fe640 1 -- 172.21.15.40:0/1741905877 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac0a5e00 con 0x7fd0bc0b4010 2024-09-13T15:50:16.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 -- 172.21.15.40:0/1741905877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0bc1f2850 con 0x7fd0bc0b4010 2024-09-13T15:50:16.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0a37fe640 1 -- 172.21.15.40:0/1741905877 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0ac0adad0 con 0x7fd0bc0b4010 2024-09-13T15:50:16.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.717+0000 7fd0c1796640 1 -- 172.21.15.40:0/1741905877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc145520 con 0x7fd0bc0b4010 2024-09-13T15:50:16.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.721+0000 7fd0a37fe640 1 -- 172.21.15.40:0/1741905877 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7fd0ac0adc30 con 0x7fd0bc0b4010 2024-09-13T15:50:16.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.721+0000 7fd0a37fe640 1 --2- 172.21.15.40:0/1741905877 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fd0a8035530 0x7fd0a80379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:16.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.721+0000 7fd0a37fe640 1 -- 172.21.15.40:0/1741905877 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fd0ac0e38c0 con 0x7fd0bc0b4010 2024-09-13T15:50:16.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.721+0000 7fd0c1796640 1 -- 172.21.15.40:0/1741905877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0bc1457d0 con 0x7fd0bc0b4010 2024-09-13T15:50:16.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.721+0000 7fd0ba7fc640 1 --2- 172.21.15.40:0/1741905877 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fd0a8035530 0x7fd0a80379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:16.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.721+0000 7fd0ba7fc640 1 --2- 172.21.15.40:0/1741905877 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fd0a8035530 0x7fd0a80379f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0007fd0 tx=0x7fd0b0007980 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:16.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.725+0000 7fd0a37fe640 1 -- 172.21.15.40:0/1741905877 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd0ac0bd020 con 0x7fd0bc0b4010 2024-09-13T15:50:16.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.889+0000 7fd0c1796640 1 -- 172.21.15.40:0/1741905877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0bc0a4d70 con 0x7fd0bc0b4010 2024-09-13T15:50:16.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.893+0000 7fd0a37fe640 1 -- 172.21.15.40:0/1741905877 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0ac0b2070 con 0x7fd0bc0b4010 2024-09-13T15:50:16.894 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-09-13T15:50:16.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.893+0000 7fd0c1796640 1 -- 172.21.15.40:0/1741905877 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fd0a8035530 msgr2=0x7fd0a80379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.893+0000 7fd0c1796640 1 --2- 172.21.15.40:0/1741905877 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fd0a8035530 0x7fd0a80379f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0007fd0 tx=0x7fd0b0007980 comp rx=0 tx=0).stop 2024-09-13T15:50:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.893+0000 7fd0c1796640 1 -- 172.21.15.40:0/1741905877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc0b4010 msgr2=0x7fd0bc1423a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.893+0000 7fd0c1796640 1 --2- 172.21.15.40:0/1741905877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc0b4010 0x7fd0bc1423a0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac019580 tx=0x7fd0ac019710 comp rx=0 tx=0).stop 2024-09-13T15:50:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.893+0000 7fd0c1796640 1 -- 172.21.15.40:0/1741905877 shutdown_connections 2024-09-13T15:50:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.893+0000 7fd0c1796640 1 --2- 172.21.15.40:0/1741905877 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fd0a8035530 0x7fd0a80379f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.893+0000 7fd0c1796640 1 --2- 172.21.15.40:0/1741905877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0bc0b4010 0x7fd0bc1423a0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.893+0000 7fd0c1796640 1 -- 172.21.15.40:0/1741905877 >> 172.21.15.40:0/1741905877 conn(0x7fd0bc06a540 msgr2=0x7fd0bc0be110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.893+0000 7fd0c1796640 1 -- 172.21.15.40:0/1741905877 shutdown_connections 2024-09-13T15:50:16.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:16.893+0000 7fd0c1796640 1 -- 172.21.15.40:0/1741905877 wait complete. 2024-09-13T15:50:16.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc.meta pg_num 2024-09-13T15:50:17.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.033+0000 7fe4feabd640 1 Processor -- start 2024-09-13T15:50:17.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.033+0000 7fe4feabd640 1 -- start start 2024-09-13T15:50:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4feabd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4f80b8670 0x7fe4f80b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4feabd640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f80bac80 con 0x7fe4f8071900 2024-09-13T15:50:17.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4feabd640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f80706f0 con 0x7fe4f80b8670 2024-09-13T15:50:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4f7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4f80b8670 0x7fe4f80b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4f7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4f80b8670 0x7fe4f80b79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41680/0 (socket says 172.21.15.40:41680) 2024-09-13T15:50:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4f7fff640 1 -- 172.21.15.40:0/1447922693 learned_addr learned my addr 172.21.15.40:0/1447922693 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4f7fff640 1 -- 172.21.15.40:0/1447922693 >> v1:172.21.15.40:6789/0 conn(0x7fe4f8071900 legacy=0x7fe4f806fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4f7fff640 1 -- 172.21.15.40:0/1447922693 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80703c0 con 0x7fe4f80b8670 2024-09-13T15:50:17.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4f7fff640 1 --2- 172.21.15.40:0/1447922693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80b8670 0x7fe4f80b79d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0097f0 tx=0x7fe4ec01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4e2f7650e72048 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:17.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4f77fe640 1 -- 172.21.15.40:0/1447922693 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4ec0aa590 con 0x7fe4f80b8670 2024-09-13T15:50:17.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4f77fe640 1 -- 172.21.15.40:0/1447922693 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec0aa6f0 con 0x7fe4f80b8670 2024-09-13T15:50:17.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4f77fe640 1 -- 172.21.15.40:0/1447922693 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4ec0aa9b0 con 0x7fe4f80b8670 2024-09-13T15:50:17.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4feabd640 1 -- 172.21.15.40:0/1447922693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80b8670 msgr2=0x7fe4f80b79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4feabd640 1 --2- 172.21.15.40:0/1447922693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80b8670 0x7fe4f80b79d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0097f0 tx=0x7fe4ec01c4e0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4feabd640 1 -- 172.21.15.40:0/1447922693 shutdown_connections 2024-09-13T15:50:17.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4feabd640 1 --2- 172.21.15.40:0/1447922693 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f80b8670 0x7fe4f80b79d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4feabd640 1 -- 172.21.15.40:0/1447922693 >> 172.21.15.40:0/1447922693 conn(0x7fe4f8065f10 msgr2=0x7fe4f8070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:17.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4feabd640 1 -- 172.21.15.40:0/1447922693 shutdown_connections 2024-09-13T15:50:17.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.037+0000 7fe4feabd640 1 -- 172.21.15.40:0/1447922693 wait complete. 2024-09-13T15:50:17.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4feabd640 1 Processor -- start 2024-09-13T15:50:17.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4feabd640 1 -- start start 2024-09-13T15:50:17.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4feabd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8071900 0x7fe4f814c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:17.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4feabd640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f81508c0 con 0x7fe4f8071900 2024-09-13T15:50:17.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4fc859640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8071900 0x7fe4f814c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:17.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4fc859640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8071900 0x7fe4f814c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41682/0 (socket says 172.21.15.40:41682) 2024-09-13T15:50:17.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4fc859640 1 -- 172.21.15.40:0/910819216 learned_addr learned my addr 172.21.15.40:0/910819216 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:17.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4fc859640 1 -- 172.21.15.40:0/910819216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec0094d0 con 0x7fe4f8071900 2024-09-13T15:50:17.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4fc859640 1 --2- 172.21.15.40:0/910819216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8071900 0x7fe4f814c460 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800c7f0 tx=0x7fe4e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:17.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4f57fa640 1 -- 172.21.15.40:0/910819216 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4e8006c90 con 0x7fe4f8071900 2024-09-13T15:50:17.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4f57fa640 1 -- 172.21.15.40:0/910819216 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e8006e10 con 0x7fe4f8071900 2024-09-13T15:50:17.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4f57fa640 1 -- 172.21.15.40:0/910819216 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4e800a960 con 0x7fe4f8071900 2024-09-13T15:50:17.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4feabd640 1 -- 172.21.15.40:0/910819216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f8150af0 con 0x7fe4f8071900 2024-09-13T15:50:17.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4feabd640 1 -- 172.21.15.40:0/910819216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f814fa80 con 0x7fe4f8071900 2024-09-13T15:50:17.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4f57fa640 1 -- 172.21.15.40:0/910819216 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7fe4e800aac0 con 0x7fe4f8071900 2024-09-13T15:50:17.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4feabd640 1 -- 172.21.15.40:0/910819216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f80b79d0 con 0x7fe4f8071900 2024-09-13T15:50:17.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4f57fa640 1 --2- 172.21.15.40:0/910819216 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fe4e4035530 0x7fe4e40379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:17.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.041+0000 7fe4f57fa640 1 -- 172.21.15.40:0/910819216 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fe4e8047d40 con 0x7fe4f8071900 2024-09-13T15:50:17.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.045+0000 7fe4f7fff640 1 --2- 172.21.15.40:0/910819216 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fe4e4035530 0x7fe4e40379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:17.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.045+0000 7fe4f7fff640 1 --2- 172.21.15.40:0/910819216 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fe4e4035530 0x7fe4e40379f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0ae000 tx=0x7fe4ec008040 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:17.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.049+0000 7fe4f57fa640 1 -- 172.21.15.40:0/910819216 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4e8019310 con 0x7fe4f8071900 2024-09-13T15:50:17.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.205+0000 7fe4feabd640 1 -- 172.21.15.40:0/910819216 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc.meta", "var": "pg_num"} v 0) v1 -- 0x7fe4f80c15c0 con 0x7fe4f8071900 2024-09-13T15:50:17.211 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.209+0000 7fe4f57fa640 1 -- 172.21.15.40:0/910819216 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc.meta", "var": "pg_num"}]=0 v51) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe4e8016020 con 0x7fe4f8071900 2024-09-13T15:50:17.211 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.209+0000 7fe4feabd640 1 -- 172.21.15.40:0/910819216 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fe4e4035530 msgr2=0x7fe4e40379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.209+0000 7fe4feabd640 1 --2- 172.21.15.40:0/910819216 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fe4e4035530 0x7fe4e40379f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0ae000 tx=0x7fe4ec008040 comp rx=0 tx=0).stop 2024-09-13T15:50:17.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.209+0000 7fe4feabd640 1 -- 172.21.15.40:0/910819216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8071900 msgr2=0x7fe4f814c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.209+0000 7fe4feabd640 1 --2- 172.21.15.40:0/910819216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8071900 0x7fe4f814c460 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800c7f0 tx=0x7fe4e800ccb0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.209+0000 7fe4feabd640 1 -- 172.21.15.40:0/910819216 shutdown_connections 2024-09-13T15:50:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.209+0000 7fe4feabd640 1 --2- 172.21.15.40:0/910819216 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fe4e4035530 0x7fe4e40379f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.209+0000 7fe4feabd640 1 --2- 172.21.15.40:0/910819216 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4f8071900 0x7fe4f814c460 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.209+0000 7fe4feabd640 1 -- 172.21.15.40:0/910819216 >> 172.21.15.40:0/910819216 conn(0x7fe4f8065f10 msgr2=0x7fe4f80bd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.209+0000 7fe4feabd640 1 -- 172.21.15.40:0/910819216 shutdown_connections 2024-09-13T15:50:17.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.209+0000 7fe4feabd640 1 -- 172.21.15.40:0/910819216 wait complete. 2024-09-13T15:50:17.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc.data pg_num 2024-09-13T15:50:17.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.345+0000 7f339a81c640 1 Processor -- start 2024-09-13T15:50:17.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.345+0000 7f339a81c640 1 -- start start 2024-09-13T15:50:17.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f339a81c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3394153f60 0x7f33940c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:17.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f339a81c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33940a7850 con 0x7f33940b7bd0 2024-09-13T15:50:17.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f339a81c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339408c4f0 con 0x7f3394153f60 2024-09-13T15:50:17.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f33937fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f33940b7bd0 0x7f33940c06e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54304/0 (socket says 172.21.15.40:54304) 2024-09-13T15:50:17.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f33937fe640 1 -- 172.21.15.40:0/1769358965 learned_addr learned my addr 172.21.15.40:0/1769358965 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:17.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f3393fff640 1 --2- 172.21.15.40:0/1769358965 >> v2:172.21.15.40:3300/0 conn(0x7f3394153f60 0x7f33940c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:17.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f3393fff640 1 -- 172.21.15.40:0/1769358965 >> v1:172.21.15.40:6789/0 conn(0x7f33940b7bd0 legacy=0x7f33940c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f3393fff640 1 -- 172.21.15.40:0/1769358965 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339408bdb0 con 0x7f3394153f60 2024-09-13T15:50:17.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f3393fff640 1 --2- 172.21.15.40:0/1769358965 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3394153f60 0x7f33940c4b90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3384009dc0 tx=0x7f338401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e8573351cb5311 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:17.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f3392ffd640 1 -- 172.21.15.40:0/1769358965 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33840a5790 con 0x7f3394153f60 2024-09-13T15:50:17.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f3392ffd640 1 -- 172.21.15.40:0/1769358965 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33840a58f0 con 0x7f3394153f60 2024-09-13T15:50:17.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f3392ffd640 1 -- 172.21.15.40:0/1769358965 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33840a5bb0 con 0x7f3394153f60 2024-09-13T15:50:17.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f339a81c640 1 -- 172.21.15.40:0/1769358965 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3394153f60 msgr2=0x7f33940c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f339a81c640 1 --2- 172.21.15.40:0/1769358965 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3394153f60 0x7f33940c4b90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3384009dc0 tx=0x7f338401c950 comp rx=0 tx=0).stop 2024-09-13T15:50:17.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f339a81c640 1 -- 172.21.15.40:0/1769358965 shutdown_connections 2024-09-13T15:50:17.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.349+0000 7f339a81c640 1 --2- 172.21.15.40:0/1769358965 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3394153f60 0x7f33940c4b90 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f339a81c640 1 -- 172.21.15.40:0/1769358965 >> 172.21.15.40:0/1769358965 conn(0x7f33940a8640 msgr2=0x7f3394065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:17.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f339a81c640 1 -- 172.21.15.40:0/1769358965 shutdown_connections 2024-09-13T15:50:17.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f339a81c640 1 -- 172.21.15.40:0/1769358965 wait complete. 2024-09-13T15:50:17.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f339a81c640 1 Processor -- start 2024-09-13T15:50:17.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f339a81c640 1 -- start start 2024-09-13T15:50:17.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f339a81c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33940b7bd0 0x7f3394156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:17.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f339a81c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940c07e0 con 0x7f33940b7bd0 2024-09-13T15:50:17.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f3393fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33940b7bd0 0x7f3394156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:17.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f3393fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33940b7bd0 0x7f3394156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41694/0 (socket says 172.21.15.40:41694) 2024-09-13T15:50:17.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f3393fff640 1 -- 172.21.15.40:0/3754695085 learned_addr learned my addr 172.21.15.40:0/3754695085 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:17.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f3393fff640 1 -- 172.21.15.40:0/3754695085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384009a70 con 0x7f33940b7bd0 2024-09-13T15:50:17.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f3393fff640 1 --2- 172.21.15.40:0/3754695085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33940b7bd0 0x7f3394156f30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f338401a580 tx=0x7f33840196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:17.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f3390ff9640 1 -- 172.21.15.40:0/3754695085 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33840ad780 con 0x7f33940b7bd0 2024-09-13T15:50:17.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f3390ff9640 1 -- 172.21.15.40:0/3754695085 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33840ad8e0 con 0x7f33940b7bd0 2024-09-13T15:50:17.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f339a81c640 1 -- 172.21.15.40:0/3754695085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33941ea790 con 0x7f33940b7bd0 2024-09-13T15:50:17.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f3390ff9640 1 -- 172.21.15.40:0/3754695085 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33840adbc0 con 0x7f33940b7bd0 2024-09-13T15:50:17.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.353+0000 7f339a81c640 1 -- 172.21.15.40:0/3754695085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33941ebf60 con 0x7f33940b7bd0 2024-09-13T15:50:17.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.357+0000 7f339a81c640 1 -- 172.21.15.40:0/3754695085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3394067510 con 0x7f33940b7bd0 2024-09-13T15:50:17.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.357+0000 7f3390ff9640 1 -- 172.21.15.40:0/3754695085 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f33840b4050 con 0x7f33940b7bd0 2024-09-13T15:50:17.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.357+0000 7f3390ff9640 1 --2- 172.21.15.40:0/3754695085 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3380035530 0x7f33800379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:17.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.357+0000 7f3390ff9640 1 -- 172.21.15.40:0/3754695085 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f33840e3870 con 0x7f33940b7bd0 2024-09-13T15:50:17.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.357+0000 7f33937fe640 1 --2- 172.21.15.40:0/3754695085 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3380035530 0x7f33800379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:17.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.357+0000 7f33937fe640 1 --2- 172.21.15.40:0/3754695085 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3380035530 0x7f33800379f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3388001610 tx=0x7f3388007ad0 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:17.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.361+0000 7f3390ff9640 1 -- 172.21.15.40:0/3754695085 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f33840c0950 con 0x7f33940b7bd0 2024-09-13T15:50:17.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.517+0000 7f339a81c640 1 -- 172.21.15.40:0/3754695085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc.data", "var": "pg_num"} v 0) v1 -- 0x7f3394161e20 con 0x7f33940b7bd0 2024-09-13T15:50:17.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.521+0000 7f3390ff9640 1 -- 172.21.15.40:0/3754695085 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc.data", "var": "pg_num"}]=0 v51) v1 ==== 103+0+11 (secure 0 0 0) 0x7f33840c70a0 con 0x7f33940b7bd0 2024-09-13T15:50:17.523 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:17.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.521+0000 7f339a81c640 1 -- 172.21.15.40:0/3754695085 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3380035530 msgr2=0x7f33800379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.521+0000 7f339a81c640 1 --2- 172.21.15.40:0/3754695085 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3380035530 0x7f33800379f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3388001610 tx=0x7f3388007ad0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.521+0000 7f339a81c640 1 -- 172.21.15.40:0/3754695085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33940b7bd0 msgr2=0x7f3394156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.521+0000 7f339a81c640 1 --2- 172.21.15.40:0/3754695085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33940b7bd0 0x7f3394156f30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f338401a580 tx=0x7f33840196f0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.521+0000 7f339a81c640 1 -- 172.21.15.40:0/3754695085 shutdown_connections 2024-09-13T15:50:17.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.521+0000 7f339a81c640 1 --2- 172.21.15.40:0/3754695085 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3380035530 0x7f33800379f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.521+0000 7f339a81c640 1 --2- 172.21.15.40:0/3754695085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33940b7bd0 0x7f3394156f30 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.521+0000 7f339a81c640 1 -- 172.21.15.40:0/3754695085 >> 172.21.15.40:0/3754695085 conn(0x7f33940a8640 msgr2=0x7f33940c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:17.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.521+0000 7f339a81c640 1 -- 172.21.15.40:0/3754695085 shutdown_connections 2024-09-13T15:50:17.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.521+0000 7f339a81c640 1 -- 172.21.15.40:0/3754695085 wait complete. 2024-09-13T15:50:17.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc-backup.meta pg_num 2024-09-13T15:50:17.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.673+0000 7f99b8e7a640 1 Processor -- start 2024-09-13T15:50:17.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.673+0000 7f99b8e7a640 1 -- start start 2024-09-13T15:50:17.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.673+0000 7f99b8e7a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99b4153f60 0x7f99b40c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:17.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.673+0000 7f99b8e7a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b40a7850 con 0x7f99b40b7bd0 2024-09-13T15:50:17.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.673+0000 7f99b8e7a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b408c4f0 con 0x7f99b4153f60 2024-09-13T15:50:17.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.673+0000 7f99b259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99b4153f60 0x7f99b40c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:17.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.673+0000 7f99b259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99b4153f60 0x7f99b40c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41704/0 (socket says 172.21.15.40:41704) 2024-09-13T15:50:17.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.673+0000 7f99b259c640 1 -- 172.21.15.40:0/535280710 learned_addr learned my addr 172.21.15.40:0/535280710 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:17.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.673+0000 7f99b259c640 1 -- 172.21.15.40:0/535280710 >> v1:172.21.15.40:6789/0 conn(0x7f99b40b7bd0 legacy=0x7f99b40c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.673+0000 7f99b259c640 1 -- 172.21.15.40:0/535280710 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b408bdb0 con 0x7f99b4153f60 2024-09-13T15:50:17.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.673+0000 7f99b259c640 1 --2- 172.21.15.40:0/535280710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99b4153f60 0x7f99b40c4b90 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009820 tx=0x7f99a401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ad2c023594bca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:17.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b159a640 1 -- 172.21.15.40:0/535280710 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99a40a8050 con 0x7f99b4153f60 2024-09-13T15:50:17.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b159a640 1 -- 172.21.15.40:0/535280710 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a40ac520 con 0x7f99b4153f60 2024-09-13T15:50:17.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b159a640 1 -- 172.21.15.40:0/535280710 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99a40ac7e0 con 0x7f99b4153f60 2024-09-13T15:50:17.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 -- 172.21.15.40:0/535280710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99b4153f60 msgr2=0x7f99b40c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 --2- 172.21.15.40:0/535280710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99b4153f60 0x7f99b40c4b90 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f99a4009820 tx=0x7f99a401c4c0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 -- 172.21.15.40:0/535280710 shutdown_connections 2024-09-13T15:50:17.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 --2- 172.21.15.40:0/535280710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99b4153f60 0x7f99b40c4b90 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 -- 172.21.15.40:0/535280710 >> 172.21.15.40:0/535280710 conn(0x7f99b40a8640 msgr2=0x7f99b4065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:17.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 -- 172.21.15.40:0/535280710 shutdown_connections 2024-09-13T15:50:17.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 -- 172.21.15.40:0/535280710 wait complete. 2024-09-13T15:50:17.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 Processor -- start 2024-09-13T15:50:17.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 -- start start 2024-09-13T15:50:17.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99b40b7bd0 0x7f99b4156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:17.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40c07e0 con 0x7f99b40b7bd0 2024-09-13T15:50:17.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99b40b7bd0 0x7f99b4156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:17.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99b40b7bd0 0x7f99b4156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41718/0 (socket says 172.21.15.40:41718) 2024-09-13T15:50:17.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b259c640 1 -- 172.21.15.40:0/3936607045 learned_addr learned my addr 172.21.15.40:0/3936607045 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:17.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b259c640 1 -- 172.21.15.40:0/3936607045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a40094d0 con 0x7f99b40b7bd0 2024-09-13T15:50:17.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b259c640 1 --2- 172.21.15.40:0/3936607045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99b40b7bd0 0x7f99b4156f30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f99a401ab70 tx=0x7f99a401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:17.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99a2ffd640 1 -- 172.21.15.40:0/3936607045 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99a40b7630 con 0x7f99b40b7bd0 2024-09-13T15:50:17.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99a2ffd640 1 -- 172.21.15.40:0/3936607045 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a40b7790 con 0x7f99b40b7bd0 2024-09-13T15:50:17.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 -- 172.21.15.40:0/3936607045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b41ea790 con 0x7f99b40b7bd0 2024-09-13T15:50:17.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99a2ffd640 1 -- 172.21.15.40:0/3936607045 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99a40b7a50 con 0x7f99b40b7bd0 2024-09-13T15:50:17.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.677+0000 7f99b8e7a640 1 -- 172.21.15.40:0/3936607045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b41ebf60 con 0x7f99b40b7bd0 2024-09-13T15:50:17.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.681+0000 7f99a2ffd640 1 -- 172.21.15.40:0/3936607045 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f99a40b3040 con 0x7f99b40b7bd0 2024-09-13T15:50:17.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.681+0000 7f99b8e7a640 1 -- 172.21.15.40:0/3936607045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b4067510 con 0x7f99b40b7bd0 2024-09-13T15:50:17.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.681+0000 7f99a2ffd640 1 --2- 172.21.15.40:0/3936607045 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9994035530 0x7f99940379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:17.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.681+0000 7f99a2ffd640 1 -- 172.21.15.40:0/3936607045 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f99a40e2c40 con 0x7f99b40b7bd0 2024-09-13T15:50:17.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.681+0000 7f99b1d9b640 1 --2- 172.21.15.40:0/3936607045 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9994035530 0x7f99940379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:17.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.681+0000 7f99b1d9b640 1 --2- 172.21.15.40:0/3936607045 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9994035530 0x7f99940379f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f99a8000f70 tx=0x7f99a8007a40 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:17.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.685+0000 7f99a2ffd640 1 -- 172.21.15.40:0/3936607045 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99a40ab980 con 0x7f99b40b7bd0 2024-09-13T15:50:17.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.845+0000 7f99b8e7a640 1 -- 172.21.15.40:0/3936607045 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc-backup.meta", "var": "pg_num"} v 0) v1 -- 0x7f99b4161e20 con 0x7f99b40b7bd0 2024-09-13T15:50:17.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.849+0000 7f99a2ffd640 1 -- 172.21.15.40:0/3936607045 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc-backup.meta", "var": "pg_num"}]=0 v51) v1 ==== 110+0+11 (secure 0 0 0) 0x7f99a40b1020 con 0x7f99b40b7bd0 2024-09-13T15:50:17.850 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.849+0000 7f99b8e7a640 1 -- 172.21.15.40:0/3936607045 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9994035530 msgr2=0x7f99940379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.849+0000 7f99b8e7a640 1 --2- 172.21.15.40:0/3936607045 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9994035530 0x7f99940379f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f99a8000f70 tx=0x7f99a8007a40 comp rx=0 tx=0).stop 2024-09-13T15:50:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.849+0000 7f99b8e7a640 1 -- 172.21.15.40:0/3936607045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99b40b7bd0 msgr2=0x7f99b4156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.849+0000 7f99b8e7a640 1 --2- 172.21.15.40:0/3936607045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99b40b7bd0 0x7f99b4156f30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f99a401ab70 tx=0x7f99a401ad00 comp rx=0 tx=0).stop 2024-09-13T15:50:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.849+0000 7f99b8e7a640 1 -- 172.21.15.40:0/3936607045 shutdown_connections 2024-09-13T15:50:17.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.849+0000 7f99b8e7a640 1 --2- 172.21.15.40:0/3936607045 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9994035530 0x7f99940379f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.849+0000 7f99b8e7a640 1 --2- 172.21.15.40:0/3936607045 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99b40b7bd0 0x7f99b4156f30 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.849+0000 7f99b8e7a640 1 -- 172.21.15.40:0/3936607045 >> 172.21.15.40:0/3936607045 conn(0x7f99b40a8640 msgr2=0x7f99b40c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.849+0000 7f99b8e7a640 1 -- 172.21.15.40:0/3936607045 shutdown_connections 2024-09-13T15:50:17.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.849+0000 7f99b8e7a640 1 -- 172.21.15.40:0/3936607045 wait complete. 2024-09-13T15:50:17.870 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc-backup.data pg_num 2024-09-13T15:50:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.985+0000 7f6ac8425640 1 Processor -- start 2024-09-13T15:50:17.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.985+0000 7f6ac8425640 1 -- start start 2024-09-13T15:50:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac8425640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ac00a2220 0x7f6ac00bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac8425640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac00a50c0 con 0x7f6ac006e730 2024-09-13T15:50:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac8425640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac00a26b0 con 0x7f6ac00a2220 2024-09-13T15:50:17.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac59c0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ac00a2220 0x7f6ac00bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac59c0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ac00a2220 0x7f6ac00bd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41734/0 (socket says 172.21.15.40:41734) 2024-09-13T15:50:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac59c0640 1 -- 172.21.15.40:0/321064080 learned_addr learned my addr 172.21.15.40:0/321064080 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac61c1640 1 --1- 172.21.15.40:0/321064080 >> v1:172.21.15.40:6789/0 conn(0x7f6ac006e730 0x7f6ac00c0e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54322/0 (socket says 172.21.15.40:54322) 2024-09-13T15:50:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac59c0640 1 -- 172.21.15.40:0/321064080 >> v1:172.21.15.40:6789/0 conn(0x7f6ac006e730 legacy=0x7f6ac00c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac59c0640 1 -- 172.21.15.40:0/321064080 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac00bfc70 con 0x7f6ac00a2220 2024-09-13T15:50:17.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac59c0640 1 --2- 172.21.15.40:0/321064080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ac00a2220 0x7f6ac00bd5f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40097f0 tx=0x7f6ab401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca79a15544ba81bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac51bf640 1 -- 172.21.15.40:0/321064080 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ab40ab530 con 0x7f6ac00a2220 2024-09-13T15:50:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac51bf640 1 -- 172.21.15.40:0/321064080 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab40a7050 con 0x7f6ac00a2220 2024-09-13T15:50:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac51bf640 1 -- 172.21.15.40:0/321064080 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ab40ab7e0 con 0x7f6ac00a2220 2024-09-13T15:50:17.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac8425640 1 -- 172.21.15.40:0/321064080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ac00a2220 msgr2=0x7f6ac00bd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac8425640 1 --2- 172.21.15.40:0/321064080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ac00a2220 0x7f6ac00bd5f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40097f0 tx=0x7f6ab401c4e0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac8425640 1 -- 172.21.15.40:0/321064080 shutdown_connections 2024-09-13T15:50:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac8425640 1 --2- 172.21.15.40:0/321064080 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ac00a2220 0x7f6ac00bd5f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac8425640 1 -- 172.21.15.40:0/321064080 >> 172.21.15.40:0/321064080 conn(0x7f6ac006a540 msgr2=0x7f6ac00a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac8425640 1 -- 172.21.15.40:0/321064080 shutdown_connections 2024-09-13T15:50:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.989+0000 7f6ac8425640 1 -- 172.21.15.40:0/321064080 wait complete. 2024-09-13T15:50:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac8425640 1 Processor -- start 2024-09-13T15:50:17.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac8425640 1 -- start start 2024-09-13T15:50:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac8425640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ac006e730 0x7f6ac0154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac8425640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac0154db0 con 0x7f6ac006e730 2024-09-13T15:50:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac61c1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ac006e730 0x7f6ac0154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac61c1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ac006e730 0x7f6ac0154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41748/0 (socket says 172.21.15.40:41748) 2024-09-13T15:50:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac61c1640 1 -- 172.21.15.40:0/171841627 learned_addr learned my addr 172.21.15.40:0/171841627 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac61c1640 1 -- 172.21.15.40:0/171841627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40094d0 con 0x7f6ac006e730 2024-09-13T15:50:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac61c1640 1 --2- 172.21.15.40:0/171841627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ac006e730 0x7f6ac0154550 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000c410 tx=0x7f6ab000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6abeffd640 1 -- 172.21.15.40:0/171841627 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ab0007410 con 0x7f6ac006e730 2024-09-13T15:50:17.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6abeffd640 1 -- 172.21.15.40:0/171841627 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab0007570 con 0x7f6ac006e730 2024-09-13T15:50:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac8425640 1 -- 172.21.15.40:0/171841627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac0162c30 con 0x7f6ac006e730 2024-09-13T15:50:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6abeffd640 1 -- 172.21.15.40:0/171841627 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ab00047f0 con 0x7f6ac006e730 2024-09-13T15:50:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac8425640 1 -- 172.21.15.40:0/171841627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac01f09b0 con 0x7f6ac006e730 2024-09-13T15:50:17.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6abeffd640 1 -- 172.21.15.40:0/171841627 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f6ab0004950 con 0x7f6ac006e730 2024-09-13T15:50:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac8425640 1 -- 172.21.15.40:0/171841627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac01f0ba0 con 0x7f6ac006e730 2024-09-13T15:50:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6abeffd640 1 --2- 172.21.15.40:0/171841627 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6aac035530 0x7f6aac0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6abeffd640 1 -- 172.21.15.40:0/171841627 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f6ab0047de0 con 0x7f6ac006e730 2024-09-13T15:50:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac59c0640 1 --2- 172.21.15.40:0/171841627 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6aac035530 0x7f6aac0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:17.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.993+0000 7f6ac59c0640 1 --2- 172.21.15.40:0/171841627 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6aac035530 0x7f6aac0379f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40ad000 tx=0x7f6ab40a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:18.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:17.997+0000 7f6abeffd640 1 -- 172.21.15.40:0/171841627 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6ab00192c0 con 0x7f6ac006e730 2024-09-13T15:50:18.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.157+0000 7f6ac8425640 1 -- 172.21.15.40:0/171841627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc-backup.data", "var": "pg_num"} v 0) v1 -- 0x7f6ac00bd5f0 con 0x7f6ac006e730 2024-09-13T15:50:18.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.157+0000 7f6abeffd640 1 -- 172.21.15.40:0/171841627 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc-backup.data", "var": "pg_num"}]=0 v51) v1 ==== 110+0+11 (secure 0 0 0) 0x7f6ab001aac0 con 0x7f6ac006e730 2024-09-13T15:50:18.160 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:18.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.161+0000 7f6ac8425640 1 -- 172.21.15.40:0/171841627 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6aac035530 msgr2=0x7f6aac0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:18.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.161+0000 7f6ac8425640 1 --2- 172.21.15.40:0/171841627 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6aac035530 0x7f6aac0379f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40ad000 tx=0x7f6ab40a6000 comp rx=0 tx=0).stop 2024-09-13T15:50:18.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.161+0000 7f6ac8425640 1 -- 172.21.15.40:0/171841627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ac006e730 msgr2=0x7f6ac0154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:18.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.161+0000 7f6ac8425640 1 --2- 172.21.15.40:0/171841627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ac006e730 0x7f6ac0154550 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000c410 tx=0x7f6ab000c8d0 comp rx=0 tx=0).stop 2024-09-13T15:50:18.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.161+0000 7f6ac8425640 1 -- 172.21.15.40:0/171841627 shutdown_connections 2024-09-13T15:50:18.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.161+0000 7f6ac8425640 1 --2- 172.21.15.40:0/171841627 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6aac035530 0x7f6aac0379f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:18.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.161+0000 7f6ac8425640 1 --2- 172.21.15.40:0/171841627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ac006e730 0x7f6ac0154550 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:18.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.161+0000 7f6ac8425640 1 -- 172.21.15.40:0/171841627 >> 172.21.15.40:0/171841627 conn(0x7f6ac006a540 msgr2=0x7f6ac00bcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:18.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.161+0000 7f6ac8425640 1 -- 172.21.15.40:0/171841627 shutdown_connections 2024-09-13T15:50:18.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.161+0000 7f6ac8425640 1 -- 172.21.15.40:0/171841627 wait complete. 2024-09-13T15:50:18.180 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:50:18.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.297+0000 7f0316c26640 1 Processor -- start 2024-09-13T15:50:18.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.297+0000 7f0316c26640 1 -- start start 2024-09-13T15:50:18.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.297+0000 7f0316c26640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0310153f60 0x7f03100c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:18.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.297+0000 7f0316c26640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03100a7850 con 0x7f03100b7bd0 2024-09-13T15:50:18.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.297+0000 7f0316c26640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f031008c4f0 con 0x7f0310153f60 2024-09-13T15:50:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.297+0000 7f03149c2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0310153f60 0x7f03100c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.297+0000 7f03149c2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0310153f60 0x7f03100c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41754/0 (socket says 172.21.15.40:41754) 2024-09-13T15:50:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.297+0000 7f030ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f03100b7bd0 0x7f03100c06e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54332/0 (socket says 172.21.15.40:54332) 2024-09-13T15:50:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.297+0000 7f03149c2640 1 -- 172.21.15.40:0/3978094562 learned_addr learned my addr 172.21.15.40:0/3978094562 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.297+0000 7f03149c2640 1 -- 172.21.15.40:0/3978094562 >> v1:172.21.15.40:6789/0 conn(0x7f03100b7bd0 legacy=0x7f03100c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:18.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.297+0000 7f03149c2640 1 -- 172.21.15.40:0/3978094562 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031008bdb0 con 0x7f0310153f60 2024-09-13T15:50:18.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f03149c2640 1 --2- 172.21.15.40:0/3978094562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0310153f60 0x7f03100c4b90 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0300009820 tx=0x7f030001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee883e42ab41cd88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:18.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f030f7fe640 1 -- 172.21.15.40:0/3978094562 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03000a8050 con 0x7f0310153f60 2024-09-13T15:50:18.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f030f7fe640 1 -- 172.21.15.40:0/3978094562 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03000ac520 con 0x7f0310153f60 2024-09-13T15:50:18.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f030f7fe640 1 -- 172.21.15.40:0/3978094562 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03000ac7e0 con 0x7f0310153f60 2024-09-13T15:50:18.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f0316c26640 1 -- 172.21.15.40:0/3978094562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0310153f60 msgr2=0x7f03100c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:18.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f0316c26640 1 --2- 172.21.15.40:0/3978094562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0310153f60 0x7f03100c4b90 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0300009820 tx=0x7f030001c4c0 comp rx=0 tx=0).stop 2024-09-13T15:50:18.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f0316c26640 1 -- 172.21.15.40:0/3978094562 shutdown_connections 2024-09-13T15:50:18.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f0316c26640 1 --2- 172.21.15.40:0/3978094562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0310153f60 0x7f03100c4b90 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:18.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f0316c26640 1 -- 172.21.15.40:0/3978094562 >> 172.21.15.40:0/3978094562 conn(0x7f03100a8640 msgr2=0x7f0310065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:18.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f0316c26640 1 -- 172.21.15.40:0/3978094562 shutdown_connections 2024-09-13T15:50:18.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f0316c26640 1 -- 172.21.15.40:0/3978094562 wait complete. 2024-09-13T15:50:18.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f0316c26640 1 Processor -- start 2024-09-13T15:50:18.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.301+0000 7f0316c26640 1 -- start start 2024-09-13T15:50:18.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f0316c26640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03100b7bd0 0x7f03101583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:18.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f0316c26640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03101ebaf0 con 0x7f03100b7bd0 2024-09-13T15:50:18.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f03149c2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03100b7bd0 0x7f03101583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:18.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f03149c2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03100b7bd0 0x7f03101583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:41760/0 (socket says 172.21.15.40:41760) 2024-09-13T15:50:18.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f03149c2640 1 -- 172.21.15.40:0/2619711648 learned_addr learned my addr 172.21.15.40:0/2619711648 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:18.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f03149c2640 1 -- 172.21.15.40:0/2619711648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03000094d0 con 0x7f03100b7bd0 2024-09-13T15:50:18.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f03149c2640 1 --2- 172.21.15.40:0/2619711648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03100b7bd0 0x7f03101583e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f030001ab70 tx=0x7f030001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:18.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f030d7fa640 1 -- 172.21.15.40:0/2619711648 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03000b7630 con 0x7f03100b7bd0 2024-09-13T15:50:18.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f030d7fa640 1 -- 172.21.15.40:0/2619711648 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03000b7790 con 0x7f03100b7bd0 2024-09-13T15:50:18.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f0316c26640 1 -- 172.21.15.40:0/2619711648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031015aa00 con 0x7f03100b7bd0 2024-09-13T15:50:18.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f030d7fa640 1 -- 172.21.15.40:0/2619711648 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03000b7a50 con 0x7f03100b7bd0 2024-09-13T15:50:18.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f0316c26640 1 -- 172.21.15.40:0/2619711648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03101ebe70 con 0x7f03100b7bd0 2024-09-13T15:50:18.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f0316c26640 1 -- 172.21.15.40:0/2619711648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0310067510 con 0x7f03100b7bd0 2024-09-13T15:50:18.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f030d7fa640 1 -- 172.21.15.40:0/2619711648 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f03000b3040 con 0x7f03100b7bd0 2024-09-13T15:50:18.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f030d7fa640 1 --2- 172.21.15.40:0/2619711648 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f02fc035530 0x7f02fc0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:18.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f030d7fa640 1 -- 172.21.15.40:0/2619711648 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f03000e2b80 con 0x7f03100b7bd0 2024-09-13T15:50:18.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f030ffff640 1 --2- 172.21.15.40:0/2619711648 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f02fc035530 0x7f02fc0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:18.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.305+0000 7f030ffff640 1 --2- 172.21.15.40:0/2619711648 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f02fc035530 0x7f02fc0379f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0304001600 tx=0x7f0304007a50 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:18.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.309+0000 7f030d7fa640 1 -- 172.21.15.40:0/2619711648 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03000ab980 con 0x7f03100b7bd0 2024-09-13T15:50:18.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.477+0000 7f0316c26640 1 -- 172.21.15.40:0/2619711648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f03100c0bb0 con 0x7f03100b7bd0 2024-09-13T15:50:18.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.477+0000 7f030d7fa640 1 -- 172.21.15.40:0/2619711648 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 30 entries v51) v1 ==== 81+0+1742 (secure 0 0 0) 0x7f03000b1020 con 0x7f03100b7bd0 2024-09-13T15:50:18.479 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3464899269 2024-09-13T16:49:52.021920+0000 2024-09-13T15:50:18.479 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2020191347 2024-09-13T16:39:12.695853+0000 2024-09-13T15:50:18.479 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3215060720 2024-09-13T16:37:48.656072+0000 2024-09-13T15:50:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2096071371 2024-09-13T16:41:43.833379+0000 2024-09-13T15:50:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1024811135 2024-09-13T16:46:02.884335+0000 2024-09-13T15:50:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1371435748 2024-09-13T16:49:08.427332+0000 2024-09-13T15:50:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1725367853 2024-09-13T16:38:36.652988+0000 2024-09-13T15:50:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2070755866 2024-09-13T16:38:12.598575+0000 2024-09-13T15:50:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/695475091 2024-09-13T16:40:02.785567+0000 2024-09-13T15:50:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/276304017 2024-09-13T16:45:37.498754+0000 2024-09-13T15:50:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3286012502 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:18.480 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2241829794 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2301478808 2024-09-13T16:40:27.738146+0000 2024-09-13T15:50:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6824/3185150828 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/690822190 2024-09-13T16:39:37.683949+0000 2024-09-13T15:50:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/414904326 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3777702470 2024-09-13T16:43:17.229644+0000 2024-09-13T15:50:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3514360215 2024-09-13T16:44:32.325869+0000 2024-09-13T15:50:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3853947452 2024-09-13T16:46:26.907170+0000 2024-09-13T15:50:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1991235795 2024-09-13T16:40:52.760615+0000 2024-09-13T15:50:18.481 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6825/3185150828 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1455634917 2024-09-13T16:47:13.340610+0000 2024-09-13T15:50:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2753473479 2024-09-13T16:42:16.865910+0000 2024-09-13T15:50:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3230130657 2024-09-13T16:42:51.908956+0000 2024-09-13T15:50:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3833267415 2024-09-13T16:48:42.495533+0000 2024-09-13T15:50:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1708466797 2024-09-13T16:43:42.271124+0000 2024-09-13T15:50:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3629684271 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3494260782 2024-09-13T16:41:17.861368+0000 2024-09-13T15:50:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1861863246 2024-09-13T16:44:07.288889+0000 2024-09-13T15:50:18.482 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1129415438 2024-09-13T16:47:37.323733+0000 2024-09-13T15:50:18.483 INFO:teuthology.orchestra.run.smithi040.stderr:listed 30 entries 2024-09-13T15:50:18.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.477+0000 7f0316c26640 1 -- 172.21.15.40:0/2619711648 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f02fc035530 msgr2=0x7f02fc0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:18.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.477+0000 7f0316c26640 1 --2- 172.21.15.40:0/2619711648 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f02fc035530 0x7f02fc0379f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0304001600 tx=0x7f0304007a50 comp rx=0 tx=0).stop 2024-09-13T15:50:18.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.477+0000 7f0316c26640 1 -- 172.21.15.40:0/2619711648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03100b7bd0 msgr2=0x7f03101583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:18.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.477+0000 7f0316c26640 1 --2- 172.21.15.40:0/2619711648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03100b7bd0 0x7f03101583e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f030001ab70 tx=0x7f030001ad00 comp rx=0 tx=0).stop 2024-09-13T15:50:18.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.477+0000 7f0316c26640 1 -- 172.21.15.40:0/2619711648 shutdown_connections 2024-09-13T15:50:18.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.477+0000 7f0316c26640 1 --2- 172.21.15.40:0/2619711648 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f02fc035530 0x7f02fc0379f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:18.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.477+0000 7f0316c26640 1 --2- 172.21.15.40:0/2619711648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03100b7bd0 0x7f03101583e0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:18.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.477+0000 7f0316c26640 1 -- 172.21.15.40:0/2619711648 >> 172.21.15.40:0/2619711648 conn(0x7f03100a8640 msgr2=0x7f03100c3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:18.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.477+0000 7f0316c26640 1 -- 172.21.15.40:0/2619711648 shutdown_connections 2024-09-13T15:50:18.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:18.477+0000 7f0316c26640 1 -- 172.21.15.40:0/2619711648 wait complete. 2024-09-13T15:50:18.497 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2024-09-13T15:50:18.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:50:18.497 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-13T15:50:18.518 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi040.stderr:ceph-fuse[34128]: fuse finished with error 0 and tester_r 0 2024-09-13T15:50:18.593 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:50:24.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:50:24.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:50:24.695 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T15:50:25.169 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:50:25.169 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:50:25.176 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:50:25.176 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:50:25.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:50:25.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.397+0000 7fdd852c5640 1 Processor -- start 2024-09-13T15:50:25.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.397+0000 7fdd852c5640 1 -- start start 2024-09-13T15:50:25.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.397+0000 7fdd852c5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd800b7bd0 0x7fdd800c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:25.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.397+0000 7fdd852c5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd800a7850 con 0x7fdd80153f60 2024-09-13T15:50:25.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.397+0000 7fdd852c5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8008c4f0 con 0x7fdd800b7bd0 2024-09-13T15:50:25.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.397+0000 7fdd7e7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd800b7bd0 0x7fdd800c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:25.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.397+0000 7fdd7effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdd80153f60 0x7fdd800c4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34770/0 (socket says 172.21.15.40:34770) 2024-09-13T15:50:25.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.397+0000 7fdd7effd640 1 -- 172.21.15.40:0/1814759396 learned_addr learned my addr 172.21.15.40:0/1814759396 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:25.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.397+0000 7fdd7e7fc640 1 -- 172.21.15.40:0/1814759396 >> v1:172.21.15.40:6789/0 conn(0x7fdd80153f60 legacy=0x7fdd800c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:25.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.397+0000 7fdd7e7fc640 1 -- 172.21.15.40:0/1814759396 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8008bdb0 con 0x7fdd800b7bd0 2024-09-13T15:50:25.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd7e7fc640 1 --2- 172.21.15.40:0/1814759396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd800b7bd0 0x7fdd800c06e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009770 tx=0x7fdd6801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd87a875346da211 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:25.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd7dffb640 1 -- 172.21.15.40:0/1814759396 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd680ab530 con 0x7fdd800b7bd0 2024-09-13T15:50:25.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd7dffb640 1 -- 172.21.15.40:0/1814759396 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd680a7050 con 0x7fdd800b7bd0 2024-09-13T15:50:25.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd7dffb640 1 -- 172.21.15.40:0/1814759396 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd680ab7e0 con 0x7fdd800b7bd0 2024-09-13T15:50:25.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd852c5640 1 -- 172.21.15.40:0/1814759396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd800b7bd0 msgr2=0x7fdd800c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:25.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd852c5640 1 --2- 172.21.15.40:0/1814759396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd800b7bd0 0x7fdd800c06e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009770 tx=0x7fdd6801c420 comp rx=0 tx=0).stop 2024-09-13T15:50:25.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd852c5640 1 -- 172.21.15.40:0/1814759396 shutdown_connections 2024-09-13T15:50:25.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd852c5640 1 --2- 172.21.15.40:0/1814759396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd800b7bd0 0x7fdd800c06e0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:25.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd852c5640 1 -- 172.21.15.40:0/1814759396 >> 172.21.15.40:0/1814759396 conn(0x7fdd800a8640 msgr2=0x7fdd80065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:25.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd852c5640 1 -- 172.21.15.40:0/1814759396 shutdown_connections 2024-09-13T15:50:25.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd852c5640 1 -- 172.21.15.40:0/1814759396 wait complete. 2024-09-13T15:50:25.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd852c5640 1 Processor -- start 2024-09-13T15:50:25.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd852c5640 1 -- start start 2024-09-13T15:50:25.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd852c5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd800b7bd0 0x7fdd80161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:25.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd852c5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8015be40 con 0x7fdd800b7bd0 2024-09-13T15:50:25.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd7effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd800b7bd0 0x7fdd80161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:25.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd7effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd800b7bd0 0x7fdd80161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53732/0 (socket says 172.21.15.40:53732) 2024-09-13T15:50:25.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd7effd640 1 -- 172.21.15.40:0/1786291163 learned_addr learned my addr 172.21.15.40:0/1786291163 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:25.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd7effd640 1 -- 172.21.15.40:0/1786291163 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd68009420 con 0x7fdd800b7bd0 2024-09-13T15:50:25.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd7effd640 1 --2- 172.21.15.40:0/1786291163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd800b7bd0 0x7fdd80161360 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000c480 tx=0x7fdd7000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:25.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd777fe640 1 -- 172.21.15.40:0/1786291163 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd70005c20 con 0x7fdd800b7bd0 2024-09-13T15:50:25.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd777fe640 1 -- 172.21.15.40:0/1786291163 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd70005d80 con 0x7fdd800b7bd0 2024-09-13T15:50:25.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.401+0000 7fdd777fe640 1 -- 172.21.15.40:0/1786291163 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdd700071a0 con 0x7fdd800b7bd0 2024-09-13T15:50:25.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.405+0000 7fdd852c5640 1 -- 172.21.15.40:0/1786291163 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd80154a40 con 0x7fdd800b7bd0 2024-09-13T15:50:25.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.405+0000 7fdd852c5640 1 -- 172.21.15.40:0/1786291163 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8015c050 con 0x7fdd800b7bd0 2024-09-13T15:50:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.405+0000 7fdd777fe640 1 -- 172.21.15.40:0/1786291163 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7fdd70007300 con 0x7fdd800b7bd0 2024-09-13T15:50:25.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.405+0000 7fdd852c5640 1 -- 172.21.15.40:0/1786291163 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd80067510 con 0x7fdd800b7bd0 2024-09-13T15:50:25.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.405+0000 7fdd777fe640 1 --2- 172.21.15.40:0/1786291163 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fdd60035530 0x7fdd600379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:25.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.405+0000 7fdd777fe640 1 -- 172.21.15.40:0/1786291163 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fdd70047890 con 0x7fdd800b7bd0 2024-09-13T15:50:25.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.405+0000 7fdd7e7fc640 1 --2- 172.21.15.40:0/1786291163 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fdd60035530 0x7fdd600379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:25.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.405+0000 7fdd7e7fc640 1 --2- 172.21.15.40:0/1786291163 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fdd60035530 0x7fdd600379f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009770 tx=0x7fdd680a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:25.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.409+0000 7fdd777fe640 1 -- 172.21.15.40:0/1786291163 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdd7001b3b0 con 0x7fdd800b7bd0 2024-09-13T15:50:25.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.569+0000 7fdd852c5640 1 -- 172.21.15.40:0/1786291163 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd800c06e0 con 0x7fdd800b7bd0 2024-09-13T15:50:25.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.573+0000 7fdd777fe640 1 -- 172.21.15.40:0/1786291163 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+19969 (secure 0 0 0) 0x7fdd70017090 con 0x7fdd800b7bd0 2024-09-13T15:50:25.575 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:50:25.575 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":51,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:49:52.917821+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.2699999809265137,"score_stable":1.2699999809265137,"optimal_score":1,"raw_score_acting":1.2699999809265137,"raw_score_stable":1.2699999809265137,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs.dc.meta","create_time":"2024-09-13T15:34:54.455347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"dc"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs.dc.data","create_time":"2024-09-13T15:34:55.209802+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"dc"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs.dc-backup.meta","create_time":"2024-09-13T15:34:56.580392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"dc-backup"}},"read_balance":{"score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs.dc-backup.data","create_time":"2024-09-13T15:34:57.245673+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"dc-backup"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1c","mappings":[{"from":0,"to":2}]},{"pgid":"3.24","mappings":[{"from":0,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3464899269":"2024-09-13T16:49:52.021920+0000","172.21.15.40:0/2020191347":"2024-09-13T16:39:12.695853+0000","172.21.15.40:0/3215060720":"2024-09-13T16:37:48.656072+0000","172.21.15.40:0/2096071371":"2024-09-13T16:41:43.833379+0000","172.21.15.40:0/1024811135":"2024-09-13T16:46:02.884335+0000","172.21.15.40:0/1371435748":"2024-09-13T16:49:08.427332+0000","172.21.15.40:0/1725367853":"2024-09-13T16:38:36.652988+0000","172.21.15.40:0/2070755866":"2024-09-13T16:38:12.598575+0000","172.21.15.40:0/695475091":"2024-09-13T16:40:02.785567+0000","172.21.15.40:0/276304017":"2024-09-13T16:45:37.498754+0000","172.21.15.40:0/3286012502":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/2241829794":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/2301478808":"2024-09-13T16:40:27.738146+0000","172.21.15.40:6824/3185150828":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/690822190":"2024-09-13T16:39:37.683949+0000","172.21.15.40:0/414904326":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/3777702470":"2024-09-13T16:43:17.229644+0000","172.21.15.40:0/3514360215":"2024-09-13T16:44:32.325869+0000","172.21.15.40:0/3853947452":"2024-09-13T16:46:26.907170+0000","172.21.15.40:0/1991235795":"2024-09-13T16:40:52.760615+0000","172.21.15.40:6825/3185150828":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/1455634917":"2024-09-13T16:47:13.340610+0000","172.21.15.40:0/2753473479":"2024-09-13T16:42:16.865910+0000","172.21.15.40:0/3230130657":"2024-09-13T16:42:51.908956+0000","172.21.15.40:0/3833267415":"2024-09-13T16:48:42.495533+0000","172.21.15.40:0/1708466797":"2024-09-13T16:43:42.271124+0000","172.21.15.40:0/3629684271":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/3494260782":"2024-09-13T16:41:17.861368+0000","172.21.15.40:0/1861863246":"2024-09-13T16:44:07.288889+0000","172.21.15.40:0/1129415438":"2024-09-13T16:47:37.323733+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:50:25.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.573+0000 7fdd852c5640 1 -- 172.21.15.40:0/1786291163 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fdd60035530 msgr2=0x7fdd600379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:25.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.573+0000 7fdd852c5640 1 --2- 172.21.15.40:0/1786291163 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fdd60035530 0x7fdd600379f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdd68009770 tx=0x7fdd680a6000 comp rx=0 tx=0).stop 2024-09-13T15:50:25.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.573+0000 7fdd852c5640 1 -- 172.21.15.40:0/1786291163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd800b7bd0 msgr2=0x7fdd80161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:25.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.573+0000 7fdd852c5640 1 --2- 172.21.15.40:0/1786291163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd800b7bd0 0x7fdd80161360 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fdd7000c480 tx=0x7fdd7000c940 comp rx=0 tx=0).stop 2024-09-13T15:50:25.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.573+0000 7fdd852c5640 1 -- 172.21.15.40:0/1786291163 shutdown_connections 2024-09-13T15:50:25.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.573+0000 7fdd852c5640 1 --2- 172.21.15.40:0/1786291163 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fdd60035530 0x7fdd600379f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:25.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.573+0000 7fdd852c5640 1 --2- 172.21.15.40:0/1786291163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd800b7bd0 0x7fdd80161360 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:25.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.573+0000 7fdd852c5640 1 -- 172.21.15.40:0/1786291163 >> 172.21.15.40:0/1786291163 conn(0x7fdd800a8640 msgr2=0x7fdd800c4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:25.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.573+0000 7fdd852c5640 1 -- 172.21.15.40:0/1786291163 shutdown_connections 2024-09-13T15:50:25.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.573+0000 7fdd852c5640 1 -- 172.21.15.40:0/1786291163 wait complete. 2024-09-13T15:50:25.595 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:34:25.125767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:34:33.833957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:34:34.276037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.2699999809265137, 'score_stable': 1.2699999809265137, 'optimal_score': 1, 'raw_score_acting': 1.2699999809265137, 'raw_score_stable': 1.2699999809265137, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs.dc.meta', 'create_time': '2024-09-13T15:34:54.455347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'dc'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs.dc.data', 'create_time': '2024-09-13T15:34:55.209802+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'dc'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs.dc-backup.meta', 'create_time': '2024-09-13T15:34:56.580392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'dc-backup'}}, 'read_balance': {'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs.dc-backup.data', 'create_time': '2024-09-13T15:34:57.245673+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'dc-backup'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:50:25.595 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:50:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.725+0000 7f90cd056640 1 Processor -- start 2024-09-13T15:50:25.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.725+0000 7f90cd056640 1 -- start start 2024-09-13T15:50:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.725+0000 7f90cd056640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90c80b4010 0x7f90c80a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.725+0000 7f90cd056640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c81515b0 con 0x7f90c80bebb0 2024-09-13T15:50:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.725+0000 7f90cd056640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c814e2c0 con 0x7f90c80b4010 2024-09-13T15:50:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.725+0000 7f90c6d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f90c80bebb0 0x7f90c806e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34786/0 (socket says 172.21.15.40:34786) 2024-09-13T15:50:25.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.725+0000 7f90c6d9d640 1 -- 172.21.15.40:0/538295286 learned_addr learned my addr 172.21.15.40:0/538295286 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.725+0000 7f90c659c640 1 --2- 172.21.15.40:0/538295286 >> v2:172.21.15.40:3300/0 conn(0x7f90c80b4010 0x7f90c80a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.725+0000 7f90c5d9b640 1 -- 172.21.15.40:0/538295286 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2592333627 0 0) 0x7f90c81515b0 con 0x7f90c80bebb0 2024-09-13T15:50:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.725+0000 7f90c5d9b640 1 -- 172.21.15.40:0/538295286 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90b0003530 con 0x7f90c80bebb0 2024-09-13T15:50:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.725+0000 7f90c659c640 1 -- 172.21.15.40:0/538295286 >> v1:172.21.15.40:6789/0 conn(0x7f90c80bebb0 legacy=0x7f90c806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:25.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.725+0000 7f90c659c640 1 -- 172.21.15.40:0/538295286 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c806f830 con 0x7f90c80b4010 2024-09-13T15:50:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90c659c640 1 --2- 172.21.15.40:0/538295286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b4010 0x7f90c80a4d70 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009740 tx=0x7f90bc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8949a0cbdc933756 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90c5d9b640 1 -- 172.21.15.40:0/538295286 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90c80b6bc0 con 0x7f90c80b4010 2024-09-13T15:50:25.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90c5d9b640 1 -- 172.21.15.40:0/538295286 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc0a7050 con 0x7f90c80b4010 2024-09-13T15:50:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90c5d9b640 1 -- 172.21.15.40:0/538295286 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90bc0ab660 con 0x7f90c80b4010 2024-09-13T15:50:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90cd056640 1 -- 172.21.15.40:0/538295286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b4010 msgr2=0x7f90c80a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90cd056640 1 --2- 172.21.15.40:0/538295286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b4010 0x7f90c80a4d70 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f90bc009740 tx=0x7f90bc01c420 comp rx=0 tx=0).stop 2024-09-13T15:50:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90cd056640 1 -- 172.21.15.40:0/538295286 shutdown_connections 2024-09-13T15:50:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90cd056640 1 --2- 172.21.15.40:0/538295286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b4010 0x7f90c80a4d70 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:25.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90cd056640 1 -- 172.21.15.40:0/538295286 >> 172.21.15.40:0/538295286 conn(0x7f90c806a540 msgr2=0x7f90c80a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:25.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90cd056640 1 -- 172.21.15.40:0/538295286 shutdown_connections 2024-09-13T15:50:25.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90cd056640 1 -- 172.21.15.40:0/538295286 wait complete. 2024-09-13T15:50:25.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90cd056640 1 Processor -- start 2024-09-13T15:50:25.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90cd056640 1 -- start start 2024-09-13T15:50:25.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90cd056640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b4010 0x7f90c81478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:25.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90cd056640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c81461c0 con 0x7f90c80b4010 2024-09-13T15:50:25.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90c6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b4010 0x7f90c81478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:25.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90c6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b4010 0x7f90c81478b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53748/0 (socket says 172.21.15.40:53748) 2024-09-13T15:50:25.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90c6d9d640 1 -- 172.21.15.40:0/1031792089 learned_addr learned my addr 172.21.15.40:0/1031792089 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:25.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.729+0000 7f90c6d9d640 1 -- 172.21.15.40:0/1031792089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc009420 con 0x7f90c80b4010 2024-09-13T15:50:25.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.733+0000 7f90c6d9d640 1 --2- 172.21.15.40:0/1031792089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b4010 0x7f90c81478b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f90b800c3d0 tx=0x7f90b800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.733+0000 7f90af7fe640 1 -- 172.21.15.40:0/1031792089 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90b8005ce0 con 0x7f90c80b4010 2024-09-13T15:50:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.733+0000 7f90af7fe640 1 -- 172.21.15.40:0/1031792089 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b8005e40 con 0x7f90c80b4010 2024-09-13T15:50:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.733+0000 7f90cd056640 1 -- 172.21.15.40:0/1031792089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c81e9c10 con 0x7f90c80b4010 2024-09-13T15:50:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.733+0000 7f90af7fe640 1 -- 172.21.15.40:0/1031792089 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90b8007220 con 0x7f90c80b4010 2024-09-13T15:50:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.733+0000 7f90cd056640 1 -- 172.21.15.40:0/1031792089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c814bd60 con 0x7f90c80b4010 2024-09-13T15:50:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.733+0000 7f90af7fe640 1 -- 172.21.15.40:0/1031792089 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f90b8007440 con 0x7f90c80b4010 2024-09-13T15:50:25.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.733+0000 7f90cd056640 1 -- 172.21.15.40:0/1031792089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c81e9e00 con 0x7f90c80b4010 2024-09-13T15:50:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.733+0000 7f90af7fe640 1 --2- 172.21.15.40:0/1031792089 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f90b4035490 0x7f90b4037950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.733+0000 7f90af7fe640 1 -- 172.21.15.40:0/1031792089 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f90b80479f0 con 0x7f90c80b4010 2024-09-13T15:50:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.733+0000 7f90c659c640 1 --2- 172.21.15.40:0/1031792089 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f90b4035490 0x7f90b4037950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:25.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.733+0000 7f90c659c640 1 --2- 172.21.15.40:0/1031792089 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f90b4035490 0x7f90b4037950 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0ad000 tx=0x7f90bc0a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:25.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.737+0000 7f90af7fe640 1 -- 172.21.15.40:0/1031792089 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f90b8049e60 con 0x7f90c80b4010 2024-09-13T15:50:25.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.897+0000 7f90cd056640 1 -- 172.21.15.40:0/1031792089 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90c80a4d70 con 0x7f90c80b4010 2024-09-13T15:50:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.897+0000 7f90af7fe640 1 -- 172.21.15.40:0/1031792089 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90b80170a0 con 0x7f90c80b4010 2024-09-13T15:50:25.900 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-09-13T15:50:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.901+0000 7f90cd056640 1 -- 172.21.15.40:0/1031792089 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f90b4035490 msgr2=0x7f90b4037950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.901+0000 7f90cd056640 1 --2- 172.21.15.40:0/1031792089 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f90b4035490 0x7f90b4037950 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0ad000 tx=0x7f90bc0a6000 comp rx=0 tx=0).stop 2024-09-13T15:50:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.901+0000 7f90cd056640 1 -- 172.21.15.40:0/1031792089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b4010 msgr2=0x7f90c81478b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.901+0000 7f90cd056640 1 --2- 172.21.15.40:0/1031792089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b4010 0x7f90c81478b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f90b800c3d0 tx=0x7f90b800c890 comp rx=0 tx=0).stop 2024-09-13T15:50:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.901+0000 7f90cd056640 1 -- 172.21.15.40:0/1031792089 shutdown_connections 2024-09-13T15:50:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.901+0000 7f90cd056640 1 --2- 172.21.15.40:0/1031792089 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f90b4035490 0x7f90b4037950 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.901+0000 7f90cd056640 1 --2- 172.21.15.40:0/1031792089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c80b4010 0x7f90c81478b0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.901+0000 7f90cd056640 1 -- 172.21.15.40:0/1031792089 >> 172.21.15.40:0/1031792089 conn(0x7f90c806a540 msgr2=0x7f90c80bde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.901+0000 7f90cd056640 1 -- 172.21.15.40:0/1031792089 shutdown_connections 2024-09-13T15:50:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:25.901+0000 7f90cd056640 1 -- 172.21.15.40:0/1031792089 wait complete. 2024-09-13T15:50:25.919 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:50:26.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc203c3640 1 Processor -- start 2024-09-13T15:50:26.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc203c3640 1 -- start start 2024-09-13T15:50:26.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc203c3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc180b7bd0 0x7fdc180c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:26.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc203c3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc180a7850 con 0x7fdc18153f60 2024-09-13T15:50:26.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc203c3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1808c4f0 con 0x7fdc180b7bd0 2024-09-13T15:50:26.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc1d95e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc180b7bd0 0x7fdc180c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:26.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc1e15f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdc18153f60 0x7fdc180c4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34788/0 (socket says 172.21.15.40:34788) 2024-09-13T15:50:26.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc1e15f640 1 -- 172.21.15.40:0/1891415752 learned_addr learned my addr 172.21.15.40:0/1891415752 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:26.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc1d95e640 1 -- 172.21.15.40:0/1891415752 >> v1:172.21.15.40:6789/0 conn(0x7fdc18153f60 legacy=0x7fdc180c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc1d15d640 1 -- 172.21.15.40:0/1891415752 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635669814 0 0) 0x7fdc180a7850 con 0x7fdc18153f60 2024-09-13T15:50:26.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc1d95e640 1 -- 172.21.15.40:0/1891415752 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1808bdb0 con 0x7fdc180b7bd0 2024-09-13T15:50:26.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc1d95e640 1 --2- 172.21.15.40:0/1891415752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc180b7bd0 0x7fdc180c06e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009770 tx=0x7fdc0c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6c591074e789cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:26.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc1d15d640 1 -- 172.21.15.40:0/1891415752 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc0c0ab530 con 0x7fdc180b7bd0 2024-09-13T15:50:26.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc1d15d640 1 -- 172.21.15.40:0/1891415752 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c0a7050 con 0x7fdc180b7bd0 2024-09-13T15:50:26.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.045+0000 7fdc1d15d640 1 -- 172.21.15.40:0/1891415752 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc0c0ab7e0 con 0x7fdc180b7bd0 2024-09-13T15:50:26.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 -- 172.21.15.40:0/1891415752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc180b7bd0 msgr2=0x7fdc180c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 --2- 172.21.15.40:0/1891415752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc180b7bd0 0x7fdc180c06e0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009770 tx=0x7fdc0c01c420 comp rx=0 tx=0).stop 2024-09-13T15:50:26.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 -- 172.21.15.40:0/1891415752 shutdown_connections 2024-09-13T15:50:26.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 --2- 172.21.15.40:0/1891415752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc180b7bd0 0x7fdc180c06e0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:26.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 -- 172.21.15.40:0/1891415752 >> 172.21.15.40:0/1891415752 conn(0x7fdc180a8640 msgr2=0x7fdc18065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:26.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 -- 172.21.15.40:0/1891415752 shutdown_connections 2024-09-13T15:50:26.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 -- 172.21.15.40:0/1891415752 wait complete. 2024-09-13T15:50:26.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 Processor -- start 2024-09-13T15:50:26.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 -- start start 2024-09-13T15:50:26.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc180b7bd0 0x7fdc1815fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:26.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc181603d0 con 0x7fdc180b7bd0 2024-09-13T15:50:26.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc1e15f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc180b7bd0 0x7fdc1815fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc1e15f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc180b7bd0 0x7fdc1815fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53766/0 (socket says 172.21.15.40:53766) 2024-09-13T15:50:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc1e15f640 1 -- 172.21.15.40:0/3066402852 learned_addr learned my addr 172.21.15.40:0/3066402852 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc1e15f640 1 -- 172.21.15.40:0/3066402852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c009420 con 0x7fdc180b7bd0 2024-09-13T15:50:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc1e15f640 1 --2- 172.21.15.40:0/3066402852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc180b7bd0 0x7fdc1815fb70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800c840 tx=0x7fdc0800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc16ffd640 1 -- 172.21.15.40:0/3066402852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc0800a660 con 0x7fdc180b7bd0 2024-09-13T15:50:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc16ffd640 1 -- 172.21.15.40:0/3066402852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0800a7e0 con 0x7fdc180b7bd0 2024-09-13T15:50:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 -- 172.21.15.40:0/3066402852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc18142e80 con 0x7fdc180b7bd0 2024-09-13T15:50:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc16ffd640 1 -- 172.21.15.40:0/3066402852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdc0800aac0 con 0x7fdc180b7bd0 2024-09-13T15:50:26.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.049+0000 7fdc203c3640 1 -- 172.21.15.40:0/3066402852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc181608b0 con 0x7fdc180b7bd0 2024-09-13T15:50:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.053+0000 7fdc203c3640 1 -- 172.21.15.40:0/3066402852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc18067510 con 0x7fdc180b7bd0 2024-09-13T15:50:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.053+0000 7fdc16ffd640 1 -- 172.21.15.40:0/3066402852 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7fdc0800ac20 con 0x7fdc180b7bd0 2024-09-13T15:50:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.053+0000 7fdc16ffd640 1 --2- 172.21.15.40:0/3066402852 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fdc04035530 0x7fdc040379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.053+0000 7fdc16ffd640 1 -- 172.21.15.40:0/3066402852 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fdc08047c50 con 0x7fdc180b7bd0 2024-09-13T15:50:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.053+0000 7fdc1d95e640 1 --2- 172.21.15.40:0/3066402852 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fdc04035530 0x7fdc040379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:26.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.053+0000 7fdc1d95e640 1 --2- 172.21.15.40:0/3066402852 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fdc04035530 0x7fdc040379f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009770 tx=0x7fdc0c0a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:26.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.057+0000 7fdc16ffd640 1 -- 172.21.15.40:0/3066402852 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdc0801a6d0 con 0x7fdc180b7bd0 2024-09-13T15:50:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.213+0000 7fdc203c3640 1 -- 172.21.15.40:0/3066402852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc18160b00 con 0x7fdc180b7bd0 2024-09-13T15:50:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.213+0000 7fdc16ffd640 1 -- 172.21.15.40:0/3066402852 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdc08018020 con 0x7fdc180b7bd0 2024-09-13T15:50:26.217 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.217+0000 7fdc203c3640 1 -- 172.21.15.40:0/3066402852 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fdc04035530 msgr2=0x7fdc040379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.217+0000 7fdc203c3640 1 --2- 172.21.15.40:0/3066402852 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fdc04035530 0x7fdc040379f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009770 tx=0x7fdc0c0a6000 comp rx=0 tx=0).stop 2024-09-13T15:50:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.217+0000 7fdc203c3640 1 -- 172.21.15.40:0/3066402852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc180b7bd0 msgr2=0x7fdc1815fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.217+0000 7fdc203c3640 1 --2- 172.21.15.40:0/3066402852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc180b7bd0 0x7fdc1815fb70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fdc0800c840 tx=0x7fdc0800cd00 comp rx=0 tx=0).stop 2024-09-13T15:50:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.217+0000 7fdc203c3640 1 -- 172.21.15.40:0/3066402852 shutdown_connections 2024-09-13T15:50:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.217+0000 7fdc203c3640 1 --2- 172.21.15.40:0/3066402852 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fdc04035530 0x7fdc040379f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.217+0000 7fdc203c3640 1 --2- 172.21.15.40:0/3066402852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc180b7bd0 0x7fdc1815fb70 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.217+0000 7fdc203c3640 1 -- 172.21.15.40:0/3066402852 >> 172.21.15.40:0/3066402852 conn(0x7fdc180a8640 msgr2=0x7fdc180c40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.217+0000 7fdc203c3640 1 -- 172.21.15.40:0/3066402852 shutdown_connections 2024-09-13T15:50:26.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.217+0000 7fdc203c3640 1 -- 172.21.15.40:0/3066402852 wait complete. 2024-09-13T15:50:26.234 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:50:26.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c9f9de640 1 Processor -- start 2024-09-13T15:50:26.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c9f9de640 1 -- start start 2024-09-13T15:50:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c9f9de640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c980b4600 0x7f4c9814dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c9f9de640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c980c1130 con 0x7f4c9814e280 2024-09-13T15:50:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c9f9de640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9814e780 con 0x7f4c980b4600 2024-09-13T15:50:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c9d77a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c980b4600 0x7f4c9814dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c9d77a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4c980b4600 0x7f4c9814dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53782/0 (socket says 172.21.15.40:53782) 2024-09-13T15:50:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c9cf79640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4c9814e280 0x7f4c980bf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34798/0 (socket says 172.21.15.40:34798) 2024-09-13T15:50:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c9d77a640 1 -- 172.21.15.40:0/1052199066 learned_addr learned my addr 172.21.15.40:0/1052199066 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c9d77a640 1 -- 172.21.15.40:0/1052199066 >> v1:172.21.15.40:6789/0 conn(0x7f4c9814e280 legacy=0x7f4c980bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c8ffff640 1 -- 172.21.15.40:0/1052199066 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538669051 0 0) 0x7f4c980c1130 con 0x7f4c9814e280 2024-09-13T15:50:26.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c9d77a640 1 -- 172.21.15.40:0/1052199066 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c980b59f0 con 0x7f4c980b4600 2024-09-13T15:50:26.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c9d77a640 1 --2- 172.21.15.40:0/1052199066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c980b4600 0x7f4c9814dd40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4c940097f0 tx=0x7f4c9401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be5487e4460c2de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:26.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c8ffff640 1 -- 172.21.15.40:0/1052199066 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c940ab530 con 0x7f4c980b4600 2024-09-13T15:50:26.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c8ffff640 1 -- 172.21.15.40:0/1052199066 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c940a7050 con 0x7f4c980b4600 2024-09-13T15:50:26.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.349+0000 7f4c8ffff640 1 -- 172.21.15.40:0/1052199066 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c940ab7e0 con 0x7f4c980b4600 2024-09-13T15:50:26.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1052199066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c980b4600 msgr2=0x7f4c9814dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 --2- 172.21.15.40:0/1052199066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c980b4600 0x7f4c9814dd40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4c940097f0 tx=0x7f4c9401c450 comp rx=0 tx=0).stop 2024-09-13T15:50:26.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1052199066 shutdown_connections 2024-09-13T15:50:26.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 --2- 172.21.15.40:0/1052199066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c980b4600 0x7f4c9814dd40 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:26.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1052199066 >> 172.21.15.40:0/1052199066 conn(0x7f4c9806a540 msgr2=0x7f4c980a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:26.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1052199066 shutdown_connections 2024-09-13T15:50:26.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1052199066 wait complete. 2024-09-13T15:50:26.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 Processor -- start 2024-09-13T15:50:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 -- start start 2024-09-13T15:50:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c980b4600 0x7f4c9813ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:26.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9813f340 con 0x7f4c980b4600 2024-09-13T15:50:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9d77a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c980b4600 0x7f4c9813ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9d77a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c980b4600 0x7f4c9813ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53784/0 (socket says 172.21.15.40:53784) 2024-09-13T15:50:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9d77a640 1 -- 172.21.15.40:0/1148796887 learned_addr learned my addr 172.21.15.40:0/1148796887 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9d77a640 1 -- 172.21.15.40:0/1148796887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940094d0 con 0x7f4c980b4600 2024-09-13T15:50:26.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9d77a640 1 --2- 172.21.15.40:0/1148796887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c980b4600 0x7f4c9813ee00 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4c94019060 tx=0x7f4c9401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:26.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c8dffb640 1 -- 172.21.15.40:0/1148796887 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c94004020 con 0x7f4c980b4600 2024-09-13T15:50:26.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c8dffb640 1 -- 172.21.15.40:0/1148796887 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c94004180 con 0x7f4c980b4600 2024-09-13T15:50:26.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1148796887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9815baf0 con 0x7f4c980b4600 2024-09-13T15:50:26.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c8dffb640 1 -- 172.21.15.40:0/1148796887 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c94004420 con 0x7f4c980b4600 2024-09-13T15:50:26.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1148796887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9815bfb0 con 0x7f4c980b4600 2024-09-13T15:50:26.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c8dffb640 1 -- 172.21.15.40:0/1148796887 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f4c940b2040 con 0x7f4c980b4600 2024-09-13T15:50:26.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.353+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1148796887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9814dd40 con 0x7f4c980b4600 2024-09-13T15:50:26.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.357+0000 7f4c8dffb640 1 --2- 172.21.15.40:0/1148796887 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4c7c035530 0x7f4c7c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:26.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.357+0000 7f4c8dffb640 1 -- 172.21.15.40:0/1148796887 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f4c940e23b0 con 0x7f4c980b4600 2024-09-13T15:50:26.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.357+0000 7f4c9cf79640 1 --2- 172.21.15.40:0/1148796887 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4c7c035530 0x7f4c7c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:26.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.357+0000 7f4c9cf79640 1 --2- 172.21.15.40:0/1148796887 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4c7c035530 0x7f4c7c0379f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4c88007fd0 tx=0x7f4c88007920 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:26.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.361+0000 7f4c8dffb640 1 -- 172.21.15.40:0/1148796887 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4c940c6710 con 0x7f4c980b4600 2024-09-13T15:50:26.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.521+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1148796887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4c980a3b40 con 0x7f4c980b4600 2024-09-13T15:50:26.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.521+0000 7f4c8dffb640 1 -- 172.21.15.40:0/1148796887 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4c940b00a0 con 0x7f4c980b4600 2024-09-13T15:50:26.524 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-09-13T15:50:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.521+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1148796887 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4c7c035530 msgr2=0x7f4c7c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.521+0000 7f4c9f9de640 1 --2- 172.21.15.40:0/1148796887 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4c7c035530 0x7f4c7c0379f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4c88007fd0 tx=0x7f4c88007920 comp rx=0 tx=0).stop 2024-09-13T15:50:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.521+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1148796887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c980b4600 msgr2=0x7f4c9813ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.521+0000 7f4c9f9de640 1 --2- 172.21.15.40:0/1148796887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c980b4600 0x7f4c9813ee00 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4c94019060 tx=0x7f4c9401ac90 comp rx=0 tx=0).stop 2024-09-13T15:50:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.521+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1148796887 shutdown_connections 2024-09-13T15:50:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.521+0000 7f4c9f9de640 1 --2- 172.21.15.40:0/1148796887 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4c7c035530 0x7f4c7c0379f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.521+0000 7f4c9f9de640 1 --2- 172.21.15.40:0/1148796887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4c980b4600 0x7f4c9813ee00 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.521+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1148796887 >> 172.21.15.40:0/1148796887 conn(0x7f4c9806a540 msgr2=0x7f4c980bf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:26.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.521+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1148796887 shutdown_connections 2024-09-13T15:50:26.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.521+0000 7f4c9f9de640 1 -- 172.21.15.40:0/1148796887 wait complete. 2024-09-13T15:50:26.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc.meta pg_num 2024-09-13T15:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.665+0000 7f3c8d1e3640 1 Processor -- start 2024-09-13T15:50:26.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.665+0000 7f3c8d1e3640 1 -- start start 2024-09-13T15:50:26.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.665+0000 7f3c8d1e3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c8806f400 0x7f3c880b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:26.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.665+0000 7f3c8d1e3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c880b48d0 con 0x7f3c8814f3d0 2024-09-13T15:50:26.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.665+0000 7f3c8d1e3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c880b5240 con 0x7f3c8806f400 2024-09-13T15:50:26.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.665+0000 7f3c8659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c8806f400 0x7f3c880b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:26.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.665+0000 7f3c8659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c8806f400 0x7f3c880b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53790/0 (socket says 172.21.15.40:53790) 2024-09-13T15:50:26.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.665+0000 7f3c8659c640 1 -- 172.21.15.40:0/509915126 learned_addr learned my addr 172.21.15.40:0/509915126 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:26.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.665+0000 7f3c8659c640 1 -- 172.21.15.40:0/509915126 >> v1:172.21.15.40:6789/0 conn(0x7f3c8814f3d0 legacy=0x7f3c8806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.665+0000 7f3c8659c640 1 -- 172.21.15.40:0/509915126 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8814e7b0 con 0x7f3c8806f400 2024-09-13T15:50:26.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8659c640 1 --2- 172.21.15.40:0/509915126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c8806f400 0x7f3c880b4d00 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0097f0 tx=0x7f3c7c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858b5f50ec1254f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:26.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c85d9b640 1 -- 172.21.15.40:0/509915126 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c7c0ab530 con 0x7f3c8806f400 2024-09-13T15:50:26.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c85d9b640 1 -- 172.21.15.40:0/509915126 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c0a7050 con 0x7f3c8806f400 2024-09-13T15:50:26.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c85d9b640 1 -- 172.21.15.40:0/509915126 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c7c0ab7e0 con 0x7f3c8806f400 2024-09-13T15:50:26.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/509915126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c8806f400 msgr2=0x7f3c880b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 --2- 172.21.15.40:0/509915126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c8806f400 0x7f3c880b4d00 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0097f0 tx=0x7f3c7c01c450 comp rx=0 tx=0).stop 2024-09-13T15:50:26.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/509915126 shutdown_connections 2024-09-13T15:50:26.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 --2- 172.21.15.40:0/509915126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c8806f400 0x7f3c880b4d00 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:26.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/509915126 >> 172.21.15.40:0/509915126 conn(0x7f3c8806a540 msgr2=0x7f3c880a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:26.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/509915126 shutdown_connections 2024-09-13T15:50:26.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/509915126 wait complete. 2024-09-13T15:50:26.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 Processor -- start 2024-09-13T15:50:26.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 -- start start 2024-09-13T15:50:26.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c8806f400 0x7f3c880b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:26.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88147f80 con 0x7f3c8806f400 2024-09-13T15:50:26.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c86d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c8806f400 0x7f3c880b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:26.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c86d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c8806f400 0x7f3c880b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53806/0 (socket says 172.21.15.40:53806) 2024-09-13T15:50:26.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c86d9d640 1 -- 172.21.15.40:0/3783205667 learned_addr learned my addr 172.21.15.40:0/3783205667 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:26.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c86d9d640 1 -- 172.21.15.40:0/3783205667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c0094d0 con 0x7f3c8806f400 2024-09-13T15:50:26.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c86d9d640 1 --2- 172.21.15.40:0/3783205667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c8806f400 0x7f3c880b5da0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800c450 tx=0x7f3c7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/3783205667 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c78005200 con 0x7f3c8806f400 2024-09-13T15:50:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/3783205667 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c78005360 con 0x7f3c8806f400 2024-09-13T15:50:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/3783205667 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c78012630 con 0x7f3c8806f400 2024-09-13T15:50:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/3783205667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c88070e30 con 0x7f3c8806f400 2024-09-13T15:50:26.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.669+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/3783205667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c88071310 con 0x7f3c8806f400 2024-09-13T15:50:26.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.673+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/3783205667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c880b4d00 con 0x7f3c8806f400 2024-09-13T15:50:26.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.673+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/3783205667 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f3c78012790 con 0x7f3c8806f400 2024-09-13T15:50:26.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.673+0000 7f3c6f7fe640 1 --2- 172.21.15.40:0/3783205667 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3c74035530 0x7f3c740379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:26.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.673+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/3783205667 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f3c78047e50 con 0x7f3c8806f400 2024-09-13T15:50:26.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.673+0000 7f3c8659c640 1 --2- 172.21.15.40:0/3783205667 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3c74035530 0x7f3c740379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:26.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.673+0000 7f3c8659c640 1 --2- 172.21.15.40:0/3783205667 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3c74035530 0x7f3c740379f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0ad000 tx=0x7f3c7c008040 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:26.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.677+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/3783205667 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3c78019300 con 0x7f3c8806f400 2024-09-13T15:50:26.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.833+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/3783205667 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc.meta", "var": "pg_num"} v 0) v1 -- 0x7f3c88066920 con 0x7f3c8806f400 2024-09-13T15:50:26.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.833+0000 7f3c6f7fe640 1 -- 172.21.15.40:0/3783205667 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc.meta", "var": "pg_num"}]=0 v51) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3c78010ad0 con 0x7f3c8806f400 2024-09-13T15:50:26.835 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:26.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.833+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/3783205667 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3c74035530 msgr2=0x7f3c740379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.833+0000 7f3c8d1e3640 1 --2- 172.21.15.40:0/3783205667 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3c74035530 0x7f3c740379f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c0ad000 tx=0x7f3c7c008040 comp rx=0 tx=0).stop 2024-09-13T15:50:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.833+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/3783205667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c8806f400 msgr2=0x7f3c880b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.833+0000 7f3c8d1e3640 1 --2- 172.21.15.40:0/3783205667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c8806f400 0x7f3c880b5da0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800c450 tx=0x7f3c7800c910 comp rx=0 tx=0).stop 2024-09-13T15:50:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.833+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/3783205667 shutdown_connections 2024-09-13T15:50:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.833+0000 7f3c8d1e3640 1 --2- 172.21.15.40:0/3783205667 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3c74035530 0x7f3c740379f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.833+0000 7f3c8d1e3640 1 --2- 172.21.15.40:0/3783205667 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c8806f400 0x7f3c880b5da0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.833+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/3783205667 >> 172.21.15.40:0/3783205667 conn(0x7f3c8806a540 msgr2=0x7f3c880a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.833+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/3783205667 shutdown_connections 2024-09-13T15:50:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.833+0000 7f3c8d1e3640 1 -- 172.21.15.40:0/3783205667 wait complete. 2024-09-13T15:50:26.854 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc.data pg_num 2024-09-13T15:50:26.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.977+0000 7f90b5f02640 1 Processor -- start 2024-09-13T15:50:26.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.977+0000 7f90b5f02640 1 -- start start 2024-09-13T15:50:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.981+0000 7f90b5f02640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90b00bedb0 0x7f90b00b8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.981+0000 7f90b5f02640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b0065fb0 con 0x7f90b00be9d0 2024-09-13T15:50:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.981+0000 7f90b5f02640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b0066450 con 0x7f90b00bedb0 2024-09-13T15:50:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.981+0000 7f90af7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f90b00be9d0 0x7f90b006bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34814/0 (socket says 172.21.15.40:34814) 2024-09-13T15:50:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.981+0000 7f90af7fe640 1 -- 172.21.15.40:0/1342683801 learned_addr learned my addr 172.21.15.40:0/1342683801 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:26.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.981+0000 7f90a7fff640 1 --2- 172.21.15.40:0/1342683801 >> v2:172.21.15.40:3300/0 conn(0x7f90b00bedb0 0x7f90b00b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:26.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.981+0000 7f90aeffd640 1 -- 172.21.15.40:0/1342683801 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286032319 0 0) 0x7f90b0065fb0 con 0x7f90b00be9d0 2024-09-13T15:50:26.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.981+0000 7f90aeffd640 1 -- 172.21.15.40:0/1342683801 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f909c003530 con 0x7f90b00be9d0 2024-09-13T15:50:26.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.981+0000 7f90a7fff640 1 -- 172.21.15.40:0/1342683801 >> v1:172.21.15.40:6789/0 conn(0x7f90b00be9d0 legacy=0x7f90b006bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.981+0000 7f90a7fff640 1 -- 172.21.15.40:0/1342683801 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b00b94a0 con 0x7f90b00bedb0 2024-09-13T15:50:26.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90a7fff640 1 --2- 172.21.15.40:0/1342683801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90b00bedb0 0x7f90b00b8580 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9098009740 tx=0x7f909801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fd812602611d6f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:26.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90aeffd640 1 -- 172.21.15.40:0/1342683801 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90980ad5b0 con 0x7f90b00bedb0 2024-09-13T15:50:26.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90aeffd640 1 -- 172.21.15.40:0/1342683801 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90980ad710 con 0x7f90b00bedb0 2024-09-13T15:50:26.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90aeffd640 1 -- 172.21.15.40:0/1342683801 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90980ad9d0 con 0x7f90b00bedb0 2024-09-13T15:50:26.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90b5f02640 1 -- 172.21.15.40:0/1342683801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90b00bedb0 msgr2=0x7f90b00b8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:26.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90b5f02640 1 --2- 172.21.15.40:0/1342683801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90b00bedb0 0x7f90b00b8580 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f9098009740 tx=0x7f909801c360 comp rx=0 tx=0).stop 2024-09-13T15:50:26.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90b5f02640 1 -- 172.21.15.40:0/1342683801 shutdown_connections 2024-09-13T15:50:26.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90b5f02640 1 --2- 172.21.15.40:0/1342683801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90b00bedb0 0x7f90b00b8580 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:26.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90b5f02640 1 -- 172.21.15.40:0/1342683801 >> 172.21.15.40:0/1342683801 conn(0x7f90b0070c80 msgr2=0x7f90b0071090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:26.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90b5f02640 1 -- 172.21.15.40:0/1342683801 shutdown_connections 2024-09-13T15:50:26.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90b5f02640 1 -- 172.21.15.40:0/1342683801 wait complete. 2024-09-13T15:50:26.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90b5f02640 1 Processor -- start 2024-09-13T15:50:26.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90b5f02640 1 -- start start 2024-09-13T15:50:26.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90b5f02640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90b00be9d0 0x7f90b00bc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:26.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90b5f02640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b014e350 con 0x7f90b00be9d0 2024-09-13T15:50:26.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90af7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90b00be9d0 0x7f90b00bc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:26.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90af7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90b00be9d0 0x7f90b00bc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53830/0 (socket says 172.21.15.40:53830) 2024-09-13T15:50:26.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90af7fe640 1 -- 172.21.15.40:0/1560312330 learned_addr learned my addr 172.21.15.40:0/1560312330 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:26.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90af7fe640 1 -- 172.21.15.40:0/1560312330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098009420 con 0x7f90b00be9d0 2024-09-13T15:50:26.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90af7fe640 1 --2- 172.21.15.40:0/1560312330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90b00be9d0 0x7f90b00bc300 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c450 tx=0x7f90a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:26.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.985+0000 7f90acff9640 1 -- 172.21.15.40:0/1560312330 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90a0005c20 con 0x7f90b00be9d0 2024-09-13T15:50:26.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.989+0000 7f90acff9640 1 -- 172.21.15.40:0/1560312330 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a0005d80 con 0x7f90b00be9d0 2024-09-13T15:50:26.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.989+0000 7f90b5f02640 1 -- 172.21.15.40:0/1560312330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b01ec050 con 0x7f90b00be9d0 2024-09-13T15:50:26.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.989+0000 7f90acff9640 1 -- 172.21.15.40:0/1560312330 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f90a00071a0 con 0x7f90b00be9d0 2024-09-13T15:50:26.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.989+0000 7f90b5f02640 1 -- 172.21.15.40:0/1560312330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b01ec410 con 0x7f90b00be9d0 2024-09-13T15:50:26.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.989+0000 7f90b5f02640 1 -- 172.21.15.40:0/1560312330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b014e1b0 con 0x7f90b00be9d0 2024-09-13T15:50:26.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.989+0000 7f90acff9640 1 -- 172.21.15.40:0/1560312330 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f90a0007300 con 0x7f90b00be9d0 2024-09-13T15:50:26.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.989+0000 7f90acff9640 1 --2- 172.21.15.40:0/1560312330 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9090035530 0x7f90900379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:26.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.989+0000 7f90acff9640 1 -- 172.21.15.40:0/1560312330 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f90a0047b80 con 0x7f90b00be9d0 2024-09-13T15:50:26.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.989+0000 7f90a7fff640 1 --2- 172.21.15.40:0/1560312330 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9090035530 0x7f90900379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:26.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.989+0000 7f90a7fff640 1 --2- 172.21.15.40:0/1560312330 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9090035530 0x7f90900379f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9098009740 tx=0x7f9098008040 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:26.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:26.993+0000 7f90acff9640 1 -- 172.21.15.40:0/1560312330 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f90a00075b0 con 0x7f90b00be9d0 2024-09-13T15:50:27.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.149+0000 7f90b5f02640 1 -- 172.21.15.40:0/1560312330 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc.data", "var": "pg_num"} v 0) v1 -- 0x7f90b014e1b0 con 0x7f90b00be9d0 2024-09-13T15:50:27.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.153+0000 7f90acff9640 1 -- 172.21.15.40:0/1560312330 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc.data", "var": "pg_num"}]=0 v51) v1 ==== 103+0+11 (secure 0 0 0) 0x7f90b014e1b0 con 0x7f90b00be9d0 2024-09-13T15:50:27.155 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.153+0000 7f90b5f02640 1 -- 172.21.15.40:0/1560312330 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9090035530 msgr2=0x7f90900379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:27.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.153+0000 7f90b5f02640 1 --2- 172.21.15.40:0/1560312330 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9090035530 0x7f90900379f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9098009740 tx=0x7f9098008040 comp rx=0 tx=0).stop 2024-09-13T15:50:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.153+0000 7f90b5f02640 1 -- 172.21.15.40:0/1560312330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90b00be9d0 msgr2=0x7f90b00bc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.153+0000 7f90b5f02640 1 --2- 172.21.15.40:0/1560312330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90b00be9d0 0x7f90b00bc300 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c450 tx=0x7f90a000c910 comp rx=0 tx=0).stop 2024-09-13T15:50:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.153+0000 7f90b5f02640 1 -- 172.21.15.40:0/1560312330 shutdown_connections 2024-09-13T15:50:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.153+0000 7f90b5f02640 1 --2- 172.21.15.40:0/1560312330 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9090035530 0x7f90900379f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.153+0000 7f90b5f02640 1 --2- 172.21.15.40:0/1560312330 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90b00be9d0 0x7f90b00bc300 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.153+0000 7f90b5f02640 1 -- 172.21.15.40:0/1560312330 >> 172.21.15.40:0/1560312330 conn(0x7f90b0070c80 msgr2=0x7f90b00c0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:27.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.153+0000 7f90b5f02640 1 -- 172.21.15.40:0/1560312330 shutdown_connections 2024-09-13T15:50:27.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.153+0000 7f90b5f02640 1 -- 172.21.15.40:0/1560312330 wait complete. 2024-09-13T15:50:27.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc-backup.meta pg_num 2024-09-13T15:50:27.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.293+0000 7f1605bd5640 1 Processor -- start 2024-09-13T15:50:27.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.293+0000 7f1605bd5640 1 -- start start 2024-09-13T15:50:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f1605bd5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16000b8530 0x7f160006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f1605bd5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16000be820 con 0x7f16000b8910 2024-09-13T15:50:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f1605bd5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1600153940 con 0x7f16000b8530 2024-09-13T15:50:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f15ff7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16000b8530 0x7f160006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f15ff7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16000b8530 0x7f160006f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53846/0 (socket says 172.21.15.40:53846) 2024-09-13T15:50:27.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f15ff7fe640 1 -- 172.21.15.40:0/81765867 learned_addr learned my addr 172.21.15.40:0/81765867 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:27.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f15f6ffd640 1 --1- 172.21.15.40:0/81765867 >> v1:172.21.15.40:6789/0 conn(0x7f16000b8910 0x7f160006e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34828/0 (socket says 172.21.15.40:34828) 2024-09-13T15:50:27.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f15ff7fe640 1 -- 172.21.15.40:0/81765867 >> v1:172.21.15.40:6789/0 conn(0x7f16000b8910 legacy=0x7f160006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:27.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f15ff7fe640 1 -- 172.21.15.40:0/81765867 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000c1290 con 0x7f16000b8530 2024-09-13T15:50:27.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f15ff7fe640 1 --2- 172.21.15.40:0/81765867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16000b8530 0x7f160006f160 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f15f00097f0 tx=0x7f15f001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1b87a7f4628ce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:27.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f15feffd640 1 -- 172.21.15.40:0/81765867 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15f00ab520 con 0x7f16000b8530 2024-09-13T15:50:27.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f15feffd640 1 -- 172.21.15.40:0/81765867 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f00ab680 con 0x7f16000b8530 2024-09-13T15:50:27.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f15feffd640 1 -- 172.21.15.40:0/81765867 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15f00ab940 con 0x7f16000b8530 2024-09-13T15:50:27.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f1605bd5640 1 -- 172.21.15.40:0/81765867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16000b8530 msgr2=0x7f160006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:27.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f1605bd5640 1 --2- 172.21.15.40:0/81765867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16000b8530 0x7f160006f160 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f15f00097f0 tx=0x7f15f001c4e0 comp rx=0 tx=0).stop 2024-09-13T15:50:27.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f1605bd5640 1 -- 172.21.15.40:0/81765867 shutdown_connections 2024-09-13T15:50:27.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f1605bd5640 1 --2- 172.21.15.40:0/81765867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16000b8530 0x7f160006f160 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:27.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f1605bd5640 1 -- 172.21.15.40:0/81765867 >> 172.21.15.40:0/81765867 conn(0x7f160006a540 msgr2=0x7f16000a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:27.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f1605bd5640 1 -- 172.21.15.40:0/81765867 shutdown_connections 2024-09-13T15:50:27.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.297+0000 7f1605bd5640 1 -- 172.21.15.40:0/81765867 wait complete. 2024-09-13T15:50:27.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f1605bd5640 1 Processor -- start 2024-09-13T15:50:27.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f1605bd5640 1 -- start start 2024-09-13T15:50:27.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f1605bd5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16000b8530 0x7f1600143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:27.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f1605bd5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16001ec070 con 0x7f16000b8530 2024-09-13T15:50:27.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f15ff7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16000b8530 0x7f1600143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:27.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f15ff7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16000b8530 0x7f1600143920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53848/0 (socket says 172.21.15.40:53848) 2024-09-13T15:50:27.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f15ff7fe640 1 -- 172.21.15.40:0/1124177451 learned_addr learned my addr 172.21.15.40:0/1124177451 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f15ff7fe640 1 -- 172.21.15.40:0/1124177451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f00094d0 con 0x7f16000b8530 2024-09-13T15:50:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f15ff7fe640 1 --2- 172.21.15.40:0/1124177451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16000b8530 0x7f1600143920 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f15f00190f0 tx=0x7f15f001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f15fcff9640 1 -- 172.21.15.40:0/1124177451 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15f00ab4d0 con 0x7f16000b8530 2024-09-13T15:50:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f15fcff9640 1 -- 172.21.15.40:0/1124177451 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f00b4600 con 0x7f16000b8530 2024-09-13T15:50:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f1605bd5640 1 -- 172.21.15.40:0/1124177451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160009d0e0 con 0x7f16000b8530 2024-09-13T15:50:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f15fcff9640 1 -- 172.21.15.40:0/1124177451 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15f00b48e0 con 0x7f16000b8530 2024-09-13T15:50:27.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f1605bd5640 1 -- 172.21.15.40:0/1124177451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1600143e60 con 0x7f16000b8530 2024-09-13T15:50:27.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f1605bd5640 1 -- 172.21.15.40:0/1124177451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16000c0000 con 0x7f16000b8530 2024-09-13T15:50:27.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f15fcff9640 1 -- 172.21.15.40:0/1124177451 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f15f00b4a40 con 0x7f16000b8530 2024-09-13T15:50:27.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f15fcff9640 1 --2- 172.21.15.40:0/1124177451 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f15e0035530 0x7f15e00379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:27.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f15fcff9640 1 -- 172.21.15.40:0/1124177451 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f15f00a8050 con 0x7f16000b8530 2024-09-13T15:50:27.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.301+0000 7f15f6ffd640 1 --2- 172.21.15.40:0/1124177451 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f15e0035530 0x7f15e00379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:27.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.305+0000 7f15f6ffd640 1 --2- 172.21.15.40:0/1124177451 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f15e0035530 0x7f15e00379f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f15e8001600 tx=0x7f15e8007a50 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:27.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.305+0000 7f15fcff9640 1 -- 172.21.15.40:0/1124177451 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f15f00b3380 con 0x7f16000b8530 2024-09-13T15:50:27.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.465+0000 7f1605bd5640 1 -- 172.21.15.40:0/1124177451 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc-backup.meta", "var": "pg_num"} v 0) v1 -- 0x7f1600066920 con 0x7f16000b8530 2024-09-13T15:50:27.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.465+0000 7f15fcff9640 1 -- 172.21.15.40:0/1124177451 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc-backup.meta", "var": "pg_num"}]=0 v52) v1 ==== 110+0+11 (secure 0 0 0) 0x7f15f00c63a0 con 0x7f16000b8530 2024-09-13T15:50:27.468 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.465+0000 7f1605bd5640 1 -- 172.21.15.40:0/1124177451 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f15e0035530 msgr2=0x7f15e00379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.465+0000 7f1605bd5640 1 --2- 172.21.15.40:0/1124177451 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f15e0035530 0x7f15e00379f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f15e8001600 tx=0x7f15e8007a50 comp rx=0 tx=0).stop 2024-09-13T15:50:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.465+0000 7f1605bd5640 1 -- 172.21.15.40:0/1124177451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16000b8530 msgr2=0x7f1600143920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.465+0000 7f1605bd5640 1 --2- 172.21.15.40:0/1124177451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16000b8530 0x7f1600143920 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f15f00190f0 tx=0x7f15f001ad20 comp rx=0 tx=0).stop 2024-09-13T15:50:27.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.465+0000 7f1605bd5640 1 -- 172.21.15.40:0/1124177451 shutdown_connections 2024-09-13T15:50:27.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.465+0000 7f1605bd5640 1 --2- 172.21.15.40:0/1124177451 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f15e0035530 0x7f15e00379f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:27.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.465+0000 7f1605bd5640 1 --2- 172.21.15.40:0/1124177451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16000b8530 0x7f1600143920 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:27.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.465+0000 7f1605bd5640 1 -- 172.21.15.40:0/1124177451 >> 172.21.15.40:0/1124177451 conn(0x7f160006a540 msgr2=0x7f16000bb560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:27.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.465+0000 7f1605bd5640 1 -- 172.21.15.40:0/1124177451 shutdown_connections 2024-09-13T15:50:27.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.465+0000 7f1605bd5640 1 -- 172.21.15.40:0/1124177451 wait complete. 2024-09-13T15:50:27.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc-backup.data pg_num 2024-09-13T15:50:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.601+0000 7f12a5db2640 1 Processor -- start 2024-09-13T15:50:27.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f12a5db2640 1 -- start start 2024-09-13T15:50:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f12a5db2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12a00b4600 0x7f12a014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f12a5db2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a00c1130 con 0x7f12a014e280 2024-09-13T15:50:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f12a5db2640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a014e780 con 0x7f12a00b4600 2024-09-13T15:50:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f129f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12a00b4600 0x7f12a014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f129effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f12a014e280 0x7f12a00bf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34844/0 (socket says 172.21.15.40:34844) 2024-09-13T15:50:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f129effd640 1 -- 172.21.15.40:0/2869282195 learned_addr learned my addr 172.21.15.40:0/2869282195 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f129f7fe640 1 --2- 172.21.15.40:0/2869282195 >> v2:172.21.15.40:3300/0 conn(0x7f12a00b4600 0x7f12a014dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53864/0 (socket says 172.21.15.40:53864) 2024-09-13T15:50:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f129f7fe640 1 -- 172.21.15.40:0/2869282195 >> v1:172.21.15.40:6789/0 conn(0x7f12a014e280 legacy=0x7f12a00bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f129f7fe640 1 -- 172.21.15.40:0/2869282195 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a00b59f0 con 0x7f12a00b4600 2024-09-13T15:50:27.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f129e7fc640 1 -- 172.21.15.40:0/2869282195 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251744131 0 0) 0x7f12a00c1130 con 0x7f12a014e280 2024-09-13T15:50:27.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f129f7fe640 1 --2- 172.21.15.40:0/2869282195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a00b4600 0x7f12a014dd40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1290009740 tx=0x7f129001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf65778c3f8a2b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:27.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f129e7fc640 1 -- 172.21.15.40:0/2869282195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12900ab530 con 0x7f12a00b4600 2024-09-13T15:50:27.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f129e7fc640 1 -- 172.21.15.40:0/2869282195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12900a7050 con 0x7f12a00b4600 2024-09-13T15:50:27.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.605+0000 7f129e7fc640 1 -- 172.21.15.40:0/2869282195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12900ab7e0 con 0x7f12a00b4600 2024-09-13T15:50:27.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 -- 172.21.15.40:0/2869282195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a00b4600 msgr2=0x7f12a014dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 --2- 172.21.15.40:0/2869282195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a00b4600 0x7f12a014dd40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1290009740 tx=0x7f129001c390 comp rx=0 tx=0).stop 2024-09-13T15:50:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 -- 172.21.15.40:0/2869282195 shutdown_connections 2024-09-13T15:50:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 --2- 172.21.15.40:0/2869282195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a00b4600 0x7f12a014dd40 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 -- 172.21.15.40:0/2869282195 >> 172.21.15.40:0/2869282195 conn(0x7f12a006a540 msgr2=0x7f12a00a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 -- 172.21.15.40:0/2869282195 shutdown_connections 2024-09-13T15:50:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 -- 172.21.15.40:0/2869282195 wait complete. 2024-09-13T15:50:27.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 Processor -- start 2024-09-13T15:50:27.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 -- start start 2024-09-13T15:50:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a00b4600 0x7f12a01411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a0146dd0 con 0x7f12a00b4600 2024-09-13T15:50:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f129f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a00b4600 0x7f12a01411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f129f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a00b4600 0x7f12a01411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53870/0 (socket says 172.21.15.40:53870) 2024-09-13T15:50:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f129f7fe640 1 -- 172.21.15.40:0/712453474 learned_addr learned my addr 172.21.15.40:0/712453474 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f129f7fe640 1 -- 172.21.15.40:0/712453474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1290009420 con 0x7f12a00b4600 2024-09-13T15:50:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f129f7fe640 1 --2- 172.21.15.40:0/712453474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a00b4600 0x7f12a01411a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1290019fc0 tx=0x7f129001abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f1287fff640 1 -- 172.21.15.40:0/712453474 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12900abea0 con 0x7f12a00b4600 2024-09-13T15:50:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f1287fff640 1 -- 172.21.15.40:0/712453474 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290004020 con 0x7f12a00b4600 2024-09-13T15:50:27.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f1287fff640 1 -- 172.21.15.40:0/712453474 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12900042c0 con 0x7f12a00b4600 2024-09-13T15:50:27.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 -- 172.21.15.40:0/712453474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a0147070 con 0x7f12a00b4600 2024-09-13T15:50:27.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 -- 172.21.15.40:0/712453474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a01417c0 con 0x7f12a00b4600 2024-09-13T15:50:27.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f1287fff640 1 -- 172.21.15.40:0/712453474 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f12900b2050 con 0x7f12a00b4600 2024-09-13T15:50:27.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.609+0000 7f12a5db2640 1 -- 172.21.15.40:0/712453474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a014dd40 con 0x7f12a00b4600 2024-09-13T15:50:27.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.613+0000 7f1287fff640 1 --2- 172.21.15.40:0/712453474 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f128c035530 0x7f128c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:27.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.613+0000 7f1287fff640 1 -- 172.21.15.40:0/712453474 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f12900e2890 con 0x7f12a00b4600 2024-09-13T15:50:27.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.613+0000 7f129effd640 1 --2- 172.21.15.40:0/712453474 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f128c035530 0x7f128c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:27.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.613+0000 7f129effd640 1 --2- 172.21.15.40:0/712453474 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f128c035530 0x7f128c0379f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1294007fd0 tx=0x7f1294007920 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:27.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.617+0000 7f1287fff640 1 -- 172.21.15.40:0/712453474 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f12900b2300 con 0x7f12a00b4600 2024-09-13T15:50:27.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.777+0000 7f12a5db2640 1 -- 172.21.15.40:0/712453474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc-backup.data", "var": "pg_num"} v 0) v1 -- 0x7f12a0157050 con 0x7f12a00b4600 2024-09-13T15:50:27.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.777+0000 7f1287fff640 1 -- 172.21.15.40:0/712453474 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc-backup.data", "var": "pg_num"}]=0 v52) v1 ==== 110+0+11 (secure 0 0 0) 0x7f12900b0020 con 0x7f12a00b4600 2024-09-13T15:50:27.779 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.777+0000 7f12a5db2640 1 -- 172.21.15.40:0/712453474 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f128c035530 msgr2=0x7f128c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.777+0000 7f12a5db2640 1 --2- 172.21.15.40:0/712453474 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f128c035530 0x7f128c0379f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1294007fd0 tx=0x7f1294007920 comp rx=0 tx=0).stop 2024-09-13T15:50:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.777+0000 7f12a5db2640 1 -- 172.21.15.40:0/712453474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a00b4600 msgr2=0x7f12a01411a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.777+0000 7f12a5db2640 1 --2- 172.21.15.40:0/712453474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a00b4600 0x7f12a01411a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1290019fc0 tx=0x7f129001abd0 comp rx=0 tx=0).stop 2024-09-13T15:50:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.777+0000 7f12a5db2640 1 -- 172.21.15.40:0/712453474 shutdown_connections 2024-09-13T15:50:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.777+0000 7f12a5db2640 1 --2- 172.21.15.40:0/712453474 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f128c035530 0x7f128c0379f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.777+0000 7f12a5db2640 1 --2- 172.21.15.40:0/712453474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12a00b4600 0x7f12a01411a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.777+0000 7f12a5db2640 1 -- 172.21.15.40:0/712453474 >> 172.21.15.40:0/712453474 conn(0x7f12a006a540 msgr2=0x7f12a00bf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.777+0000 7f12a5db2640 1 -- 172.21.15.40:0/712453474 shutdown_connections 2024-09-13T15:50:27.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.777+0000 7f12a5db2640 1 -- 172.21.15.40:0/712453474 wait complete. 2024-09-13T15:50:27.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:50:27.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.913+0000 7f437100c640 1 Processor -- start 2024-09-13T15:50:27.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.913+0000 7f437100c640 1 -- start start 2024-09-13T15:50:27.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.913+0000 7f437100c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f436c06e6f0 0x7f436c0bd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:27.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.913+0000 7f437100c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c0b5140 con 0x7f436c06ead0 2024-09-13T15:50:27.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.913+0000 7f437100c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436c0c0090 con 0x7f436c06e6f0 2024-09-13T15:50:27.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.913+0000 7f436ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f436c06e6f0 0x7f436c0bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:27.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.913+0000 7f436ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f436c06e6f0 0x7f436c0bd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53874/0 (socket says 172.21.15.40:53874) 2024-09-13T15:50:27.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.913+0000 7f436ad9d640 1 -- 172.21.15.40:0/460156497 learned_addr learned my addr 172.21.15.40:0/460156497 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:27.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.913+0000 7f436a59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f436c06ead0 0x7f436c0bf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34852/0 (socket says 172.21.15.40:34852) 2024-09-13T15:50:27.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.913+0000 7f436ad9d640 1 -- 172.21.15.40:0/460156497 >> v1:172.21.15.40:6789/0 conn(0x7f436c06ead0 legacy=0x7f436c0bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:27.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.913+0000 7f436ad9d640 1 -- 172.21.15.40:0/460156497 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c0becd0 con 0x7f436c06e6f0 2024-09-13T15:50:27.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f436ad9d640 1 --2- 172.21.15.40:0/460156497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c06e6f0 0x7f436c0bd420 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f435c009cc0 tx=0x7f435c01daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309e417f8943e286 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:27.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f4369d9b640 1 -- 172.21.15.40:0/460156497 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f435c009200 con 0x7f436c06e6f0 2024-09-13T15:50:27.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f4369d9b640 1 -- 172.21.15.40:0/460156497 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c0a6890 con 0x7f436c06e6f0 2024-09-13T15:50:27.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f4369d9b640 1 -- 172.21.15.40:0/460156497 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f435c0a6b50 con 0x7f436c06e6f0 2024-09-13T15:50:27.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f437100c640 1 -- 172.21.15.40:0/460156497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c06e6f0 msgr2=0x7f436c0bd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:27.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f437100c640 1 --2- 172.21.15.40:0/460156497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c06e6f0 0x7f436c0bd420 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f435c009cc0 tx=0x7f435c01daa0 comp rx=0 tx=0).stop 2024-09-13T15:50:27.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f437100c640 1 -- 172.21.15.40:0/460156497 shutdown_connections 2024-09-13T15:50:27.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f437100c640 1 --2- 172.21.15.40:0/460156497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c06e6f0 0x7f436c0bd420 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:27.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f437100c640 1 -- 172.21.15.40:0/460156497 >> 172.21.15.40:0/460156497 conn(0x7f436c06a370 msgr2=0x7f436c06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:27.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f437100c640 1 -- 172.21.15.40:0/460156497 shutdown_connections 2024-09-13T15:50:27.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f437100c640 1 -- 172.21.15.40:0/460156497 wait complete. 2024-09-13T15:50:27.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f437100c640 1 Processor -- start 2024-09-13T15:50:27.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f437100c640 1 -- start start 2024-09-13T15:50:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f437100c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c06e6f0 0x7f436c14b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.917+0000 7f437100c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c13e150 con 0x7f436c06e6f0 2024-09-13T15:50:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f436ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c06e6f0 0x7f436c14b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f436ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c06e6f0 0x7f436c14b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53880/0 (socket says 172.21.15.40:53880) 2024-09-13T15:50:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f436ad9d640 1 -- 172.21.15.40:0/757962198 learned_addr learned my addr 172.21.15.40:0/757962198 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f436ad9d640 1 -- 172.21.15.40:0/757962198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c00d040 con 0x7f436c06e6f0 2024-09-13T15:50:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f436ad9d640 1 --2- 172.21.15.40:0/757962198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c06e6f0 0x7f436c14b840 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f435c01b6d0 tx=0x7f435c01a840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f43637fe640 1 -- 172.21.15.40:0/757962198 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f435c0bb070 con 0x7f436c06e6f0 2024-09-13T15:50:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f43637fe640 1 -- 172.21.15.40:0/757962198 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c0ae8b0 con 0x7f436c06e6f0 2024-09-13T15:50:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f437100c640 1 -- 172.21.15.40:0/757962198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c139e60 con 0x7f436c06e6f0 2024-09-13T15:50:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f43637fe640 1 -- 172.21.15.40:0/757962198 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f435c0aeb50 con 0x7f436c06e6f0 2024-09-13T15:50:27.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f437100c640 1 -- 172.21.15.40:0/757962198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c13de40 con 0x7f436c06e6f0 2024-09-13T15:50:27.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f43637fe640 1 -- 172.21.15.40:0/757962198 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f435c0aecb0 con 0x7f436c06e6f0 2024-09-13T15:50:27.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f437100c640 1 -- 172.21.15.40:0/757962198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436c14bd80 con 0x7f436c06e6f0 2024-09-13T15:50:27.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f43637fe640 1 --2- 172.21.15.40:0/757962198 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f434c035530 0x7f434c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:27.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f43637fe640 1 -- 172.21.15.40:0/757962198 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f435c0e2fe0 con 0x7f436c06e6f0 2024-09-13T15:50:27.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f436a59c640 1 --2- 172.21.15.40:0/757962198 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f434c035530 0x7f434c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:27.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.921+0000 7f436a59c640 1 --2- 172.21.15.40:0/757962198 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f434c035530 0x7f434c0379f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4354001600 tx=0x7f4354007a50 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:27.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:27.925+0000 7f43637fe640 1 -- 172.21.15.40:0/757962198 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f435c0be730 con 0x7f436c06e6f0 2024-09-13T15:50:28.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.097+0000 7f437100c640 1 -- 172.21.15.40:0/757962198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f436c067850 con 0x7f436c06e6f0 2024-09-13T15:50:28.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.097+0000 7f43637fe640 1 -- 172.21.15.40:0/757962198 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 31 entries v52) v1 ==== 81+0+1800 (secure 0 0 0) 0x7f435c0b5330 con 0x7f436c06e6f0 2024-09-13T15:50:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3574317467 2024-09-13T16:50:27.040813+0000 2024-09-13T15:50:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3464899269 2024-09-13T16:49:52.021920+0000 2024-09-13T15:50:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2020191347 2024-09-13T16:39:12.695853+0000 2024-09-13T15:50:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3215060720 2024-09-13T16:37:48.656072+0000 2024-09-13T15:50:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2096071371 2024-09-13T16:41:43.833379+0000 2024-09-13T15:50:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1024811135 2024-09-13T16:46:02.884335+0000 2024-09-13T15:50:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1371435748 2024-09-13T16:49:08.427332+0000 2024-09-13T15:50:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1725367853 2024-09-13T16:38:36.652988+0000 2024-09-13T15:50:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2070755866 2024-09-13T16:38:12.598575+0000 2024-09-13T15:50:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/695475091 2024-09-13T16:40:02.785567+0000 2024-09-13T15:50:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/276304017 2024-09-13T16:45:37.498754+0000 2024-09-13T15:50:28.102 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3286012502 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2241829794 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2301478808 2024-09-13T16:40:27.738146+0000 2024-09-13T15:50:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6824/3185150828 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/690822190 2024-09-13T16:39:37.683949+0000 2024-09-13T15:50:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/414904326 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3777702470 2024-09-13T16:43:17.229644+0000 2024-09-13T15:50:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3514360215 2024-09-13T16:44:32.325869+0000 2024-09-13T15:50:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3853947452 2024-09-13T16:46:26.907170+0000 2024-09-13T15:50:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1991235795 2024-09-13T16:40:52.760615+0000 2024-09-13T15:50:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6825/3185150828 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1455634917 2024-09-13T16:47:13.340610+0000 2024-09-13T15:50:28.103 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2753473479 2024-09-13T16:42:16.865910+0000 2024-09-13T15:50:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3230130657 2024-09-13T16:42:51.908956+0000 2024-09-13T15:50:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3833267415 2024-09-13T16:48:42.495533+0000 2024-09-13T15:50:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1708466797 2024-09-13T16:43:42.271124+0000 2024-09-13T15:50:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3629684271 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3494260782 2024-09-13T16:41:17.861368+0000 2024-09-13T15:50:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1861863246 2024-09-13T16:44:07.288889+0000 2024-09-13T15:50:28.104 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1129415438 2024-09-13T16:47:37.323733+0000 2024-09-13T15:50:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:listed 31 entries 2024-09-13T15:50:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.101+0000 7f437100c640 1 -- 172.21.15.40:0/757962198 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f434c035530 msgr2=0x7f434c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.101+0000 7f437100c640 1 --2- 172.21.15.40:0/757962198 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f434c035530 0x7f434c0379f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4354001600 tx=0x7f4354007a50 comp rx=0 tx=0).stop 2024-09-13T15:50:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.101+0000 7f437100c640 1 -- 172.21.15.40:0/757962198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c06e6f0 msgr2=0x7f436c14b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.101+0000 7f437100c640 1 --2- 172.21.15.40:0/757962198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c06e6f0 0x7f436c14b840 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f435c01b6d0 tx=0x7f435c01a840 comp rx=0 tx=0).stop 2024-09-13T15:50:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.101+0000 7f437100c640 1 -- 172.21.15.40:0/757962198 shutdown_connections 2024-09-13T15:50:28.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.101+0000 7f437100c640 1 --2- 172.21.15.40:0/757962198 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f434c035530 0x7f434c0379f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:28.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.101+0000 7f437100c640 1 --2- 172.21.15.40:0/757962198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c06e6f0 0x7f436c14b840 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:28.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.101+0000 7f437100c640 1 -- 172.21.15.40:0/757962198 >> 172.21.15.40:0/757962198 conn(0x7f436c06a370 msgr2=0x7f436c14f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:28.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.101+0000 7f437100c640 1 -- 172.21.15.40:0/757962198 shutdown_connections 2024-09-13T15:50:28.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.101+0000 7f437100c640 1 -- 172.21.15.40:0/757962198 wait complete. 2024-09-13T15:50:28.121 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-09-13T15:50:28.121 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:50:28.127 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:50:28.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.289+0000 7f616113f640 1 Processor -- start 2024-09-13T15:50:28.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.289+0000 7f616113f640 1 -- start start 2024-09-13T15:50:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.289+0000 7f616113f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f615c0a2220 0x7f615c0bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.289+0000 7f616113f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c0a50c0 con 0x7f615c06e730 2024-09-13T15:50:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.289+0000 7f616113f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615c0a26b0 con 0x7f615c0a2220 2024-09-13T15:50:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.289+0000 7f615a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f615c0a2220 0x7f615c0bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.289+0000 7f615a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f615c0a2220 0x7f615c0bd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53886/0 (socket says 172.21.15.40:53886) 2024-09-13T15:50:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.289+0000 7f615ad9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f615c06e730 0x7f615c0c0e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34856/0 (socket says 172.21.15.40:34856) 2024-09-13T15:50:28.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.289+0000 7f615a59c640 1 -- 172.21.15.40:0/325712053 learned_addr learned my addr 172.21.15.40:0/325712053 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:28.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.289+0000 7f615a59c640 1 -- 172.21.15.40:0/325712053 >> v1:172.21.15.40:6789/0 conn(0x7f615c06e730 legacy=0x7f615c0c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:28.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.289+0000 7f615a59c640 1 -- 172.21.15.40:0/325712053 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c0bfc70 con 0x7f615c0a2220 2024-09-13T15:50:28.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.289+0000 7f6159d9b640 1 -- 172.21.15.40:0/325712053 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405558875 0 0) 0x7f615c0a50c0 con 0x7f615c06e730 2024-09-13T15:50:28.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f615a59c640 1 --2- 172.21.15.40:0/325712053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c0a2220 0x7f615c0bd5f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6144009e50 tx=0x7f614401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1e174ba4a17133 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:28.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f6159d9b640 1 -- 172.21.15.40:0/325712053 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6144009200 con 0x7f615c0a2220 2024-09-13T15:50:28.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f6159d9b640 1 -- 172.21.15.40:0/325712053 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61440a5680 con 0x7f615c0a2220 2024-09-13T15:50:28.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f6159d9b640 1 -- 172.21.15.40:0/325712053 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f61440a5940 con 0x7f615c0a2220 2024-09-13T15:50:28.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f616113f640 1 -- 172.21.15.40:0/325712053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c0a2220 msgr2=0x7f615c0bd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:28.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f616113f640 1 --2- 172.21.15.40:0/325712053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c0a2220 0x7f615c0bd5f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6144009e50 tx=0x7f614401ca30 comp rx=0 tx=0).stop 2024-09-13T15:50:28.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f616113f640 1 -- 172.21.15.40:0/325712053 shutdown_connections 2024-09-13T15:50:28.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f616113f640 1 --2- 172.21.15.40:0/325712053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c0a2220 0x7f615c0bd5f0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:28.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f616113f640 1 -- 172.21.15.40:0/325712053 >> 172.21.15.40:0/325712053 conn(0x7f615c06a540 msgr2=0x7f615c0a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:28.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f616113f640 1 -- 172.21.15.40:0/325712053 shutdown_connections 2024-09-13T15:50:28.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f616113f640 1 -- 172.21.15.40:0/325712053 wait complete. 2024-09-13T15:50:28.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f616113f640 1 Processor -- start 2024-09-13T15:50:28.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f616113f640 1 -- start start 2024-09-13T15:50:28.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f616113f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c06e730 0x7f615c150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:28.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f616113f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1621e0 con 0x7f615c06e730 2024-09-13T15:50:28.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f615ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c06e730 0x7f615c150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:28.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f615ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c06e730 0x7f615c150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53892/0 (socket says 172.21.15.40:53892) 2024-09-13T15:50:28.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.293+0000 7f615ad9d640 1 -- 172.21.15.40:0/3397257548 learned_addr learned my addr 172.21.15.40:0/3397257548 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:28.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f615ad9d640 1 -- 172.21.15.40:0/3397257548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144009b30 con 0x7f615c06e730 2024-09-13T15:50:28.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f615ad9d640 1 --2- 172.21.15.40:0/3397257548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c06e730 0x7f615c150d40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c420 tx=0x7f614c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:28.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f61537fe640 1 -- 172.21.15.40:0/3397257548 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f614c0074d0 con 0x7f615c06e730 2024-09-13T15:50:28.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f61537fe640 1 -- 172.21.15.40:0/3397257548 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c007630 con 0x7f615c06e730 2024-09-13T15:50:28.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f616113f640 1 -- 172.21.15.40:0/3397257548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c14f7d0 con 0x7f615c06e730 2024-09-13T15:50:28.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f61537fe640 1 -- 172.21.15.40:0/3397257548 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f614c004960 con 0x7f615c06e730 2024-09-13T15:50:28.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f616113f640 1 -- 172.21.15.40:0/3397257548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c1626c0 con 0x7f615c06e730 2024-09-13T15:50:28.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f61537fe640 1 -- 172.21.15.40:0/3397257548 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f614c004ac0 con 0x7f615c06e730 2024-09-13T15:50:28.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f616113f640 1 -- 172.21.15.40:0/3397257548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c162910 con 0x7f615c06e730 2024-09-13T15:50:28.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f61537fe640 1 --2- 172.21.15.40:0/3397257548 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f613c035530 0x7f613c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:28.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f61537fe640 1 -- 172.21.15.40:0/3397257548 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f614c0479d0 con 0x7f615c06e730 2024-09-13T15:50:28.300 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f615a59c640 1 --2- 172.21.15.40:0/3397257548 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f613c035530 0x7f613c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:28.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.297+0000 7f615a59c640 1 --2- 172.21.15.40:0/3397257548 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f613c035530 0x7f613c0379f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f61440ae000 tx=0x7f61440a7070 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:28.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.301+0000 7f61537fe640 1 -- 172.21.15.40:0/3397257548 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f614c01ab40 con 0x7f615c06e730 2024-09-13T15:50:28.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.461+0000 7f616113f640 1 -- 172.21.15.40:0/3397257548 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f615c0bd5f0 con 0x7f615c06e730 2024-09-13T15:50:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.465+0000 7f61537fe640 1 -- 172.21.15.40:0/3397257548 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+20031 (secure 0 0 0) 0x7f614c018070 con 0x7f615c06e730 2024-09-13T15:50:28.468 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:50:28.468 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":52,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:50:27.213869+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.2699999809265137,"score_stable":1.2699999809265137,"optimal_score":1,"raw_score_acting":1.2699999809265137,"raw_score_stable":1.2699999809265137,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs.dc.meta","create_time":"2024-09-13T15:34:54.455347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"dc"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs.dc.data","create_time":"2024-09-13T15:34:55.209802+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"dc"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs.dc-backup.meta","create_time":"2024-09-13T15:34:56.580392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"dc-backup"}},"read_balance":{"score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs.dc-backup.data","create_time":"2024-09-13T15:34:57.245673+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"dc-backup"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1c","mappings":[{"from":0,"to":2}]},{"pgid":"3.24","mappings":[{"from":0,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/3574317467":"2024-09-13T16:50:27.040813+0000","172.21.15.40:0/3464899269":"2024-09-13T16:49:52.021920+0000","172.21.15.40:0/2020191347":"2024-09-13T16:39:12.695853+0000","172.21.15.40:0/3215060720":"2024-09-13T16:37:48.656072+0000","172.21.15.40:0/2096071371":"2024-09-13T16:41:43.833379+0000","172.21.15.40:0/1024811135":"2024-09-13T16:46:02.884335+0000","172.21.15.40:0/1371435748":"2024-09-13T16:49:08.427332+0000","172.21.15.40:0/1725367853":"2024-09-13T16:38:36.652988+0000","172.21.15.40:0/2070755866":"2024-09-13T16:38:12.598575+0000","172.21.15.40:0/695475091":"2024-09-13T16:40:02.785567+0000","172.21.15.40:0/276304017":"2024-09-13T16:45:37.498754+0000","172.21.15.40:0/3286012502":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/2241829794":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/2301478808":"2024-09-13T16:40:27.738146+0000","172.21.15.40:6824/3185150828":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/690822190":"2024-09-13T16:39:37.683949+0000","172.21.15.40:0/414904326":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/3777702470":"2024-09-13T16:43:17.229644+0000","172.21.15.40:0/3514360215":"2024-09-13T16:44:32.325869+0000","172.21.15.40:0/3853947452":"2024-09-13T16:46:26.907170+0000","172.21.15.40:0/1991235795":"2024-09-13T16:40:52.760615+0000","172.21.15.40:6825/3185150828":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/1455634917":"2024-09-13T16:47:13.340610+0000","172.21.15.40:0/2753473479":"2024-09-13T16:42:16.865910+0000","172.21.15.40:0/3230130657":"2024-09-13T16:42:51.908956+0000","172.21.15.40:0/3833267415":"2024-09-13T16:48:42.495533+0000","172.21.15.40:0/1708466797":"2024-09-13T16:43:42.271124+0000","172.21.15.40:0/3629684271":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/3494260782":"2024-09-13T16:41:17.861368+0000","172.21.15.40:0/1861863246":"2024-09-13T16:44:07.288889+0000","172.21.15.40:0/1129415438":"2024-09-13T16:47:37.323733+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:50:28.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.469+0000 7f616113f640 1 -- 172.21.15.40:0/3397257548 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f613c035530 msgr2=0x7f613c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:28.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.469+0000 7f616113f640 1 --2- 172.21.15.40:0/3397257548 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f613c035530 0x7f613c0379f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f61440ae000 tx=0x7f61440a7070 comp rx=0 tx=0).stop 2024-09-13T15:50:28.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.469+0000 7f616113f640 1 -- 172.21.15.40:0/3397257548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c06e730 msgr2=0x7f615c150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:28.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.469+0000 7f616113f640 1 --2- 172.21.15.40:0/3397257548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c06e730 0x7f615c150d40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f614c00c420 tx=0x7f614c00c8e0 comp rx=0 tx=0).stop 2024-09-13T15:50:28.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.469+0000 7f616113f640 1 -- 172.21.15.40:0/3397257548 shutdown_connections 2024-09-13T15:50:28.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.469+0000 7f616113f640 1 --2- 172.21.15.40:0/3397257548 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f613c035530 0x7f613c0379f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:28.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.469+0000 7f616113f640 1 --2- 172.21.15.40:0/3397257548 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c06e730 0x7f615c150d40 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:28.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.469+0000 7f616113f640 1 -- 172.21.15.40:0/3397257548 >> 172.21.15.40:0/3397257548 conn(0x7f615c06a540 msgr2=0x7f615c155880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:28.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.469+0000 7f616113f640 1 -- 172.21.15.40:0/3397257548 shutdown_connections 2024-09-13T15:50:28.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.469+0000 7f616113f640 1 -- 172.21.15.40:0/3397257548 wait complete. 2024-09-13T15:50:28.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:34:25.125767+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:34:33.833957+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.0299999713897705, 'raw_score_stable': 1.0299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:34:34.276037+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.2699999809265137, 'score_stable': 1.2699999809265137, 'optimal_score': 1, 'raw_score_acting': 1.2699999809265137, 'raw_score_stable': 1.2699999809265137, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs.dc.meta', 'create_time': '2024-09-13T15:34:54.455347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'dc'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs.dc.data', 'create_time': '2024-09-13T15:34:55.209802+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'dc'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs.dc-backup.meta', 'create_time': '2024-09-13T15:34:56.580392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'dc-backup'}}, 'read_balance': {'score_acting': 1.2200000286102295, 'score_stable': 1.2200000286102295, 'optimal_score': 1, 'raw_score_acting': 1.2200000286102295, 'raw_score_stable': 1.2200000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs.dc-backup.data', 'create_time': '2024-09-13T15:34:57.245673+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'dc-backup'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:50:28.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:50:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.613+0000 7f92dbd1a640 1 Processor -- start 2024-09-13T15:50:28.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.613+0000 7f92dbd1a640 1 -- start start 2024-09-13T15:50:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92dbd1a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92d40bebb0 0x7f92d40a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92dbd1a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d41515b0 con 0x7f92d40b4010 2024-09-13T15:50:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92dbd1a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d414e2c0 con 0x7f92d40bebb0 2024-09-13T15:50:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92d9ab6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92d40bebb0 0x7f92d40a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92d92b5640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f92d40b4010 0x7f92d406e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34860/0 (socket says 172.21.15.40:34860) 2024-09-13T15:50:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92d9ab6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92d40bebb0 0x7f92d40a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53908/0 (socket says 172.21.15.40:53908) 2024-09-13T15:50:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92d92b5640 1 -- 172.21.15.40:0/2584745539 learned_addr learned my addr 172.21.15.40:0/2584745539 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92d9ab6640 1 -- 172.21.15.40:0/2584745539 >> v1:172.21.15.40:6789/0 conn(0x7f92d40b4010 legacy=0x7f92d406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:28.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92d9ab6640 1 -- 172.21.15.40:0/2584745539 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d406f830 con 0x7f92d40bebb0 2024-09-13T15:50:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92d9ab6640 1 --2- 172.21.15.40:0/2584745539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d40bebb0 0x7f92d40a4d70 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009740 tx=0x7f92d001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befb957bf23a7aef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92d8ab4640 1 -- 172.21.15.40:0/2584745539 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92d40b6bc0 con 0x7f92d40bebb0 2024-09-13T15:50:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92d8ab4640 1 -- 172.21.15.40:0/2584745539 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d00a7050 con 0x7f92d40bebb0 2024-09-13T15:50:28.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92d8ab4640 1 -- 172.21.15.40:0/2584745539 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92d00ab680 con 0x7f92d40bebb0 2024-09-13T15:50:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92dbd1a640 1 -- 172.21.15.40:0/2584745539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d40bebb0 msgr2=0x7f92d40a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92dbd1a640 1 --2- 172.21.15.40:0/2584745539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d40bebb0 0x7f92d40a4d70 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f92d0009740 tx=0x7f92d001c420 comp rx=0 tx=0).stop 2024-09-13T15:50:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92dbd1a640 1 -- 172.21.15.40:0/2584745539 shutdown_connections 2024-09-13T15:50:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92dbd1a640 1 --2- 172.21.15.40:0/2584745539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d40bebb0 0x7f92d40a4d70 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92dbd1a640 1 -- 172.21.15.40:0/2584745539 >> 172.21.15.40:0/2584745539 conn(0x7f92d406a540 msgr2=0x7f92d40a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92dbd1a640 1 -- 172.21.15.40:0/2584745539 shutdown_connections 2024-09-13T15:50:28.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.617+0000 7f92dbd1a640 1 -- 172.21.15.40:0/2584745539 wait complete. 2024-09-13T15:50:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92dbd1a640 1 Processor -- start 2024-09-13T15:50:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92dbd1a640 1 -- start start 2024-09-13T15:50:28.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92dbd1a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d40b4010 0x7f92d40b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:28.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92dbd1a640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d4147790 con 0x7f92d40b4010 2024-09-13T15:50:28.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92d9ab6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d40b4010 0x7f92d40b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:28.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92d9ab6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d40b4010 0x7f92d40b81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53910/0 (socket says 172.21.15.40:53910) 2024-09-13T15:50:28.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92d9ab6640 1 -- 172.21.15.40:0/3267297288 learned_addr learned my addr 172.21.15.40:0/3267297288 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92d9ab6640 1 -- 172.21.15.40:0/3267297288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d0009420 con 0x7f92d40b4010 2024-09-13T15:50:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92d9ab6640 1 --2- 172.21.15.40:0/3267297288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d40b4010 0x7f92d40b81b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f92d00ae040 tx=0x7f92d00191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92ca7fc640 1 -- 172.21.15.40:0/3267297288 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92d00b4540 con 0x7f92d40b4010 2024-09-13T15:50:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92ca7fc640 1 -- 172.21.15.40:0/3267297288 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d00b46a0 con 0x7f92d40b4010 2024-09-13T15:50:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92ca7fc640 1 -- 172.21.15.40:0/3267297288 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f92d00b4980 con 0x7f92d40b4010 2024-09-13T15:50:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92dbd1a640 1 -- 172.21.15.40:0/3267297288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d40b88b0 con 0x7f92d40b4010 2024-09-13T15:50:28.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92dbd1a640 1 -- 172.21.15.40:0/3267297288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d4140a30 con 0x7f92d40b4010 2024-09-13T15:50:28.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92dbd1a640 1 -- 172.21.15.40:0/3267297288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d40b86f0 con 0x7f92d40b4010 2024-09-13T15:50:28.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92ca7fc640 1 -- 172.21.15.40:0/3267297288 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f92d00b2040 con 0x7f92d40b4010 2024-09-13T15:50:28.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92ca7fc640 1 --2- 172.21.15.40:0/3267297288 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f92b8035530 0x7f92b80379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:28.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92ca7fc640 1 -- 172.21.15.40:0/3267297288 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f92d00e2860 con 0x7f92d40b4010 2024-09-13T15:50:28.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.621+0000 7f92d92b5640 1 --2- 172.21.15.40:0/3267297288 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f92b8035530 0x7f92b80379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:28.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.625+0000 7f92d92b5640 1 --2- 172.21.15.40:0/3267297288 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f92b8035530 0x7f92b80379f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f92c4001610 tx=0x7f92c4007ad0 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:28.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.629+0000 7f92ca7fc640 1 -- 172.21.15.40:0/3267297288 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f92d00b4e60 con 0x7f92d40b4010 2024-09-13T15:50:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.781+0000 7f92dbd1a640 1 -- 172.21.15.40:0/3267297288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92d40a4d70 con 0x7f92d40b4010 2024-09-13T15:50:28.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.781+0000 7f92ca7fc640 1 -- 172.21.15.40:0/3267297288 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92d00b0070 con 0x7f92d40b4010 2024-09-13T15:50:28.786 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-09-13T15:50:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.785+0000 7f92dbd1a640 1 -- 172.21.15.40:0/3267297288 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f92b8035530 msgr2=0x7f92b80379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.785+0000 7f92dbd1a640 1 --2- 172.21.15.40:0/3267297288 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f92b8035530 0x7f92b80379f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f92c4001610 tx=0x7f92c4007ad0 comp rx=0 tx=0).stop 2024-09-13T15:50:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.785+0000 7f92dbd1a640 1 -- 172.21.15.40:0/3267297288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d40b4010 msgr2=0x7f92d40b81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.785+0000 7f92dbd1a640 1 --2- 172.21.15.40:0/3267297288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d40b4010 0x7f92d40b81b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f92d00ae040 tx=0x7f92d00191c0 comp rx=0 tx=0).stop 2024-09-13T15:50:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.785+0000 7f92dbd1a640 1 -- 172.21.15.40:0/3267297288 shutdown_connections 2024-09-13T15:50:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.785+0000 7f92dbd1a640 1 --2- 172.21.15.40:0/3267297288 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f92b8035530 0x7f92b80379f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:28.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.785+0000 7f92dbd1a640 1 --2- 172.21.15.40:0/3267297288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92d40b4010 0x7f92d40b81b0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.785+0000 7f92dbd1a640 1 -- 172.21.15.40:0/3267297288 >> 172.21.15.40:0/3267297288 conn(0x7f92d406a540 msgr2=0x7f92d406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.785+0000 7f92dbd1a640 1 -- 172.21.15.40:0/3267297288 shutdown_connections 2024-09-13T15:50:28.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.785+0000 7f92dbd1a640 1 -- 172.21.15.40:0/3267297288 wait complete. 2024-09-13T15:50:28.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:50:28.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.925+0000 7f9b45dcf640 1 Processor -- start 2024-09-13T15:50:28.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.925+0000 7f9b45dcf640 1 -- start start 2024-09-13T15:50:28.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.929+0000 7f9b45dcf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b400b8530 0x7f9b4006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:28.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.929+0000 7f9b45dcf640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b400be820 con 0x7f9b400b8910 2024-09-13T15:50:28.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.929+0000 7f9b45dcf640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b40153940 con 0x7f9b400b8530 2024-09-13T15:50:28.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.929+0000 7f9b3f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b400b8530 0x7f9b4006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:28.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.929+0000 7f9b3effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9b400b8910 0x7f9b4006e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34874/0 (socket says 172.21.15.40:34874) 2024-09-13T15:50:28.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.929+0000 7f9b3effd640 1 -- 172.21.15.40:0/3617815650 learned_addr learned my addr 172.21.15.40:0/3617815650 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:28.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.929+0000 7f9b3e7fc640 1 -- 172.21.15.40:0/3617815650 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941113969 0 0) 0x7f9b400be820 con 0x7f9b400b8910 2024-09-13T15:50:28.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.929+0000 7f9b3e7fc640 1 -- 172.21.15.40:0/3617815650 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b28003530 con 0x7f9b400b8910 2024-09-13T15:50:28.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.929+0000 7f9b3f7fe640 1 -- 172.21.15.40:0/3617815650 >> v1:172.21.15.40:6789/0 conn(0x7f9b400b8910 legacy=0x7f9b4006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:28.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.929+0000 7f9b3f7fe640 1 -- 172.21.15.40:0/3617815650 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b400c1290 con 0x7f9b400b8530 2024-09-13T15:50:28.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b3f7fe640 1 --2- 172.21.15.40:0/3617815650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b400b8530 0x7f9b4006f160 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009740 tx=0x7f9b3401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a660afe911f9cc34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:28.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b3e7fc640 1 -- 172.21.15.40:0/3617815650 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b340ab530 con 0x7f9b400b8530 2024-09-13T15:50:28.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b3e7fc640 1 -- 172.21.15.40:0/3617815650 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b340a7050 con 0x7f9b400b8530 2024-09-13T15:50:28.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b3e7fc640 1 -- 172.21.15.40:0/3617815650 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b340ab7e0 con 0x7f9b400b8530 2024-09-13T15:50:28.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b45dcf640 1 -- 172.21.15.40:0/3617815650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b400b8530 msgr2=0x7f9b4006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:28.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b45dcf640 1 --2- 172.21.15.40:0/3617815650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b400b8530 0x7f9b4006f160 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009740 tx=0x7f9b3401c420 comp rx=0 tx=0).stop 2024-09-13T15:50:28.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b45dcf640 1 -- 172.21.15.40:0/3617815650 shutdown_connections 2024-09-13T15:50:28.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b45dcf640 1 --2- 172.21.15.40:0/3617815650 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b400b8530 0x7f9b4006f160 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:28.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b45dcf640 1 -- 172.21.15.40:0/3617815650 >> 172.21.15.40:0/3617815650 conn(0x7f9b4006a540 msgr2=0x7f9b400a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:28.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b45dcf640 1 -- 172.21.15.40:0/3617815650 shutdown_connections 2024-09-13T15:50:28.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b45dcf640 1 -- 172.21.15.40:0/3617815650 wait complete. 2024-09-13T15:50:28.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b45dcf640 1 Processor -- start 2024-09-13T15:50:28.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.933+0000 7f9b45dcf640 1 -- start start 2024-09-13T15:50:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b45dcf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b400b8530 0x7f9b4009d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b45dcf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4014b590 con 0x7f9b400b8530 2024-09-13T15:50:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b3f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b400b8530 0x7f9b4009d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b3f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b400b8530 0x7f9b4009d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53928/0 (socket says 172.21.15.40:53928) 2024-09-13T15:50:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b3f7fe640 1 -- 172.21.15.40:0/605609830 learned_addr learned my addr 172.21.15.40:0/605609830 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b3f7fe640 1 -- 172.21.15.40:0/605609830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b34009420 con 0x7f9b400b8530 2024-09-13T15:50:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b3f7fe640 1 --2- 172.21.15.40:0/605609830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b400b8530 0x7f9b4009d330 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f9b3401a050 tx=0x7f9b3401ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b27fff640 1 -- 172.21.15.40:0/605609830 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b340abe10 con 0x7f9b400b8530 2024-09-13T15:50:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b27fff640 1 -- 172.21.15.40:0/605609830 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b340b7450 con 0x7f9b400b8530 2024-09-13T15:50:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b45dcf640 1 -- 172.21.15.40:0/605609830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4009d870 con 0x7f9b400b8530 2024-09-13T15:50:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b27fff640 1 -- 172.21.15.40:0/605609830 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b340b76f0 con 0x7f9b400b8530 2024-09-13T15:50:28.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b45dcf640 1 -- 172.21.15.40:0/605609830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b40099bb0 con 0x7f9b400b8530 2024-09-13T15:50:28.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b45dcf640 1 -- 172.21.15.40:0/605609830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b40099a10 con 0x7f9b400b8530 2024-09-13T15:50:28.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b27fff640 1 -- 172.21.15.40:0/605609830 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f9b340b7850 con 0x7f9b400b8530 2024-09-13T15:50:28.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b27fff640 1 --2- 172.21.15.40:0/605609830 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9b2c035530 0x7f9b2c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:28.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b27fff640 1 -- 172.21.15.40:0/605609830 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f9b340e2c00 con 0x7f9b400b8530 2024-09-13T15:50:28.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b3effd640 1 --2- 172.21.15.40:0/605609830 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9b2c035530 0x7f9b2c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:28.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.937+0000 7f9b3effd640 1 --2- 172.21.15.40:0/605609830 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9b2c035530 0x7f9b2c0379f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b30007fd0 tx=0x7f9b30007980 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:28.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:28.941+0000 7f9b27fff640 1 -- 172.21.15.40:0/605609830 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9b40099a10 con 0x7f9b400b8530 2024-09-13T15:50:29.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.109+0000 7f9b45dcf640 1 -- 172.21.15.40:0/605609830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b40099a10 con 0x7f9b400b8530 2024-09-13T15:50:29.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.109+0000 7f9b27fff640 1 -- 172.21.15.40:0/605609830 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b40099a10 con 0x7f9b400b8530 2024-09-13T15:50:29.111 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:29.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.109+0000 7f9b45dcf640 1 -- 172.21.15.40:0/605609830 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9b2c035530 msgr2=0x7f9b2c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:29.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.109+0000 7f9b45dcf640 1 --2- 172.21.15.40:0/605609830 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9b2c035530 0x7f9b2c0379f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9b30007fd0 tx=0x7f9b30007980 comp rx=0 tx=0).stop 2024-09-13T15:50:29.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.109+0000 7f9b45dcf640 1 -- 172.21.15.40:0/605609830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b400b8530 msgr2=0x7f9b4009d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.109+0000 7f9b45dcf640 1 --2- 172.21.15.40:0/605609830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b400b8530 0x7f9b4009d330 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f9b3401a050 tx=0x7f9b3401ac60 comp rx=0 tx=0).stop 2024-09-13T15:50:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.109+0000 7f9b45dcf640 1 -- 172.21.15.40:0/605609830 shutdown_connections 2024-09-13T15:50:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.109+0000 7f9b45dcf640 1 --2- 172.21.15.40:0/605609830 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f9b2c035530 0x7f9b2c0379f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.109+0000 7f9b45dcf640 1 --2- 172.21.15.40:0/605609830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b400b8530 0x7f9b4009d330 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.109+0000 7f9b45dcf640 1 -- 172.21.15.40:0/605609830 >> 172.21.15.40:0/605609830 conn(0x7f9b4006a540 msgr2=0x7f9b400bcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.109+0000 7f9b45dcf640 1 -- 172.21.15.40:0/605609830 shutdown_connections 2024-09-13T15:50:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.109+0000 7f9b45dcf640 1 -- 172.21.15.40:0/605609830 wait complete. 2024-09-13T15:50:29.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:50:29.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.253+0000 7f79da6de640 1 Processor -- start 2024-09-13T15:50:29.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.253+0000 7f79da6de640 1 -- start start 2024-09-13T15:50:29.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.253+0000 7f79da6de640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79d406a180 0x7f79d4071620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:29.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.253+0000 7f79da6de640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d40be470 con 0x7f79d406a560 2024-09-13T15:50:29.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.253+0000 7f79da6de640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d4070c80 con 0x7f79d406a180 2024-09-13T15:50:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.253+0000 7f79d3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79d406a180 0x7f79d4071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.253+0000 7f79d3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79d406a180 0x7f79d4071620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53942/0 (socket says 172.21.15.40:53942) 2024-09-13T15:50:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.253+0000 7f79d37fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f79d406a560 0x7f79d406f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34882/0 (socket says 172.21.15.40:34882) 2024-09-13T15:50:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.253+0000 7f79d3fff640 1 -- 172.21.15.40:0/950923398 learned_addr learned my addr 172.21.15.40:0/950923398 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.253+0000 7f79d3fff640 1 -- 172.21.15.40:0/950923398 >> v1:172.21.15.40:6789/0 conn(0x7f79d406a560 legacy=0x7f79d406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:29.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.253+0000 7f79d3fff640 1 -- 172.21.15.40:0/950923398 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d40b9640 con 0x7f79d406a180 2024-09-13T15:50:29.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79d3fff640 1 --2- 172.21.15.40:0/950923398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d406a180 0x7f79d4071620 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f79c40097f0 tx=0x7f79c401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0995c1a0679b672 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:29.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79d2ffd640 1 -- 172.21.15.40:0/950923398 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79c40ad460 con 0x7f79d406a180 2024-09-13T15:50:29.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79d2ffd640 1 -- 172.21.15.40:0/950923398 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c40ad5c0 con 0x7f79d406a180 2024-09-13T15:50:29.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79d2ffd640 1 -- 172.21.15.40:0/950923398 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79c40ad880 con 0x7f79d406a180 2024-09-13T15:50:29.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79da6de640 1 -- 172.21.15.40:0/950923398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d406a180 msgr2=0x7f79d4071620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:29.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79da6de640 1 --2- 172.21.15.40:0/950923398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d406a180 0x7f79d4071620 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f79c40097f0 tx=0x7f79c401c450 comp rx=0 tx=0).stop 2024-09-13T15:50:29.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79da6de640 1 -- 172.21.15.40:0/950923398 shutdown_connections 2024-09-13T15:50:29.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79da6de640 1 --2- 172.21.15.40:0/950923398 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d406a180 0x7f79d4071620 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:29.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79da6de640 1 -- 172.21.15.40:0/950923398 >> 172.21.15.40:0/950923398 conn(0x7f79d4065d40 msgr2=0x7f79d4066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:29.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79da6de640 1 -- 172.21.15.40:0/950923398 shutdown_connections 2024-09-13T15:50:29.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79da6de640 1 -- 172.21.15.40:0/950923398 wait complete. 2024-09-13T15:50:29.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79da6de640 1 Processor -- start 2024-09-13T15:50:29.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.257+0000 7f79da6de640 1 -- start start 2024-09-13T15:50:29.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79da6de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d406a180 0x7f79d4150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:29.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79da6de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d4152070 con 0x7f79d406a180 2024-09-13T15:50:29.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d406a180 0x7f79d4150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:29.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d406a180 0x7f79d4150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53952/0 (socket says 172.21.15.40:53952) 2024-09-13T15:50:29.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d3fff640 1 -- 172.21.15.40:0/513997120 learned_addr learned my addr 172.21.15.40:0/513997120 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:29.264 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d3fff640 1 -- 172.21.15.40:0/513997120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c40094d0 con 0x7f79d406a180 2024-09-13T15:50:29.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d3fff640 1 --2- 172.21.15.40:0/513997120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d406a180 0x7f79d4150870 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f79c4019060 tx=0x7f79c401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:29.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d0ff9640 1 -- 172.21.15.40:0/513997120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79c40b8550 con 0x7f79d406a180 2024-09-13T15:50:29.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d0ff9640 1 -- 172.21.15.40:0/513997120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79c40b86d0 con 0x7f79d406a180 2024-09-13T15:50:29.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d0ff9640 1 -- 172.21.15.40:0/513997120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79c40b89b0 con 0x7f79d406a180 2024-09-13T15:50:29.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79da6de640 1 -- 172.21.15.40:0/513997120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d4161530 con 0x7f79d406a180 2024-09-13T15:50:29.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79da6de640 1 -- 172.21.15.40:0/513997120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d415e580 con 0x7f79d406a180 2024-09-13T15:50:29.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d0ff9640 1 -- 172.21.15.40:0/513997120 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f79c40b4040 con 0x7f79d406a180 2024-09-13T15:50:29.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79da6de640 1 -- 172.21.15.40:0/513997120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d4150db0 con 0x7f79d406a180 2024-09-13T15:50:29.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d0ff9640 1 --2- 172.21.15.40:0/513997120 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f79c0035530 0x7f79c00379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:29.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d0ff9640 1 -- 172.21.15.40:0/513997120 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f79c40e2b50 con 0x7f79d406a180 2024-09-13T15:50:29.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d37fe640 1 --2- 172.21.15.40:0/513997120 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f79c0035530 0x7f79c00379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:29.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.261+0000 7f79d37fe640 1 --2- 172.21.15.40:0/513997120 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f79c0035530 0x7f79c00379f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f79d406a940 tx=0x7f79c8007a10 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:29.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.265+0000 7f79d0ff9640 1 -- 172.21.15.40:0/513997120 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f79c40ac9b0 con 0x7f79d406a180 2024-09-13T15:50:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.417+0000 7f79da6de640 1 -- 172.21.15.40:0/513997120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79d4071620 con 0x7f79d406a180 2024-09-13T15:50:29.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.421+0000 7f79d0ff9640 1 -- 172.21.15.40:0/513997120 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79c40b2020 con 0x7f79d406a180 2024-09-13T15:50:29.423 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-09-13T15:50:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.421+0000 7f79da6de640 1 -- 172.21.15.40:0/513997120 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f79c0035530 msgr2=0x7f79c00379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.421+0000 7f79da6de640 1 --2- 172.21.15.40:0/513997120 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f79c0035530 0x7f79c00379f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f79d406a940 tx=0x7f79c8007a10 comp rx=0 tx=0).stop 2024-09-13T15:50:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.421+0000 7f79da6de640 1 -- 172.21.15.40:0/513997120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d406a180 msgr2=0x7f79d4150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.421+0000 7f79da6de640 1 --2- 172.21.15.40:0/513997120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d406a180 0x7f79d4150870 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f79c4019060 tx=0x7f79c401ac90 comp rx=0 tx=0).stop 2024-09-13T15:50:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.421+0000 7f79da6de640 1 -- 172.21.15.40:0/513997120 shutdown_connections 2024-09-13T15:50:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.421+0000 7f79da6de640 1 --2- 172.21.15.40:0/513997120 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f79c0035530 0x7f79c00379f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.421+0000 7f79da6de640 1 --2- 172.21.15.40:0/513997120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79d406a180 0x7f79d4150870 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.421+0000 7f79da6de640 1 -- 172.21.15.40:0/513997120 >> 172.21.15.40:0/513997120 conn(0x7f79d4065d40 msgr2=0x7f79d406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:29.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.421+0000 7f79da6de640 1 -- 172.21.15.40:0/513997120 shutdown_connections 2024-09-13T15:50:29.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.421+0000 7f79da6de640 1 -- 172.21.15.40:0/513997120 wait complete. 2024-09-13T15:50:29.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc.meta pg_num 2024-09-13T15:50:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.561+0000 7f3a8b233640 1 Processor -- start 2024-09-13T15:50:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.561+0000 7f3a8b233640 1 -- start start 2024-09-13T15:50:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.561+0000 7f3a8b233640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a840bebb0 0x7f3a840a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.561+0000 7f3a8b233640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a841515b0 con 0x7f3a840b4010 2024-09-13T15:50:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.561+0000 7f3a8b233640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a8414e2c0 con 0x7f3a840bebb0 2024-09-13T15:50:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.561+0000 7f3a88fcf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a840bebb0 0x7f3a840a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.561+0000 7f3a88fcf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3a840bebb0 0x7f3a840a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53956/0 (socket says 172.21.15.40:53956) 2024-09-13T15:50:29.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.561+0000 7f3a88fcf640 1 -- 172.21.15.40:0/2898961635 learned_addr learned my addr 172.21.15.40:0/2898961635 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:29.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.561+0000 7f3a83fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3a840b4010 0x7f3a8406e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34892/0 (socket says 172.21.15.40:34892) 2024-09-13T15:50:29.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.561+0000 7f3a88fcf640 1 -- 172.21.15.40:0/2898961635 >> v1:172.21.15.40:6789/0 conn(0x7f3a840b4010 legacy=0x7f3a8406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:29.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.561+0000 7f3a88fcf640 1 -- 172.21.15.40:0/2898961635 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8406f830 con 0x7f3a840bebb0 2024-09-13T15:50:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a88fcf640 1 --2- 172.21.15.40:0/2898961635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a840bebb0 0x7f3a840a4d70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3a740097f0 tx=0x7f3a7401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee6c86ae74814a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a837fe640 1 -- 172.21.15.40:0/2898961635 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a840b6bc0 con 0x7f3a840bebb0 2024-09-13T15:50:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a837fe640 1 -- 172.21.15.40:0/2898961635 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a740a7050 con 0x7f3a840bebb0 2024-09-13T15:50:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a837fe640 1 -- 172.21.15.40:0/2898961635 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a740ab680 con 0x7f3a840bebb0 2024-09-13T15:50:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a8b233640 1 -- 172.21.15.40:0/2898961635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a840bebb0 msgr2=0x7f3a840a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a8b233640 1 --2- 172.21.15.40:0/2898961635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a840bebb0 0x7f3a840a4d70 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f3a740097f0 tx=0x7f3a7401c4e0 comp rx=0 tx=0).stop 2024-09-13T15:50:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a8b233640 1 -- 172.21.15.40:0/2898961635 shutdown_connections 2024-09-13T15:50:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a8b233640 1 --2- 172.21.15.40:0/2898961635 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a840bebb0 0x7f3a840a4d70 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a8b233640 1 -- 172.21.15.40:0/2898961635 >> 172.21.15.40:0/2898961635 conn(0x7f3a8406a540 msgr2=0x7f3a840a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a8b233640 1 -- 172.21.15.40:0/2898961635 shutdown_connections 2024-09-13T15:50:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a8b233640 1 -- 172.21.15.40:0/2898961635 wait complete. 2024-09-13T15:50:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a8b233640 1 Processor -- start 2024-09-13T15:50:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.565+0000 7f3a8b233640 1 -- start start 2024-09-13T15:50:29.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a8b233640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a840b4010 0x7f3a84148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:29.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a8b233640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84149430 con 0x7f3a840b4010 2024-09-13T15:50:29.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a88fcf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a840b4010 0x7f3a84148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:29.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a88fcf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a840b4010 0x7f3a84148ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53968/0 (socket says 172.21.15.40:53968) 2024-09-13T15:50:29.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a88fcf640 1 -- 172.21.15.40:0/1576263029 learned_addr learned my addr 172.21.15.40:0/1576263029 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:29.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a88fcf640 1 -- 172.21.15.40:0/1576263029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a740094d0 con 0x7f3a840b4010 2024-09-13T15:50:29.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a88fcf640 1 --2- 172.21.15.40:0/1576263029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a840b4010 0x7f3a84148ba0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3a740ae040 tx=0x7f3a74019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:29.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a817fa640 1 -- 172.21.15.40:0/1576263029 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a740b4620 con 0x7f3a840b4010 2024-09-13T15:50:29.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a817fa640 1 -- 172.21.15.40:0/1576263029 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a740b4780 con 0x7f3a840b4010 2024-09-13T15:50:29.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a8b233640 1 -- 172.21.15.40:0/1576263029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a841490e0 con 0x7f3a840b4010 2024-09-13T15:50:29.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a817fa640 1 -- 172.21.15.40:0/1576263029 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a740b4a20 con 0x7f3a840b4010 2024-09-13T15:50:29.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a8b233640 1 -- 172.21.15.40:0/1576263029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a841e9ee0 con 0x7f3a840b4010 2024-09-13T15:50:29.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a8b233640 1 -- 172.21.15.40:0/1576263029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8414b9a0 con 0x7f3a840b4010 2024-09-13T15:50:29.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a817fa640 1 -- 172.21.15.40:0/1576263029 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f3a740b2040 con 0x7f3a840b4010 2024-09-13T15:50:29.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a817fa640 1 --2- 172.21.15.40:0/1576263029 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3a70035530 0x7f3a700379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:29.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a817fa640 1 -- 172.21.15.40:0/1576263029 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f3a740e2930 con 0x7f3a840b4010 2024-09-13T15:50:29.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a83fff640 1 --2- 172.21.15.40:0/1576263029 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3a70035530 0x7f3a700379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:29.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.569+0000 7f3a83fff640 1 --2- 172.21.15.40:0/1576263029 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3a70035530 0x7f3a700379f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3a78001600 tx=0x7f3a78007a50 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:29.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.577+0000 7f3a817fa640 1 -- 172.21.15.40:0/1576263029 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3a8414b9a0 con 0x7f3a840b4010 2024-09-13T15:50:29.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.733+0000 7f3a8b233640 1 -- 172.21.15.40:0/1576263029 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc.meta", "var": "pg_num"} v 0) v1 -- 0x7f3a8414b9a0 con 0x7f3a840b4010 2024-09-13T15:50:29.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.733+0000 7f3a817fa640 1 -- 172.21.15.40:0/1576263029 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc.meta", "var": "pg_num"}]=0 v52) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3a8414b9a0 con 0x7f3a840b4010 2024-09-13T15:50:29.737 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.737+0000 7f3a8b233640 1 -- 172.21.15.40:0/1576263029 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3a70035530 msgr2=0x7f3a700379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.737+0000 7f3a8b233640 1 --2- 172.21.15.40:0/1576263029 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3a70035530 0x7f3a700379f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3a78001600 tx=0x7f3a78007a50 comp rx=0 tx=0).stop 2024-09-13T15:50:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.737+0000 7f3a8b233640 1 -- 172.21.15.40:0/1576263029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a840b4010 msgr2=0x7f3a84148ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.737+0000 7f3a8b233640 1 --2- 172.21.15.40:0/1576263029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a840b4010 0x7f3a84148ba0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3a740ae040 tx=0x7f3a74019280 comp rx=0 tx=0).stop 2024-09-13T15:50:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.737+0000 7f3a8b233640 1 -- 172.21.15.40:0/1576263029 shutdown_connections 2024-09-13T15:50:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.737+0000 7f3a8b233640 1 --2- 172.21.15.40:0/1576263029 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3a70035530 0x7f3a700379f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.737+0000 7f3a8b233640 1 --2- 172.21.15.40:0/1576263029 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3a840b4010 0x7f3a84148ba0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.737+0000 7f3a8b233640 1 -- 172.21.15.40:0/1576263029 >> 172.21.15.40:0/1576263029 conn(0x7f3a8406a540 msgr2=0x7f3a840be1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.737+0000 7f3a8b233640 1 -- 172.21.15.40:0/1576263029 shutdown_connections 2024-09-13T15:50:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.737+0000 7f3a8b233640 1 -- 172.21.15.40:0/1576263029 wait complete. 2024-09-13T15:50:29.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc.data pg_num 2024-09-13T15:50:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.885+0000 7f83d68b4640 1 Processor -- start 2024-09-13T15:50:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.885+0000 7f83d68b4640 1 -- start start 2024-09-13T15:50:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.889+0000 7f83d68b4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83d00b4010 0x7f83d00a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.889+0000 7f83d68b4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d01515b0 con 0x7f83d00bebb0 2024-09-13T15:50:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.889+0000 7f83d68b4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d014e2c0 con 0x7f83d00b4010 2024-09-13T15:50:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.889+0000 7f83cffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f83d00bebb0 0x7f83d006e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34896/0 (socket says 172.21.15.40:34896) 2024-09-13T15:50:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.889+0000 7f83cffff640 1 -- 172.21.15.40:0/1867578740 learned_addr learned my addr 172.21.15.40:0/1867578740 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:29.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.889+0000 7f83cf7fe640 1 --2- 172.21.15.40:0/1867578740 >> v2:172.21.15.40:3300/0 conn(0x7f83d00b4010 0x7f83d00a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.889+0000 7f83cf7fe640 1 -- 172.21.15.40:0/1867578740 >> v1:172.21.15.40:6789/0 conn(0x7f83d00bebb0 legacy=0x7f83d006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.889+0000 7f83cf7fe640 1 -- 172.21.15.40:0/1867578740 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d006f830 con 0x7f83d00b4010 2024-09-13T15:50:29.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.889+0000 7f83cf7fe640 1 --2- 172.21.15.40:0/1867578740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d00b4010 0x7f83d00a4d70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009740 tx=0x7f83c001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5928d09fa8baa54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:29.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.889+0000 7f83ceffd640 1 -- 172.21.15.40:0/1867578740 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83d00b6bc0 con 0x7f83d00b4010 2024-09-13T15:50:29.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.889+0000 7f83ceffd640 1 -- 172.21.15.40:0/1867578740 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c00a7050 con 0x7f83d00b4010 2024-09-13T15:50:29.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.889+0000 7f83ceffd640 1 -- 172.21.15.40:0/1867578740 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83c00ab680 con 0x7f83d00b4010 2024-09-13T15:50:29.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 -- 172.21.15.40:0/1867578740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d00b4010 msgr2=0x7f83d00a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:29.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 --2- 172.21.15.40:0/1867578740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d00b4010 0x7f83d00a4d70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009740 tx=0x7f83c001c420 comp rx=0 tx=0).stop 2024-09-13T15:50:29.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 -- 172.21.15.40:0/1867578740 shutdown_connections 2024-09-13T15:50:29.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 --2- 172.21.15.40:0/1867578740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d00b4010 0x7f83d00a4d70 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:29.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 -- 172.21.15.40:0/1867578740 >> 172.21.15.40:0/1867578740 conn(0x7f83d006a540 msgr2=0x7f83d00a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:29.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 -- 172.21.15.40:0/1867578740 shutdown_connections 2024-09-13T15:50:29.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 -- 172.21.15.40:0/1867578740 wait complete. 2024-09-13T15:50:29.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 Processor -- start 2024-09-13T15:50:29.895 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 -- start start 2024-09-13T15:50:29.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d00b4010 0x7f83d00c0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:29.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00c0d10 con 0x7f83d00b4010 2024-09-13T15:50:29.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d00b4010 0x7f83d00c0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:29.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d00b4010 0x7f83d00c0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53992/0 (socket says 172.21.15.40:53992) 2024-09-13T15:50:29.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83cffff640 1 -- 172.21.15.40:0/4260220321 learned_addr learned my addr 172.21.15.40:0/4260220321 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:29.897 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83cffff640 1 -- 172.21.15.40:0/4260220321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c0009420 con 0x7f83d00b4010 2024-09-13T15:50:29.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83cffff640 1 --2- 172.21.15.40:0/4260220321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d00b4010 0x7f83d00c0670 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f83b800c480 tx=0x7f83b800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:29.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83ccff9640 1 -- 172.21.15.40:0/4260220321 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b8005c20 con 0x7f83d00b4010 2024-09-13T15:50:29.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83ccff9640 1 -- 172.21.15.40:0/4260220321 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b8005d80 con 0x7f83d00b4010 2024-09-13T15:50:29.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 -- 172.21.15.40:0/4260220321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d0149530 con 0x7f83d00b4010 2024-09-13T15:50:29.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83ccff9640 1 -- 172.21.15.40:0/4260220321 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83b80071a0 con 0x7f83d00b4010 2024-09-13T15:50:29.898 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.893+0000 7f83d68b4640 1 -- 172.21.15.40:0/4260220321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d01ebed0 con 0x7f83d00b4010 2024-09-13T15:50:29.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.897+0000 7f83ccff9640 1 -- 172.21.15.40:0/4260220321 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f83b8007300 con 0x7f83d00b4010 2024-09-13T15:50:29.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.897+0000 7f83ccff9640 1 --2- 172.21.15.40:0/4260220321 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f83b0035530 0x7f83b00379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:29.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.897+0000 7f83d68b4640 1 -- 172.21.15.40:0/4260220321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d00a4d70 con 0x7f83d00b4010 2024-09-13T15:50:29.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.897+0000 7f83ccff9640 1 -- 172.21.15.40:0/4260220321 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f83b8047800 con 0x7f83d00b4010 2024-09-13T15:50:29.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.897+0000 7f83cf7fe640 1 --2- 172.21.15.40:0/4260220321 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f83b0035530 0x7f83b00379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:29.899 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.897+0000 7f83cf7fe640 1 --2- 172.21.15.40:0/4260220321 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f83b0035530 0x7f83b00379f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f83c00ad000 tx=0x7f83c00a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:29.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:29.901+0000 7f83ccff9640 1 -- 172.21.15.40:0/4260220321 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83b8017020 con 0x7f83d00b4010 2024-09-13T15:50:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.061+0000 7f83d68b4640 1 -- 172.21.15.40:0/4260220321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc.data", "var": "pg_num"} v 0) v1 -- 0x7f83d00c0f10 con 0x7f83d00b4010 2024-09-13T15:50:30.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.065+0000 7f83ccff9640 1 -- 172.21.15.40:0/4260220321 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc.data", "var": "pg_num"}]=0 v52) v1 ==== 103+0+11 (secure 0 0 0) 0x7f83b80104e0 con 0x7f83d00b4010 2024-09-13T15:50:30.067 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.065+0000 7f83d68b4640 1 -- 172.21.15.40:0/4260220321 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f83b0035530 msgr2=0x7f83b00379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.065+0000 7f83d68b4640 1 --2- 172.21.15.40:0/4260220321 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f83b0035530 0x7f83b00379f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f83c00ad000 tx=0x7f83c00a6000 comp rx=0 tx=0).stop 2024-09-13T15:50:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.065+0000 7f83d68b4640 1 -- 172.21.15.40:0/4260220321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d00b4010 msgr2=0x7f83d00c0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.065+0000 7f83d68b4640 1 --2- 172.21.15.40:0/4260220321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d00b4010 0x7f83d00c0670 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f83b800c480 tx=0x7f83b800c940 comp rx=0 tx=0).stop 2024-09-13T15:50:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.065+0000 7f83d68b4640 1 -- 172.21.15.40:0/4260220321 shutdown_connections 2024-09-13T15:50:30.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.065+0000 7f83d68b4640 1 --2- 172.21.15.40:0/4260220321 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f83b0035530 0x7f83b00379f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.065+0000 7f83d68b4640 1 --2- 172.21.15.40:0/4260220321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83d00b4010 0x7f83d00c0670 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.065+0000 7f83d68b4640 1 -- 172.21.15.40:0/4260220321 >> 172.21.15.40:0/4260220321 conn(0x7f83d006a540 msgr2=0x7f83d00706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:30.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.065+0000 7f83d68b4640 1 -- 172.21.15.40:0/4260220321 shutdown_connections 2024-09-13T15:50:30.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.065+0000 7f83d68b4640 1 -- 172.21.15.40:0/4260220321 wait complete. 2024-09-13T15:50:30.086 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc-backup.meta pg_num 2024-09-13T15:50:30.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.205+0000 7f2f32454640 1 Processor -- start 2024-09-13T15:50:30.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.205+0000 7f2f32454640 1 -- start start 2024-09-13T15:50:30.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.205+0000 7f2f32454640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2f2c14f3d0 0x7f2f2c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:30.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.205+0000 7f2f32454640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c0b48d0 con 0x7f2f2c06f400 2024-09-13T15:50:30.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.205+0000 7f2f32454640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c14e5c0 con 0x7f2f2c14f3d0 2024-09-13T15:50:30.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.205+0000 7f2f2b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2f2c14f3d0 0x7f2f2c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:30.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.205+0000 7f2f2b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2f2c14f3d0 0x7f2f2c0b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54006/0 (socket says 172.21.15.40:54006) 2024-09-13T15:50:30.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.205+0000 7f2f2b7fe640 1 -- 172.21.15.40:0/3643863699 learned_addr learned my addr 172.21.15.40:0/3643863699 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:30.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.205+0000 7f2f2bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2f2c06f400 0x7f2f2c0a4a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34904/0 (socket says 172.21.15.40:34904) 2024-09-13T15:50:30.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.205+0000 7f2f2b7fe640 1 -- 172.21.15.40:0/3643863699 >> v1:172.21.15.40:6789/0 conn(0x7f2f2c06f400 legacy=0x7f2f2c0a4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:30.210 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.205+0000 7f2f2b7fe640 1 -- 172.21.15.40:0/3643863699 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c0b5240 con 0x7f2f2c14f3d0 2024-09-13T15:50:30.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f2b7fe640 1 --2- 172.21.15.40:0/3643863699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2c14f3d0 0x7f2f2c0b4d00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009820 tx=0x7f2f2001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e679c96cf15f015 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:30.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f2affd640 1 -- 172.21.15.40:0/3643863699 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f200ab530 con 0x7f2f2c14f3d0 2024-09-13T15:50:30.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f2affd640 1 -- 172.21.15.40:0/3643863699 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f200a7050 con 0x7f2f2c14f3d0 2024-09-13T15:50:30.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f2affd640 1 -- 172.21.15.40:0/3643863699 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f200ab7e0 con 0x7f2f2c14f3d0 2024-09-13T15:50:30.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f32454640 1 -- 172.21.15.40:0/3643863699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2c14f3d0 msgr2=0x7f2f2c0b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:30.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f32454640 1 --2- 172.21.15.40:0/3643863699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2c14f3d0 0x7f2f2c0b4d00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009820 tx=0x7f2f2001c430 comp rx=0 tx=0).stop 2024-09-13T15:50:30.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f32454640 1 -- 172.21.15.40:0/3643863699 shutdown_connections 2024-09-13T15:50:30.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f32454640 1 --2- 172.21.15.40:0/3643863699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2c14f3d0 0x7f2f2c0b4d00 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f32454640 1 -- 172.21.15.40:0/3643863699 >> 172.21.15.40:0/3643863699 conn(0x7f2f2c06a540 msgr2=0x7f2f2c0a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:30.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f32454640 1 -- 172.21.15.40:0/3643863699 shutdown_connections 2024-09-13T15:50:30.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f32454640 1 -- 172.21.15.40:0/3643863699 wait complete. 2024-09-13T15:50:30.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f32454640 1 Processor -- start 2024-09-13T15:50:30.213 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.209+0000 7f2f32454640 1 -- start start 2024-09-13T15:50:30.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f32454640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2c06f400 0x7f2f2c146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:30.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f32454640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c0bb650 con 0x7f2f2c06f400 2024-09-13T15:50:30.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f2bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2c06f400 0x7f2f2c146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:30.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f2bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2c06f400 0x7f2f2c146c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54020/0 (socket says 172.21.15.40:54020) 2024-09-13T15:50:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f2bfff640 1 -- 172.21.15.40:0/489616444 learned_addr learned my addr 172.21.15.40:0/489616444 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f2bfff640 1 -- 172.21.15.40:0/489616444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200094d0 con 0x7f2f2c06f400 2024-09-13T15:50:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f2bfff640 1 --2- 172.21.15.40:0/489616444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2c06f400 0x7f2f2c146c50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00c7f0 tx=0x7f2f1c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f28ff9640 1 -- 172.21.15.40:0/489616444 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c00a610 con 0x7f2f2c06f400 2024-09-13T15:50:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f28ff9640 1 -- 172.21.15.40:0/489616444 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c00a770 con 0x7f2f2c06f400 2024-09-13T15:50:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f32454640 1 -- 172.21.15.40:0/489616444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c0bb2d0 con 0x7f2f2c06f400 2024-09-13T15:50:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f28ff9640 1 -- 172.21.15.40:0/489616444 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f1c00aa10 con 0x7f2f2c06f400 2024-09-13T15:50:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f32454640 1 -- 172.21.15.40:0/489616444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c147190 con 0x7f2f2c06f400 2024-09-13T15:50:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f32454640 1 -- 172.21.15.40:0/489616444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c0bb460 con 0x7f2f2c06f400 2024-09-13T15:50:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f28ff9640 1 -- 172.21.15.40:0/489616444 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f2f1c00ab70 con 0x7f2f2c06f400 2024-09-13T15:50:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f28ff9640 1 --2- 172.21.15.40:0/489616444 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2f18035530 0x7f2f180379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f28ff9640 1 -- 172.21.15.40:0/489616444 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f2f1c047b90 con 0x7f2f2c06f400 2024-09-13T15:50:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f2b7fe640 1 --2- 172.21.15.40:0/489616444 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2f18035530 0x7f2f180379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.213+0000 7f2f2b7fe640 1 --2- 172.21.15.40:0/489616444 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2f18035530 0x7f2f180379f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0a5320 tx=0x7f2f200a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:30.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.217+0000 7f2f28ff9640 1 -- 172.21.15.40:0/489616444 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2f1c007070 con 0x7f2f2c06f400 2024-09-13T15:50:30.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.381+0000 7f2f32454640 1 -- 172.21.15.40:0/489616444 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc-backup.meta", "var": "pg_num"} v 0) v1 -- 0x7f2f2c0b4d00 con 0x7f2f2c06f400 2024-09-13T15:50:30.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.381+0000 7f2f28ff9640 1 -- 172.21.15.40:0/489616444 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc-backup.meta", "var": "pg_num"}]=0 v52) v1 ==== 110+0+11 (secure 0 0 0) 0x7f2f1c017020 con 0x7f2f2c06f400 2024-09-13T15:50:30.383 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:30.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.381+0000 7f2f32454640 1 -- 172.21.15.40:0/489616444 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2f18035530 msgr2=0x7f2f180379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:30.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.381+0000 7f2f32454640 1 --2- 172.21.15.40:0/489616444 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2f18035530 0x7f2f180379f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0a5320 tx=0x7f2f200a6000 comp rx=0 tx=0).stop 2024-09-13T15:50:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.381+0000 7f2f32454640 1 -- 172.21.15.40:0/489616444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2c06f400 msgr2=0x7f2f2c146c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.381+0000 7f2f32454640 1 --2- 172.21.15.40:0/489616444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2c06f400 0x7f2f2c146c50 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00c7f0 tx=0x7f2f1c00ccb0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.381+0000 7f2f32454640 1 -- 172.21.15.40:0/489616444 shutdown_connections 2024-09-13T15:50:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.381+0000 7f2f32454640 1 --2- 172.21.15.40:0/489616444 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2f18035530 0x7f2f180379f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.381+0000 7f2f32454640 1 --2- 172.21.15.40:0/489616444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2f2c06f400 0x7f2f2c146c50 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.381+0000 7f2f32454640 1 -- 172.21.15.40:0/489616444 >> 172.21.15.40:0/489616444 conn(0x7f2f2c06a540 msgr2=0x7f2f2c14cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.381+0000 7f2f32454640 1 -- 172.21.15.40:0/489616444 shutdown_connections 2024-09-13T15:50:30.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.381+0000 7f2f32454640 1 -- 172.21.15.40:0/489616444 wait complete. 2024-09-13T15:50:30.402 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.dc-backup.data pg_num 2024-09-13T15:50:30.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.529+0000 7f320bf25640 1 Processor -- start 2024-09-13T15:50:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.529+0000 7f320bf25640 1 -- start start 2024-09-13T15:50:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.529+0000 7f320bf25640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f320406e490 0x7f320406e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.529+0000 7f320bf25640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040c0f00 con 0x7f32040b3ff0 2024-09-13T15:50:30.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.529+0000 7f320bf25640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32040bcb60 con 0x7f320406e490 2024-09-13T15:50:30.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.529+0000 7f32094c0640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f32040b3ff0 0x7f32040bfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:34916/0 (socket says 172.21.15.40:34916) 2024-09-13T15:50:30.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.529+0000 7f32094c0640 1 -- 172.21.15.40:0/985629544 learned_addr learned my addr 172.21.15.40:0/985629544 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:30.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.529+0000 7f3209cc1640 1 --2- 172.21.15.40:0/985629544 >> v2:172.21.15.40:3300/0 conn(0x7f320406e490 0x7f320406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:30.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.529+0000 7f3208cbf640 1 -- 172.21.15.40:0/985629544 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506436343 0 0) 0x7f32040c0f00 con 0x7f32040b3ff0 2024-09-13T15:50:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.529+0000 7f3208cbf640 1 -- 172.21.15.40:0/985629544 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31f0003530 con 0x7f32040b3ff0 2024-09-13T15:50:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.529+0000 7f3209cc1640 1 -- 172.21.15.40:0/985629544 >> v1:172.21.15.40:6789/0 conn(0x7f32040b3ff0 legacy=0x7f32040bfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:30.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.529+0000 7f3209cc1640 1 -- 172.21.15.40:0/985629544 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040c0310 con 0x7f320406e490 2024-09-13T15:50:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f3209cc1640 1 --2- 172.21.15.40:0/985629544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f320406e490 0x7f320406e870 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3200009740 tx=0x7f320001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206d4b1dcd087396 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f3208cbf640 1 -- 172.21.15.40:0/985629544 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32000ab530 con 0x7f320406e490 2024-09-13T15:50:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f3208cbf640 1 -- 172.21.15.40:0/985629544 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32000a7050 con 0x7f320406e490 2024-09-13T15:50:30.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f3208cbf640 1 -- 172.21.15.40:0/985629544 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32000ab7c0 con 0x7f320406e490 2024-09-13T15:50:30.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f320bf25640 1 -- 172.21.15.40:0/985629544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f320406e490 msgr2=0x7f320406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:30.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f320bf25640 1 --2- 172.21.15.40:0/985629544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f320406e490 0x7f320406e870 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3200009740 tx=0x7f320001c420 comp rx=0 tx=0).stop 2024-09-13T15:50:30.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f320bf25640 1 -- 172.21.15.40:0/985629544 shutdown_connections 2024-09-13T15:50:30.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f320bf25640 1 --2- 172.21.15.40:0/985629544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f320406e490 0x7f320406e870 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f320bf25640 1 -- 172.21.15.40:0/985629544 >> 172.21.15.40:0/985629544 conn(0x7f320406a370 msgr2=0x7f320406a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:30.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f320bf25640 1 -- 172.21.15.40:0/985629544 shutdown_connections 2024-09-13T15:50:30.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f320bf25640 1 -- 172.21.15.40:0/985629544 wait complete. 2024-09-13T15:50:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f320bf25640 1 Processor -- start 2024-09-13T15:50:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f320bf25640 1 -- start start 2024-09-13T15:50:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f320bf25640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f320406e490 0x7f32040bb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:30.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f320bf25640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32041e95c0 con 0x7f320406e490 2024-09-13T15:50:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.533+0000 7f3209cc1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f320406e490 0x7f32040bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f3209cc1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f320406e490 0x7f32040bb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54050/0 (socket says 172.21.15.40:54050) 2024-09-13T15:50:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f3209cc1640 1 -- 172.21.15.40:0/1771639328 learned_addr learned my addr 172.21.15.40:0/1771639328 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f3209cc1640 1 -- 172.21.15.40:0/1771639328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3200009420 con 0x7f320406e490 2024-09-13T15:50:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f3209cc1640 1 --2- 172.21.15.40:0/1771639328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f320406e490 0x7f32040bb690 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f32000ae040 tx=0x7f32000191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f31fa7fc640 1 -- 172.21.15.40:0/1771639328 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32000b4410 con 0x7f320406e490 2024-09-13T15:50:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f31fa7fc640 1 -- 172.21.15.40:0/1771639328 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32000b4570 con 0x7f320406e490 2024-09-13T15:50:30.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f320bf25640 1 -- 172.21.15.40:0/1771639328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320409a500 con 0x7f320406e490 2024-09-13T15:50:30.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f31fa7fc640 1 -- 172.21.15.40:0/1771639328 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32000b4810 con 0x7f320406e490 2024-09-13T15:50:30.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f320bf25640 1 -- 172.21.15.40:0/1771639328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32040b7d30 con 0x7f320406e490 2024-09-13T15:50:30.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f320bf25640 1 -- 172.21.15.40:0/1771639328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320406e870 con 0x7f320406e490 2024-09-13T15:50:30.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f31fa7fc640 1 -- 172.21.15.40:0/1771639328 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f32000b2040 con 0x7f320406e490 2024-09-13T15:50:30.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f31fa7fc640 1 --2- 172.21.15.40:0/1771639328 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f31e8035530 0x7f31e80379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:30.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f31fa7fc640 1 -- 172.21.15.40:0/1771639328 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f32000e27a0 con 0x7f320406e490 2024-09-13T15:50:30.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f32094c0640 1 --2- 172.21.15.40:0/1771639328 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f31e8035530 0x7f31e80379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:30.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.537+0000 7f32094c0640 1 --2- 172.21.15.40:0/1771639328 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f31e8035530 0x7f31e80379f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f31f4000f70 tx=0x7f31f40010b0 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:30.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.545+0000 7f31fa7fc640 1 -- 172.21.15.40:0/1771639328 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32000bc7c0 con 0x7f320406e490 2024-09-13T15:50:30.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.705+0000 7f320bf25640 1 -- 172.21.15.40:0/1771639328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.dc-backup.data", "var": "pg_num"} v 0) v1 -- 0x7f32040668b0 con 0x7f320406e490 2024-09-13T15:50:30.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.705+0000 7f31fa7fc640 1 -- 172.21.15.40:0/1771639328 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.dc-backup.data", "var": "pg_num"}]=0 v52) v1 ==== 110+0+11 (secure 0 0 0) 0x7f32000b00b0 con 0x7f320406e490 2024-09-13T15:50:30.707 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-09-13T15:50:30.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.705+0000 7f320bf25640 1 -- 172.21.15.40:0/1771639328 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f31e8035530 msgr2=0x7f31e80379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:30.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.705+0000 7f320bf25640 1 --2- 172.21.15.40:0/1771639328 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f31e8035530 0x7f31e80379f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f31f4000f70 tx=0x7f31f40010b0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.705+0000 7f320bf25640 1 -- 172.21.15.40:0/1771639328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f320406e490 msgr2=0x7f32040bb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:30.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.705+0000 7f320bf25640 1 --2- 172.21.15.40:0/1771639328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f320406e490 0x7f32040bb690 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f32000ae040 tx=0x7f32000191c0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.705+0000 7f320bf25640 1 -- 172.21.15.40:0/1771639328 shutdown_connections 2024-09-13T15:50:30.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.705+0000 7f320bf25640 1 --2- 172.21.15.40:0/1771639328 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f31e8035530 0x7f31e80379f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.705+0000 7f320bf25640 1 --2- 172.21.15.40:0/1771639328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f320406e490 0x7f32040bb690 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.705+0000 7f320bf25640 1 -- 172.21.15.40:0/1771639328 >> 172.21.15.40:0/1771639328 conn(0x7f320406a370 msgr2=0x7f320414f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:30.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.705+0000 7f320bf25640 1 -- 172.21.15.40:0/1771639328 shutdown_connections 2024-09-13T15:50:30.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.705+0000 7f320bf25640 1 -- 172.21.15.40:0/1771639328 wait complete. 2024-09-13T15:50:30.727 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:50:30.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.849+0000 7f32dae9c640 1 Processor -- start 2024-09-13T15:50:30.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.849+0000 7f32dae9c640 1 -- start start 2024-09-13T15:50:30.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.849+0000 7f32dae9c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f32d40b3f70 0x7f32d40b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:30.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.849+0000 7f32dae9c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d40bec50 con 0x7f32d406b6a0 2024-09-13T15:50:30.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.849+0000 7f32dae9c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d40bf080 con 0x7f32d40b3f70 2024-09-13T15:50:30.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.849+0000 7f32d3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f32d40b3f70 0x7f32d40b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:30.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.849+0000 7f32d3fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f32d40b3f70 0x7f32d40b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54056/0 (socket says 172.21.15.40:54056) 2024-09-13T15:50:30.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.849+0000 7f32d3fff640 1 -- 172.21.15.40:0/4256966576 learned_addr learned my addr 172.21.15.40:0/4256966576 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:30.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.849+0000 7f32d3fff640 1 -- 172.21.15.40:0/4256966576 >> v1:172.21.15.40:6789/0 conn(0x7f32d406b6a0 legacy=0x7f32d40bdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:30.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.849+0000 7f32d3fff640 1 -- 172.21.15.40:0/4256966576 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40b63d0 con 0x7f32d40b3f70 2024-09-13T15:50:30.855 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32d3fff640 1 --2- 172.21.15.40:0/4256966576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d40b3f70 0x7f32d40b5330 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f32c80097f0 tx=0x7f32c801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feea02856ef2e2b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:30.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32d37fe640 1 -- 172.21.15.40:0/4256966576 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32c80aa590 con 0x7f32d40b3f70 2024-09-13T15:50:30.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32d37fe640 1 -- 172.21.15.40:0/4256966576 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c80aa6f0 con 0x7f32d40b3f70 2024-09-13T15:50:30.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32d37fe640 1 -- 172.21.15.40:0/4256966576 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32c80aa9b0 con 0x7f32d40b3f70 2024-09-13T15:50:30.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32dae9c640 1 -- 172.21.15.40:0/4256966576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d40b3f70 msgr2=0x7f32d40b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:30.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32dae9c640 1 --2- 172.21.15.40:0/4256966576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d40b3f70 0x7f32d40b5330 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f32c80097f0 tx=0x7f32c801c4e0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32dae9c640 1 -- 172.21.15.40:0/4256966576 shutdown_connections 2024-09-13T15:50:30.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32dae9c640 1 --2- 172.21.15.40:0/4256966576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d40b3f70 0x7f32d40b5330 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:30.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32dae9c640 1 -- 172.21.15.40:0/4256966576 >> 172.21.15.40:0/4256966576 conn(0x7f32d406a370 msgr2=0x7f32d406a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:30.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32dae9c640 1 -- 172.21.15.40:0/4256966576 shutdown_connections 2024-09-13T15:50:30.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32dae9c640 1 -- 172.21.15.40:0/4256966576 wait complete. 2024-09-13T15:50:30.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32dae9c640 1 Processor -- start 2024-09-13T15:50:30.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.853+0000 7f32dae9c640 1 -- start start 2024-09-13T15:50:30.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32dae9c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d406b6a0 0x7f32d40c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:30.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32dae9c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d4148440 con 0x7f32d406b6a0 2024-09-13T15:50:30.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d8c38640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d406b6a0 0x7f32d40c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:30.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d8c38640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d406b6a0 0x7f32d40c08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54060/0 (socket says 172.21.15.40:54060) 2024-09-13T15:50:30.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d8c38640 1 -- 172.21.15.40:0/1550677426 learned_addr learned my addr 172.21.15.40:0/1550677426 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:30.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d8c38640 1 -- 172.21.15.40:0/1550677426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c80094d0 con 0x7f32d406b6a0 2024-09-13T15:50:30.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d8c38640 1 --2- 172.21.15.40:0/1550677426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d406b6a0 0x7f32d40c08e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f32c400c480 tx=0x7f32c400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:30.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d17fa640 1 -- 172.21.15.40:0/1550677426 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32c4005150 con 0x7f32d406b6a0 2024-09-13T15:50:30.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d17fa640 1 -- 172.21.15.40:0/1550677426 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c40052b0 con 0x7f32d406b6a0 2024-09-13T15:50:30.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32dae9c640 1 -- 172.21.15.40:0/1550677426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d4143d90 con 0x7f32d406b6a0 2024-09-13T15:50:30.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d17fa640 1 -- 172.21.15.40:0/1550677426 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f32c4007030 con 0x7f32d406b6a0 2024-09-13T15:50:30.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32dae9c640 1 -- 172.21.15.40:0/1550677426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d4148660 con 0x7f32d406b6a0 2024-09-13T15:50:30.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32dae9c640 1 -- 172.21.15.40:0/1550677426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d4067850 con 0x7f32d406b6a0 2024-09-13T15:50:30.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d17fa640 1 -- 172.21.15.40:0/1550677426 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f32c4007190 con 0x7f32d406b6a0 2024-09-13T15:50:30.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d17fa640 1 --2- 172.21.15.40:0/1550677426 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f32c0035530 0x7f32c00379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:30.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d17fa640 1 -- 172.21.15.40:0/1550677426 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f32c40477c0 con 0x7f32d406b6a0 2024-09-13T15:50:30.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d3fff640 1 --2- 172.21.15.40:0/1550677426 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f32c0035530 0x7f32c00379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:30.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.857+0000 7f32d3fff640 1 --2- 172.21.15.40:0/1550677426 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f32c0035530 0x7f32c00379f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f32c80ae000 tx=0x7f32c80a7000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:30.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:30.861+0000 7f32d17fa640 1 -- 172.21.15.40:0/1550677426 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32c40106f0 con 0x7f32d406b6a0 2024-09-13T15:50:31.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:31.037+0000 7f32dae9c640 1 -- 172.21.15.40:0/1550677426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f32d40b5330 con 0x7f32d406b6a0 2024-09-13T15:50:31.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:31.037+0000 7f32d17fa640 1 -- 172.21.15.40:0/1550677426 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 31 entries v52) v1 ==== 81+0+1800 (secure 0 0 0) 0x7f32c40102e0 con 0x7f32d406b6a0 2024-09-13T15:50:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3574317467 2024-09-13T16:50:27.040813+0000 2024-09-13T15:50:31.041 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3464899269 2024-09-13T16:49:52.021920+0000 2024-09-13T15:50:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2020191347 2024-09-13T16:39:12.695853+0000 2024-09-13T15:50:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3215060720 2024-09-13T16:37:48.656072+0000 2024-09-13T15:50:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2096071371 2024-09-13T16:41:43.833379+0000 2024-09-13T15:50:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1024811135 2024-09-13T16:46:02.884335+0000 2024-09-13T15:50:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1371435748 2024-09-13T16:49:08.427332+0000 2024-09-13T15:50:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1725367853 2024-09-13T16:38:36.652988+0000 2024-09-13T15:50:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2070755866 2024-09-13T16:38:12.598575+0000 2024-09-13T15:50:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/695475091 2024-09-13T16:40:02.785567+0000 2024-09-13T15:50:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/276304017 2024-09-13T16:45:37.498754+0000 2024-09-13T15:50:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3286012502 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2241829794 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:31.042 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2301478808 2024-09-13T16:40:27.738146+0000 2024-09-13T15:50:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6824/3185150828 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/690822190 2024-09-13T16:39:37.683949+0000 2024-09-13T15:50:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/414904326 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3777702470 2024-09-13T16:43:17.229644+0000 2024-09-13T15:50:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3514360215 2024-09-13T16:44:32.325869+0000 2024-09-13T15:50:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3853947452 2024-09-13T16:46:26.907170+0000 2024-09-13T15:50:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1991235795 2024-09-13T16:40:52.760615+0000 2024-09-13T15:50:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:6825/3185150828 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1455634917 2024-09-13T16:47:13.340610+0000 2024-09-13T15:50:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/2753473479 2024-09-13T16:42:16.865910+0000 2024-09-13T15:50:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3230130657 2024-09-13T16:42:51.908956+0000 2024-09-13T15:50:31.043 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3833267415 2024-09-13T16:48:42.495533+0000 2024-09-13T15:50:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1708466797 2024-09-13T16:43:42.271124+0000 2024-09-13T15:50:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3629684271 2024-09-14T15:37:01.425806+0000 2024-09-13T15:50:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/3494260782 2024-09-13T16:41:17.861368+0000 2024-09-13T15:50:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1861863246 2024-09-13T16:44:07.288889+0000 2024-09-13T15:50:31.044 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40:0/1129415438 2024-09-13T16:47:37.323733+0000 2024-09-13T15:50:31.045 INFO:teuthology.orchestra.run.smithi040.stderr:listed 31 entries 2024-09-13T15:50:31.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:31.041+0000 7f32dae9c640 1 -- 172.21.15.40:0/1550677426 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f32c0035530 msgr2=0x7f32c00379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:31.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:31.041+0000 7f32dae9c640 1 --2- 172.21.15.40:0/1550677426 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f32c0035530 0x7f32c00379f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f32c80ae000 tx=0x7f32c80a7000 comp rx=0 tx=0).stop 2024-09-13T15:50:31.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:31.041+0000 7f32dae9c640 1 -- 172.21.15.40:0/1550677426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d406b6a0 msgr2=0x7f32d40c08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:31.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:31.041+0000 7f32dae9c640 1 --2- 172.21.15.40:0/1550677426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d406b6a0 0x7f32d40c08e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f32c400c480 tx=0x7f32c400c940 comp rx=0 tx=0).stop 2024-09-13T15:50:31.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:31.041+0000 7f32dae9c640 1 -- 172.21.15.40:0/1550677426 shutdown_connections 2024-09-13T15:50:31.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:31.041+0000 7f32dae9c640 1 --2- 172.21.15.40:0/1550677426 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f32c0035530 0x7f32c00379f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:31.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:31.041+0000 7f32dae9c640 1 --2- 172.21.15.40:0/1550677426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32d406b6a0 0x7f32d40c08e0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:31.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:31.041+0000 7f32dae9c640 1 -- 172.21.15.40:0/1550677426 >> 172.21.15.40:0/1550677426 conn(0x7f32d406a370 msgr2=0x7f32d4150120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:31.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:31.041+0000 7f32dae9c640 1 -- 172.21.15.40:0/1550677426 shutdown_connections 2024-09-13T15:50:31.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:31.041+0000 7f32dae9c640 1 -- 172.21.15.40:0/1550677426 wait complete. 2024-09-13T15:50:31.061 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2024-09-13T15:50:31.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:50:31.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-13T15:50:31.072 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi040.stderr:ceph-fuse[34267]: fuse finished with error 0 and tester_r 0 2024-09-13T15:50:31.145 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:50:31.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:50:37.246 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:50:37.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:50:37.247 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T15:50:37.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:50:37.255 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-09-13T15:50:37.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T15:50:37.345 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T15:50:37.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:50:37.346 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T15:50:37.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:50:37.401 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T15:50:37.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:50:37.454 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-09-13T15:50:37.612 DEBUG:teuthology.run_tasks:Unwinding manager cephfs-mirror 2024-09-13T15:50:37.623 DEBUG:tasks.cephfs_mirror.client.mirror3:waiting for process to exit 2024-09-13T15:50:37.623 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:50:37.623 INFO:tasks.cephfs_mirror.client.mirror3.smithi040.stderr:2024-09-13T15:50:37.620+0000 7faa63ea2640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror3 --foreground (PID: 38625) UID: 1000 2024-09-13T15:50:43.725 INFO:tasks.cephfs_mirror.client.mirror3:Stopped 2024-09-13T15:50:43.725 DEBUG:teuthology.run_tasks:Unwinding manager cephfs-mirror 2024-09-13T15:50:43.742 DEBUG:tasks.cephfs_mirror.client.mirror2:waiting for process to exit 2024-09-13T15:50:43.742 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:50:43.743 INFO:tasks.cephfs_mirror.client.mirror2.smithi040.stderr:2024-09-13T15:50:43.740+0000 7f4730f25640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror2 --foreground (PID: 38119) UID: 1000 2024-09-13T15:50:49.843 INFO:tasks.cephfs_mirror.client.mirror2:Stopped 2024-09-13T15:50:49.844 DEBUG:teuthology.run_tasks:Unwinding manager cephfs-mirror 2024-09-13T15:50:49.857 DEBUG:tasks.cephfs_mirror.client.mirror1:waiting for process to exit 2024-09-13T15:50:49.857 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:50:49.858 INFO:tasks.cephfs_mirror.client.mirror1.smithi040.stderr:2024-09-13T15:50:49.856+0000 7f9bd732e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term cephfs-mirror --cluster ceph --id mirror1 --foreground (PID: 38777) UID: 1000 2024-09-13T15:50:55.958 INFO:tasks.cephfs_mirror.client.mirror1:Stopped 2024-09-13T15:50:55.958 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-13T15:50:55.969 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-13T15:50:55.969 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T15:50:55.969 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:50:55.969 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mon mon_allow_pool_delete true' 2024-09-13T15:50:56.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.100+0000 7fca7110b640 1 Processor -- start 2024-09-13T15:50:56.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.100+0000 7fca7110b640 1 -- start start 2024-09-13T15:50:56.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.100+0000 7fca7110b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca6c0b9570 0x7fca6c06a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:56.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.100+0000 7fca7110b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c070640 con 0x7fca6c06f640 2024-09-13T15:50:56.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.100+0000 7fca7110b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c06c390 con 0x7fca6c0b9570 2024-09-13T15:50:56.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.100+0000 7fca6ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca6c0b9570 0x7fca6c06a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:56.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.100+0000 7fca6a59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fca6c06f640 0x7fca6c15db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49510/0 (socket says 172.21.15.40:49510) 2024-09-13T15:50:56.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.100+0000 7fca6a59c640 1 -- 172.21.15.40:0/2712936982 learned_addr learned my addr 172.21.15.40:0/2712936982 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:56.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.100+0000 7fca6ad9d640 1 -- 172.21.15.40:0/2712936982 >> v1:172.21.15.40:6789/0 conn(0x7fca6c06f640 legacy=0x7fca6c15db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:56.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.100+0000 7fca6ad9d640 1 -- 172.21.15.40:0/2712936982 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c06faf0 con 0x7fca6c0b9570 2024-09-13T15:50:56.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca6ad9d640 1 --2- 172.21.15.40:0/2712936982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca6c0b9570 0x7fca6c06a290 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fca64009d90 tx=0x7fca6401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d509086933edd602 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:56.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca69d9b640 1 -- 172.21.15.40:0/2712936982 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca640a5850 con 0x7fca6c0b9570 2024-09-13T15:50:56.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca69d9b640 1 -- 172.21.15.40:0/2712936982 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca640a59b0 con 0x7fca6c0b9570 2024-09-13T15:50:56.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca69d9b640 1 -- 172.21.15.40:0/2712936982 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca640a5c70 con 0x7fca6c0b9570 2024-09-13T15:50:56.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca7110b640 1 -- 172.21.15.40:0/2712936982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca6c0b9570 msgr2=0x7fca6c06a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:56.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca7110b640 1 --2- 172.21.15.40:0/2712936982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca6c0b9570 0x7fca6c06a290 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fca64009d90 tx=0x7fca6401c8c0 comp rx=0 tx=0).stop 2024-09-13T15:50:56.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca7110b640 1 -- 172.21.15.40:0/2712936982 shutdown_connections 2024-09-13T15:50:56.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca7110b640 1 --2- 172.21.15.40:0/2712936982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca6c0b9570 0x7fca6c06a290 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:56.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca7110b640 1 -- 172.21.15.40:0/2712936982 >> 172.21.15.40:0/2712936982 conn(0x7fca6c06c5b0 msgr2=0x7fca6c06c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:56.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca7110b640 1 -- 172.21.15.40:0/2712936982 shutdown_connections 2024-09-13T15:50:56.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca7110b640 1 -- 172.21.15.40:0/2712936982 wait complete. 2024-09-13T15:50:56.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca7110b640 1 Processor -- start 2024-09-13T15:50:56.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca7110b640 1 -- start start 2024-09-13T15:50:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca7110b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca6c06f640 0x7fca6c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.104+0000 7fca7110b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c14c840 con 0x7fca6c06f640 2024-09-13T15:50:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca6ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca6c06f640 0x7fca6c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca6ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca6c06f640 0x7fca6c155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53258/0 (socket says 172.21.15.40:53258) 2024-09-13T15:50:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca6ad9d640 1 -- 172.21.15.40:0/3866451002 learned_addr learned my addr 172.21.15.40:0/3866451002 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:56.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca6ad9d640 1 -- 172.21.15.40:0/3866451002 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca64009a70 con 0x7fca6c06f640 2024-09-13T15:50:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca6ad9d640 1 --2- 172.21.15.40:0/3866451002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca6c06f640 0x7fca6c155ef0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fca640194d0 tx=0x7fca64019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca537fe640 1 -- 172.21.15.40:0/3866451002 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca640ad800 con 0x7fca6c06f640 2024-09-13T15:50:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca537fe640 1 -- 172.21.15.40:0/3866451002 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca640ad960 con 0x7fca6c06f640 2024-09-13T15:50:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca7110b640 1 -- 172.21.15.40:0/3866451002 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c1555b0 con 0x7fca6c06f640 2024-09-13T15:50:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca537fe640 1 -- 172.21.15.40:0/3866451002 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca640adc40 con 0x7fca6c06f640 2024-09-13T15:50:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca7110b640 1 -- 172.21.15.40:0/3866451002 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c1624b0 con 0x7fca6c06f640 2024-09-13T15:50:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca537fe640 1 -- 172.21.15.40:0/3866451002 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7fca640b4050 con 0x7fca6c06f640 2024-09-13T15:50:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca7110b640 1 -- 172.21.15.40:0/3866451002 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6c06a290 con 0x7fca6c06f640 2024-09-13T15:50:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca537fe640 1 --2- 172.21.15.40:0/3866451002 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fca58035530 0x7fca580379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca537fe640 1 -- 172.21.15.40:0/3866451002 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7fca640e38d0 con 0x7fca6c06f640 2024-09-13T15:50:56.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca6a59c640 1 --2- 172.21.15.40:0/3866451002 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fca58035530 0x7fca580379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:56.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.108+0000 7fca6a59c640 1 --2- 172.21.15.40:0/3866451002 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fca58035530 0x7fca580379f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca6c06fa20 tx=0x7fca60007ad0 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:56.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.112+0000 7fca537fe640 1 -- 172.21.15.40:0/3866451002 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fca640c0be0 con 0x7fca6c06f640 2024-09-13T15:50:56.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.276+0000 7fca7110b640 1 -- 172.21.15.40:0/3866451002 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fca6c066840 con 0x7fca6c06f640 2024-09-13T15:50:56.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.280+0000 7fca537fe640 1 -- 172.21.15.40:0/3866451002 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v5)=0 v5) v1 ==== 122+0+0 (secure 0 0 0) 0x7fca640c07d0 con 0x7fca6c06f640 2024-09-13T15:50:56.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.284+0000 7fca7110b640 1 -- 172.21.15.40:0/3866451002 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fca58035530 msgr2=0x7fca580379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:56.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.284+0000 7fca7110b640 1 --2- 172.21.15.40:0/3866451002 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fca58035530 0x7fca580379f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fca6c06fa20 tx=0x7fca60007ad0 comp rx=0 tx=0).stop 2024-09-13T15:50:56.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.284+0000 7fca7110b640 1 -- 172.21.15.40:0/3866451002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca6c06f640 msgr2=0x7fca6c155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:56.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.284+0000 7fca7110b640 1 --2- 172.21.15.40:0/3866451002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca6c06f640 0x7fca6c155ef0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fca640194d0 tx=0x7fca64019660 comp rx=0 tx=0).stop 2024-09-13T15:50:56.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.284+0000 7fca7110b640 1 -- 172.21.15.40:0/3866451002 shutdown_connections 2024-09-13T15:50:56.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.284+0000 7fca7110b640 1 --2- 172.21.15.40:0/3866451002 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fca58035530 0x7fca580379f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:56.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.284+0000 7fca7110b640 1 --2- 172.21.15.40:0/3866451002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca6c06f640 0x7fca6c155ef0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:56.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.284+0000 7fca7110b640 1 -- 172.21.15.40:0/3866451002 >> 172.21.15.40:0/3866451002 conn(0x7fca6c06c5b0 msgr2=0x7fca6c0c19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:56.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.284+0000 7fca7110b640 1 -- 172.21.15.40:0/3866451002 shutdown_connections 2024-09-13T15:50:56.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.284+0000 7fca7110b640 1 -- 172.21.15.40:0/3866451002 wait complete. 2024-09-13T15:50:56.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs volume rm dc --yes-i-really-mean-it' 2024-09-13T15:50:56.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.424+0000 7f7a628db640 1 Processor -- start 2024-09-13T15:50:56.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.424+0000 7f7a628db640 1 -- start start 2024-09-13T15:50:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.424+0000 7f7a628db640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a5c06a8b0 0x7f7a5c0a6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.424+0000 7f7a628db640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5c0a7180 con 0x7f7a5c06ac90 2024-09-13T15:50:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.424+0000 7f7a628db640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c0a73b0 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.424+0000 7f7a5b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7a5c06ac90 0x7f7a5c0c09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49514/0 (socket says 172.21.15.40:49514) 2024-09-13T15:50:56.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.424+0000 7f7a5b7fe640 1 -- 172.21.15.40:0/3234719354 learned_addr learned my addr 172.21.15.40:0/3234719354 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:56.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.424+0000 7f7a5bfff640 1 --2- 172.21.15.40:0/3234719354 >> v2:172.21.15.40:3300/0 conn(0x7f7a5c06a8b0 0x7f7a5c0a6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:56.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.424+0000 7f7a5affd640 1 -- 172.21.15.40:0/3234719354 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052199548 0 0) 0x7f7a5c0a7180 con 0x7f7a5c06ac90 2024-09-13T15:50:56.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.424+0000 7f7a5affd640 1 -- 172.21.15.40:0/3234719354 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a48003530 con 0x7f7a5c06ac90 2024-09-13T15:50:56.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.424+0000 7f7a5bfff640 1 -- 172.21.15.40:0/3234719354 >> v1:172.21.15.40:6789/0 conn(0x7f7a5c06ac90 legacy=0x7f7a5c0c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:56.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.424+0000 7f7a5bfff640 1 -- 172.21.15.40:0/3234719354 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c08c0f0 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a5bfff640 1 --2- 172.21.15.40:0/3234719354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a5c06a8b0 0x7f7a5c0a6c40 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009740 tx=0x7f7a4c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d59b7a344ea5e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a5affd640 1 -- 172.21.15.40:0/3234719354 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c0ab530 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a5affd640 1 -- 172.21.15.40:0/3234719354 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c0a7050 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a5affd640 1 -- 172.21.15.40:0/3234719354 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c0ab7e0 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a628db640 1 -- 172.21.15.40:0/3234719354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a5c06a8b0 msgr2=0x7f7a5c0a6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a628db640 1 --2- 172.21.15.40:0/3234719354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a5c06a8b0 0x7f7a5c0a6c40 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009740 tx=0x7f7a4c01c420 comp rx=0 tx=0).stop 2024-09-13T15:50:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a628db640 1 -- 172.21.15.40:0/3234719354 shutdown_connections 2024-09-13T15:50:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a628db640 1 --2- 172.21.15.40:0/3234719354 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a5c06a8b0 0x7f7a5c0a6c40 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a628db640 1 -- 172.21.15.40:0/3234719354 >> 172.21.15.40:0/3234719354 conn(0x7f7a5c0a8500 msgr2=0x7f7a5c0a8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a628db640 1 -- 172.21.15.40:0/3234719354 shutdown_connections 2024-09-13T15:50:56.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a628db640 1 -- 172.21.15.40:0/3234719354 wait complete. 2024-09-13T15:50:56.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a628db640 1 Processor -- start 2024-09-13T15:50:56.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a628db640 1 -- start start 2024-09-13T15:50:56.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a628db640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a5c06a8b0 0x7f7a5c140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:56.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a628db640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c142270 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a5bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a5c06a8b0 0x7f7a5c140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:56.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a5bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a5c06a8b0 0x7f7a5c140ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53268/0 (socket says 172.21.15.40:53268) 2024-09-13T15:50:56.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.428+0000 7f7a5bfff640 1 -- 172.21.15.40:0/3414643962 learned_addr learned my addr 172.21.15.40:0/3414643962 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:56.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a5bfff640 1 -- 172.21.15.40:0/3414643962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c009420 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a5bfff640 1 --2- 172.21.15.40:0/3414643962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a5c06a8b0 0x7f7a5c140ce0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c01a050 tx=0x7f7a4c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a58ff9640 1 -- 172.21.15.40:0/3414643962 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c0abe10 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a58ff9640 1 -- 172.21.15.40:0/3414643962 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c0b7450 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a628db640 1 -- 172.21.15.40:0/3414643962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c141540 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a58ff9640 1 -- 172.21.15.40:0/3414643962 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c0b76f0 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a628db640 1 -- 172.21.15.40:0/3414643962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c141e80 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a628db640 1 -- 172.21.15.40:0/3414643962 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c08bc80 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a58ff9640 1 -- 172.21.15.40:0/3414643962 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f7a4c0b7850 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a58ff9640 1 --2- 172.21.15.40:0/3414643962 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f7a3c035530 0x7f7a3c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a58ff9640 1 -- 172.21.15.40:0/3414643962 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f7a4c0e2b40 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a5b7fe640 1 --2- 172.21.15.40:0/3414643962 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f7a3c035530 0x7f7a3c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:56.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.432+0000 7f7a5b7fe640 1 --2- 172.21.15.40:0/3414643962 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f7a3c035530 0x7f7a3c0379f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7a44001570 tx=0x7f7a440016e0 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:56.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.436+0000 7f7a58ff9640 1 -- 172.21.15.40:0/3414643962 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7a4c0c76c0 con 0x7f7a5c06a8b0 2024-09-13T15:50:56.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:56.620+0000 7f7a628db640 1 -- 172.21.15.40:0/3414643962 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "dc", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a5c154090 con 0x7f7a3c035530 2024-09-13T15:50:56.652 INFO:tasks.ceph.mon.a.smithi040.stderr:2024-09-13T15:50:56.652+0000 7f606287f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T15:50:56.718 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2024-09-13T15:50:59.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.672+0000 7f7a58ff9640 1 -- 172.21.15.40:0/3414643962 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+68 (secure 0 0 0) 0x7f7a4400cbf0 con 0x7f7a3c035530 2024-09-13T15:50:59.678 INFO:teuthology.orchestra.run.smithi040.stdout:metadata pool: cephfs.dc.meta data pool: ['cephfs.dc.data'] removed 2024-09-13T15:50:59.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.676+0000 7f7a628db640 1 -- 172.21.15.40:0/3414643962 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f7a3c035530 msgr2=0x7f7a3c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:59.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.676+0000 7f7a628db640 1 --2- 172.21.15.40:0/3414643962 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f7a3c035530 0x7f7a3c0379f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7a44001570 tx=0x7f7a440016e0 comp rx=0 tx=0).stop 2024-09-13T15:50:59.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.676+0000 7f7a628db640 1 -- 172.21.15.40:0/3414643962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a5c06a8b0 msgr2=0x7f7a5c140ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:59.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.676+0000 7f7a628db640 1 --2- 172.21.15.40:0/3414643962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a5c06a8b0 0x7f7a5c140ce0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c01a050 tx=0x7f7a4c01ac60 comp rx=0 tx=0).stop 2024-09-13T15:50:59.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.676+0000 7f7a628db640 1 -- 172.21.15.40:0/3414643962 shutdown_connections 2024-09-13T15:50:59.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.676+0000 7f7a628db640 1 --2- 172.21.15.40:0/3414643962 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f7a3c035530 0x7f7a3c0379f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:59.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.676+0000 7f7a628db640 1 --2- 172.21.15.40:0/3414643962 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a5c06a8b0 0x7f7a5c140ce0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:59.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.676+0000 7f7a628db640 1 -- 172.21.15.40:0/3414643962 >> 172.21.15.40:0/3414643962 conn(0x7f7a5c0a8500 msgr2=0x7f7a5c0730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:59.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.676+0000 7f7a628db640 1 -- 172.21.15.40:0/3414643962 shutdown_connections 2024-09-13T15:50:59.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.676+0000 7f7a628db640 1 -- 172.21.15.40:0/3414643962 wait complete. 2024-09-13T15:50:59.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs volume rm dc-backup --yes-i-really-mean-it' 2024-09-13T15:50:59.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.852+0000 7f6b7e32c640 1 Processor -- start 2024-09-13T15:50:59.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.852+0000 7f6b7e32c640 1 -- start start 2024-09-13T15:50:59.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b7e32c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b780bfd10 0x7f6b780b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b7e32c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b780c01a0 con 0x7f6b780bc750 2024-09-13T15:50:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b7e32c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b780a4a80 con 0x7f6b780bfd10 2024-09-13T15:50:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b6f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b780bfd10 0x7f6b780b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b77fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6b780bc750 0x7f6b780bcb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49534/0 (socket says 172.21.15.40:49534) 2024-09-13T15:50:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b77fff640 1 -- 172.21.15.40:0/3637631131 learned_addr learned my addr 172.21.15.40:0/3637631131 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:50:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b6f7fe640 1 -- 172.21.15.40:0/3637631131 >> v1:172.21.15.40:6789/0 conn(0x7f6b780bc750 legacy=0x7f6b780bcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b777fe640 1 -- 172.21.15.40:0/3637631131 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616192540 0 0) 0x7f6b780c01a0 con 0x7f6b780bc750 2024-09-13T15:50:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b6f7fe640 1 -- 172.21.15.40:0/3637631131 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780a4bf0 con 0x7f6b780bfd10 2024-09-13T15:50:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b6f7fe640 1 --2- 172.21.15.40:0/3637631131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b780bfd10 0x7f6b780b53c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009740 tx=0x7f6b6001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537731fa1f08bc7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b777fe640 1 -- 172.21.15.40:0/3637631131 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b600ab530 con 0x7f6b780bfd10 2024-09-13T15:50:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b777fe640 1 -- 172.21.15.40:0/3637631131 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b600a7050 con 0x7f6b780bfd10 2024-09-13T15:50:59.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.856+0000 7f6b777fe640 1 -- 172.21.15.40:0/3637631131 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b600ab7e0 con 0x7f6b780bfd10 2024-09-13T15:50:59.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 -- 172.21.15.40:0/3637631131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b780bfd10 msgr2=0x7f6b780b53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:50:59.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 --2- 172.21.15.40:0/3637631131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b780bfd10 0x7f6b780b53c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009740 tx=0x7f6b6001c420 comp rx=0 tx=0).stop 2024-09-13T15:50:59.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 -- 172.21.15.40:0/3637631131 shutdown_connections 2024-09-13T15:50:59.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 --2- 172.21.15.40:0/3637631131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b780bfd10 0x7f6b780b53c0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:50:59.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 -- 172.21.15.40:0/3637631131 >> 172.21.15.40:0/3637631131 conn(0x7f6b7806a5a0 msgr2=0x7f6b780a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:50:59.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 -- 172.21.15.40:0/3637631131 shutdown_connections 2024-09-13T15:50:59.864 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 -- 172.21.15.40:0/3637631131 wait complete. 2024-09-13T15:50:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 Processor -- start 2024-09-13T15:50:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 -- start start 2024-09-13T15:50:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b780bc750 0x7f6b7814bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b781ec180 con 0x7f6b780bc750 2024-09-13T15:50:59.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b77fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b780bc750 0x7f6b7814bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b77fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b780bc750 0x7f6b7814bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53308/0 (socket says 172.21.15.40:53308) 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b77fff640 1 -- 172.21.15.40:0/2646357389 learned_addr learned my addr 172.21.15.40:0/2646357389 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b77fff640 1 -- 172.21.15.40:0/2646357389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60009420 con 0x7f6b780bc750 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b77fff640 1 --2- 172.21.15.40:0/2646357389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b780bc750 0x7f6b7814bc80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c400 tx=0x7f6b6800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b757fa640 1 -- 172.21.15.40:0/2646357389 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b68007410 con 0x7f6b780bc750 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b757fa640 1 -- 172.21.15.40:0/2646357389 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68007570 con 0x7f6b780bc750 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 -- 172.21.15.40:0/2646357389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b780b6890 con 0x7f6b780bc750 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b757fa640 1 -- 172.21.15.40:0/2646357389 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b680047f0 con 0x7f6b780bc750 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.860+0000 7f6b7e32c640 1 -- 172.21.15.40:0/2646357389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b780a4740 con 0x7f6b780bc750 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.864+0000 7f6b757fa640 1 -- 172.21.15.40:0/2646357389 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f6b68004950 con 0x7f6b780bc750 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.864+0000 7f6b757fa640 1 --2- 172.21.15.40:0/2646357389 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6b58035530 0x7f6b580379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.864+0000 7f6b7e32c640 1 -- 172.21.15.40:0/2646357389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b781ebf20 con 0x7f6b780bc750 2024-09-13T15:50:59.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.864+0000 7f6b757fa640 1 -- 172.21.15.40:0/2646357389 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5873+0+0 (secure 0 0 0) 0x7f6b68047e90 con 0x7f6b780bc750 2024-09-13T15:50:59.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.864+0000 7f6b6f7fe640 1 --2- 172.21.15.40:0/2646357389 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6b58035530 0x7f6b580379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:50:59.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.864+0000 7f6b6f7fe640 1 --2- 172.21.15.40:0/2646357389 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6b58035530 0x7f6b580379f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6b600ad000 tx=0x7f6b600a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:50:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:50:59.868+0000 7f6b757fa640 1 -- 172.21.15.40:0/2646357389 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b6801a2b0 con 0x7f6b780bc750 2024-09-13T15:51:00.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:00.072+0000 7f6b7e32c640 1 -- 172.21.15.40:0/2646357389 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "dc-backup", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b781eb9d0 con 0x7f6b58035530 2024-09-13T15:51:00.081 INFO:tasks.ceph.mon.a.smithi040.stderr:2024-09-13T15:51:00.076+0000 7f606287f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T15:51:00.189 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2024-09-13T15:51:01.784 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:51:03.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.104+0000 7f6b757fa640 1 -- 172.21.15.40:0/2646357389 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f6b600ab670 con 0x7f6b58035530 2024-09-13T15:51:03.109 INFO:teuthology.orchestra.run.smithi040.stdout:metadata pool: cephfs.dc-backup.meta data pool: ['cephfs.dc-backup.data'] removed 2024-09-13T15:51:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.108+0000 7f6b7e32c640 1 -- 172.21.15.40:0/2646357389 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6b58035530 msgr2=0x7f6b580379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.108+0000 7f6b7e32c640 1 --2- 172.21.15.40:0/2646357389 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6b58035530 0x7f6b580379f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6b600ad000 tx=0x7f6b600a6000 comp rx=0 tx=0).stop 2024-09-13T15:51:03.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.108+0000 7f6b7e32c640 1 -- 172.21.15.40:0/2646357389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b780bc750 msgr2=0x7f6b7814bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.108+0000 7f6b7e32c640 1 --2- 172.21.15.40:0/2646357389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b780bc750 0x7f6b7814bc80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c400 tx=0x7f6b6800c8c0 comp rx=0 tx=0).stop 2024-09-13T15:51:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.108+0000 7f6b7e32c640 1 -- 172.21.15.40:0/2646357389 shutdown_connections 2024-09-13T15:51:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.108+0000 7f6b7e32c640 1 --2- 172.21.15.40:0/2646357389 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6b58035530 0x7f6b580379f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.108+0000 7f6b7e32c640 1 --2- 172.21.15.40:0/2646357389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b780bc750 0x7f6b7814bc80 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.108+0000 7f6b7e32c640 1 -- 172.21.15.40:0/2646357389 >> 172.21.15.40:0/2646357389 conn(0x7f6b7806a5a0 msgr2=0x7f6b7814ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.108+0000 7f6b7e32c640 1 -- 172.21.15.40:0/2646357389 shutdown_connections 2024-09-13T15:51:03.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.108+0000 7f6b7e32c640 1 -- 172.21.15.40:0/2646357389 wait complete. 2024-09-13T15:51:03.141 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T15:51:03.154 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T15:51:03.154 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:51:03.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.296+0000 7fb909b82640 1 Processor -- start 2024-09-13T15:51:03.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.296+0000 7fb909b82640 1 -- start start 2024-09-13T15:51:03.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.296+0000 7fb909b82640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb9040b7bd0 0x7fb9040c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:03.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.296+0000 7fb909b82640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9040a7850 con 0x7fb904153f60 2024-09-13T15:51:03.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.296+0000 7fb909b82640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90408c4f0 con 0x7fb9040b7bd0 2024-09-13T15:51:03.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.300+0000 7fb9037fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb904153f60 0x7fb9040c4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49552/0 (socket says 172.21.15.40:49552) 2024-09-13T15:51:03.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.300+0000 7fb9037fe640 1 -- 172.21.15.40:0/90186573 learned_addr learned my addr 172.21.15.40:0/90186573 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:51:03.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.300+0000 7fb902ffd640 1 --2- 172.21.15.40:0/90186573 >> v2:172.21.15.40:3300/0 conn(0x7fb9040b7bd0 0x7fb9040c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:03.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.300+0000 7fb902ffd640 1 -- 172.21.15.40:0/90186573 >> v1:172.21.15.40:6789/0 conn(0x7fb904153f60 legacy=0x7fb9040c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:03.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.300+0000 7fb902ffd640 1 -- 172.21.15.40:0/90186573 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90408bdb0 con 0x7fb9040b7bd0 2024-09-13T15:51:03.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.304+0000 7fb902ffd640 1 --2- 172.21.15.40:0/90186573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040b7bd0 0x7fb9040c06e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009dc0 tx=0x7fb8fc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595a8fcb2bc41594 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.304+0000 7fb9027fc640 1 -- 172.21.15.40:0/90186573 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8fc0a57d0 con 0x7fb9040b7bd0 2024-09-13T15:51:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.304+0000 7fb9027fc640 1 -- 172.21.15.40:0/90186573 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc0a5930 con 0x7fb9040b7bd0 2024-09-13T15:51:03.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.304+0000 7fb9027fc640 1 -- 172.21.15.40:0/90186573 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8fc0a5bf0 con 0x7fb9040b7bd0 2024-09-13T15:51:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.304+0000 7fb909b82640 1 -- 172.21.15.40:0/90186573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040b7bd0 msgr2=0x7fb9040c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:03.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.304+0000 7fb909b82640 1 --2- 172.21.15.40:0/90186573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040b7bd0 0x7fb9040c06e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009dc0 tx=0x7fb8fc01c950 comp rx=0 tx=0).stop 2024-09-13T15:51:03.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.304+0000 7fb909b82640 1 -- 172.21.15.40:0/90186573 shutdown_connections 2024-09-13T15:51:03.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.304+0000 7fb909b82640 1 --2- 172.21.15.40:0/90186573 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040b7bd0 0x7fb9040c06e0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:03.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.304+0000 7fb909b82640 1 -- 172.21.15.40:0/90186573 >> 172.21.15.40:0/90186573 conn(0x7fb9040a8640 msgr2=0x7fb904065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:03.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.304+0000 7fb909b82640 1 -- 172.21.15.40:0/90186573 shutdown_connections 2024-09-13T15:51:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.304+0000 7fb909b82640 1 -- 172.21.15.40:0/90186573 wait complete. 2024-09-13T15:51:03.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.308+0000 7fb909b82640 1 Processor -- start 2024-09-13T15:51:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.308+0000 7fb909b82640 1 -- start start 2024-09-13T15:51:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.308+0000 7fb909b82640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040b7bd0 0x7fb9041f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.308+0000 7fb909b82640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90415d9b0 con 0x7fb9040b7bd0 2024-09-13T15:51:03.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.308+0000 7fb9037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040b7bd0 0x7fb9041f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.308+0000 7fb9037fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040b7bd0 0x7fb9041f7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53358/0 (socket says 172.21.15.40:53358) 2024-09-13T15:51:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.308+0000 7fb9037fe640 1 -- 172.21.15.40:0/3707548266 learned_addr learned my addr 172.21.15.40:0/3707548266 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.312+0000 7fb9037fe640 1 -- 172.21.15.40:0/3707548266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc009a70 con 0x7fb9040b7bd0 2024-09-13T15:51:03.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.312+0000 7fb9037fe640 1 --2- 172.21.15.40:0/3707548266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040b7bd0 0x7fb9041f7bb0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400c3a0 tx=0x7fb8f400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.312+0000 7fb8ebfff640 1 -- 172.21.15.40:0/3707548266 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8f4005c20 con 0x7fb9040b7bd0 2024-09-13T15:51:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.312+0000 7fb8ebfff640 1 -- 172.21.15.40:0/3707548266 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f4005d80 con 0x7fb9040b7bd0 2024-09-13T15:51:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.312+0000 7fb8ebfff640 1 -- 172.21.15.40:0/3707548266 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8f4007200 con 0x7fb9040b7bd0 2024-09-13T15:51:03.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.312+0000 7fb909b82640 1 -- 172.21.15.40:0/3707548266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9041f7500 con 0x7fb9040b7bd0 2024-09-13T15:51:03.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.312+0000 7fb909b82640 1 -- 172.21.15.40:0/3707548266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb904149260 con 0x7fb9040b7bd0 2024-09-13T15:51:03.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.312+0000 7fb8ebfff640 1 -- 172.21.15.40:0/3707548266 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7fb8f4007360 con 0x7fb9040b7bd0 2024-09-13T15:51:03.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.312+0000 7fb8ebfff640 1 --2- 172.21.15.40:0/3707548266 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb8f0035580 0x7fb8f0037a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:03.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.316+0000 7fb8ebfff640 1 -- 172.21.15.40:0/3707548266 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7fb8f40472d0 con 0x7fb9040b7bd0 2024-09-13T15:51:03.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.316+0000 7fb909b82640 1 -- 172.21.15.40:0/3707548266 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e4005260 con 0x7fb9040b7bd0 2024-09-13T15:51:03.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.316+0000 7fb902ffd640 1 --2- 172.21.15.40:0/3707548266 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb8f0035580 0x7fb8f0037a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:03.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.316+0000 7fb902ffd640 1 --2- 172.21.15.40:0/3707548266 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb8f0035580 0x7fb8f0037a40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009dc0 tx=0x7fb8fc0a7070 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:03.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.324+0000 7fb8ebfff640 1 -- 172.21.15.40:0/3707548266 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb8f401b3b0 con 0x7fb9040b7bd0 2024-09-13T15:51:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.500+0000 7fb909b82640 1 -- 172.21.15.40:0/3707548266 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8e4000bd0 con 0x7fb8f0035580 2024-09-13T15:51:03.521 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.516+0000 7fb8ebfff640 1 -- 172.21.15.40:0/3707548266 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249958 (secure 0 0 0) 0x7fb8e4000bd0 con 0x7fb8f0035580 2024-09-13T15:51:03.525 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:51:03.526 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:51:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.524+0000 7fb909b82640 1 -- 172.21.15.40:0/3707548266 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb8f0035580 msgr2=0x7fb8f0037a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.524+0000 7fb909b82640 1 --2- 172.21.15.40:0/3707548266 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb8f0035580 0x7fb8f0037a40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009dc0 tx=0x7fb8fc0a7070 comp rx=0 tx=0).stop 2024-09-13T15:51:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.524+0000 7fb909b82640 1 -- 172.21.15.40:0/3707548266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040b7bd0 msgr2=0x7fb9041f7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.524+0000 7fb909b82640 1 --2- 172.21.15.40:0/3707548266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040b7bd0 0x7fb9041f7bb0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb8f400c3a0 tx=0x7fb8f400c860 comp rx=0 tx=0).stop 2024-09-13T15:51:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.524+0000 7fb909b82640 1 -- 172.21.15.40:0/3707548266 shutdown_connections 2024-09-13T15:51:03.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.524+0000 7fb909b82640 1 --2- 172.21.15.40:0/3707548266 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb8f0035580 0x7fb8f0037a40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:03.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.524+0000 7fb909b82640 1 --2- 172.21.15.40:0/3707548266 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9040b7bd0 0x7fb9041f7bb0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:03.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.524+0000 7fb909b82640 1 -- 172.21.15.40:0/3707548266 >> 172.21.15.40:0/3707548266 conn(0x7fb9040a8640 msgr2=0x7fb9040c3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:03.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.524+0000 7fb909b82640 1 -- 172.21.15.40:0/3707548266 shutdown_connections 2024-09-13T15:51:03.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.524+0000 7fb909b82640 1 -- 172.21.15.40:0/3707548266 wait complete. 2024-09-13T15:51:03.545 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-09-13T15:51:03.100882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593804,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":208,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":368,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":671712,"kb_used_data":267444,"kb_used_omap":4,"kb_used_meta":404219,"kb_avail":282443808,"statfs":{"total":289910292480,"available":289222459392,"internally_reserved":0,"allocated":273862656,"data_stored":238184199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":413920594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-303398561,"num_objects":-10335,"num_object_clones":-120,"num_object_copies":-20670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-10335,"num_whiteouts":-36,"num_read":-42011,"num_read_kb":-385490,"num_write":-30373,"num_write_kb":-317923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.440308"},"pg_stats":[{"pgid":"2.1f","version":"15'4","reported_seq":63,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339591+0000","last_change":"2024-09-13T15:34:34.960705+0000","last_active":"2024-09-13T15:51:00.339591+0000","last_peered":"2024-09-13T15:51:00.339591+0000","last_clean":"2024-09-13T15:51:00.339591+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:51:00.339591+0000","last_undegraded":"2024-09-13T15:51:00.339591+0000","last_fullsized":"2024-09-13T15:51:00.339591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099521+0000","last_change":"2024-09-13T15:34:35.338454+0000","last_active":"2024-09-13T15:51:00.099521+0000","last_peered":"2024-09-13T15:51:00.099521+0000","last_clean":"2024-09-13T15:51:00.099521+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:51:00.099521+0000","last_undegraded":"2024-09-13T15:51:00.099521+0000","last_fullsized":"2024-09-13T15:51:00.099521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:49.904225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099261+0000","last_change":"2024-09-13T15:34:34.955842+0000","last_active":"2024-09-13T15:51:00.099261+0000","last_peered":"2024-09-13T15:51:00.099261+0000","last_clean":"2024-09-13T15:51:00.099261+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:51:00.099261+0000","last_undegraded":"2024-09-13T15:51:00.099261+0000","last_fullsized":"2024-09-13T15:51:00.099261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.340160+0000","last_change":"2024-09-13T15:34:35.350474+0000","last_active":"2024-09-13T15:51:00.340160+0000","last_peered":"2024-09-13T15:51:00.340160+0000","last_clean":"2024-09-13T15:51:00.340160+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:51:00.340160+0000","last_undegraded":"2024-09-13T15:51:00.340160+0000","last_fullsized":"2024-09-13T15:51:00.340160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:08:45.573183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":60,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.335889+0000","last_change":"2024-09-13T15:34:34.950125+0000","last_active":"2024-09-13T15:51:00.335889+0000","last_peered":"2024-09-13T15:51:00.335889+0000","last_clean":"2024-09-13T15:51:00.335889+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:51:00.335889+0000","last_undegraded":"2024-09-13T15:51:00.335889+0000","last_fullsized":"2024-09-13T15:51:00.335889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051068+0000","last_change":"2024-09-13T15:34:35.333710+0000","last_active":"2024-09-13T15:51:00.051068+0000","last_peered":"2024-09-13T15:51:00.051068+0000","last_clean":"2024-09-13T15:51:00.051068+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:51:00.051068+0000","last_undegraded":"2024-09-13T15:51:00.051068+0000","last_fullsized":"2024-09-13T15:51:00.051068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095970+0000","last_change":"2024-09-13T15:35:20.173539+0000","last_active":"2024-09-13T15:51:00.095970+0000","last_peered":"2024-09-13T15:51:00.095970+0000","last_clean":"2024-09-13T15:51:00.095970+0000","last_became_active":"2024-09-13T15:35:20.165658+0000","last_became_peered":"2024-09-13T15:35:20.165658+0000","last_unstale":"2024-09-13T15:51:00.095970+0000","last_undegraded":"2024-09-13T15:51:00.095970+0000","last_fullsized":"2024-09-13T15:51:00.095970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:35.807536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.097424+0000","last_change":"2024-09-13T15:34:35.329220+0000","last_active":"2024-09-13T15:51:00.097424+0000","last_peered":"2024-09-13T15:51:00.097424+0000","last_clean":"2024-09-13T15:51:00.097424+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:51:00.097424+0000","last_undegraded":"2024-09-13T15:51:00.097424+0000","last_fullsized":"2024-09-13T15:51:00.097424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334413+0000","last_change":"2024-09-13T15:34:35.334308+0000","last_active":"2024-09-13T15:51:00.334413+0000","last_peered":"2024-09-13T15:51:00.334413+0000","last_clean":"2024-09-13T15:51:00.334413+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:51:00.334413+0000","last_undegraded":"2024-09-13T15:51:00.334413+0000","last_fullsized":"2024-09-13T15:51:00.334413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:50.918862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334863+0000","last_change":"2024-09-13T15:34:34.943033+0000","last_active":"2024-09-13T15:51:00.334863+0000","last_peered":"2024-09-13T15:51:00.334863+0000","last_clean":"2024-09-13T15:51:00.334863+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:51:00.334863+0000","last_undegraded":"2024-09-13T15:51:00.334863+0000","last_fullsized":"2024-09-13T15:51:00.334863+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.052739+0000","last_change":"2024-09-13T15:34:35.339704+0000","last_active":"2024-09-13T15:51:00.052739+0000","last_peered":"2024-09-13T15:51:00.052739+0000","last_clean":"2024-09-13T15:51:00.052739+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:51:00.052739+0000","last_undegraded":"2024-09-13T15:51:00.052739+0000","last_fullsized":"2024-09-13T15:51:00.052739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044596+0000","last_change":"2024-09-13T15:34:34.943732+0000","last_active":"2024-09-13T15:51:00.044596+0000","last_peered":"2024-09-13T15:51:00.044596+0000","last_clean":"2024-09-13T15:51:00.044596+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:51:00.044596+0000","last_undegraded":"2024-09-13T15:51:00.044596+0000","last_fullsized":"2024-09-13T15:51:00.044596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094473+0000","last_change":"2024-09-13T15:34:35.340037+0000","last_active":"2024-09-13T15:51:00.094473+0000","last_peered":"2024-09-13T15:51:00.094473+0000","last_clean":"2024-09-13T15:51:00.094473+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:51:00.094473+0000","last_undegraded":"2024-09-13T15:51:00.094473+0000","last_fullsized":"2024-09-13T15:51:00.094473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.048410+0000","last_change":"2024-09-13T15:34:34.943197+0000","last_active":"2024-09-13T15:51:00.048410+0000","last_peered":"2024-09-13T15:51:00.048410+0000","last_clean":"2024-09-13T15:51:00.048410+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:51:00.048410+0000","last_undegraded":"2024-09-13T15:51:00.048410+0000","last_fullsized":"2024-09-13T15:51:00.048410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333855+0000","last_change":"2024-09-13T15:34:35.327260+0000","last_active":"2024-09-13T15:51:00.333855+0000","last_peered":"2024-09-13T15:51:00.333855+0000","last_clean":"2024-09-13T15:51:00.333855+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:51:00.333855+0000","last_undegraded":"2024-09-13T15:51:00.333855+0000","last_fullsized":"2024-09-13T15:51:00.333855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.332568+0000","last_change":"2024-09-13T15:34:34.941308+0000","last_active":"2024-09-13T15:51:00.332568+0000","last_peered":"2024-09-13T15:51:00.332568+0000","last_clean":"2024-09-13T15:51:00.332568+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:51:00.332568+0000","last_undegraded":"2024-09-13T15:51:00.332568+0000","last_fullsized":"2024-09-13T15:51:00.332568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.337585+0000","last_change":"2024-09-13T15:34:35.334433+0000","last_active":"2024-09-13T15:51:00.337585+0000","last_peered":"2024-09-13T15:51:00.337585+0000","last_clean":"2024-09-13T15:51:00.337585+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:51:00.337585+0000","last_undegraded":"2024-09-13T15:51:00.337585+0000","last_fullsized":"2024-09-13T15:51:00.337585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:34.847820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.058322+0000","last_change":"2024-09-13T15:34:34.946540+0000","last_active":"2024-09-13T15:51:00.058322+0000","last_peered":"2024-09-13T15:51:00.058322+0000","last_clean":"2024-09-13T15:51:00.058322+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:51:00.058322+0000","last_undegraded":"2024-09-13T15:51:00.058322+0000","last_fullsized":"2024-09-13T15:51:00.058322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099890+0000","last_change":"2024-09-13T15:34:35.337361+0000","last_active":"2024-09-13T15:51:00.099890+0000","last_peered":"2024-09-13T15:51:00.099890+0000","last_clean":"2024-09-13T15:51:00.099890+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:51:00.099890+0000","last_undegraded":"2024-09-13T15:51:00.099890+0000","last_fullsized":"2024-09-13T15:51:00.099890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:27.081960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":59,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.057520+0000","last_change":"2024-09-13T15:34:34.942452+0000","last_active":"2024-09-13T15:51:00.057520+0000","last_peered":"2024-09-13T15:51:00.057520+0000","last_clean":"2024-09-13T15:51:00.057520+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:51:00.057520+0000","last_undegraded":"2024-09-13T15:51:00.057520+0000","last_fullsized":"2024-09-13T15:51:00.057520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.050628+0000","last_change":"2024-09-13T15:34:35.339676+0000","last_active":"2024-09-13T15:51:00.050628+0000","last_peered":"2024-09-13T15:51:00.050628+0000","last_clean":"2024-09-13T15:51:00.050628+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:51:00.050628+0000","last_undegraded":"2024-09-13T15:51:00.050628+0000","last_fullsized":"2024-09-13T15:51:00.050628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062116+0000","last_change":"2024-09-13T15:34:34.949805+0000","last_active":"2024-09-13T15:51:00.062116+0000","last_peered":"2024-09-13T15:51:00.062116+0000","last_clean":"2024-09-13T15:51:00.062116+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:51:00.062116+0000","last_undegraded":"2024-09-13T15:51:00.062116+0000","last_fullsized":"2024-09-13T15:51:00.062116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.097690+0000","last_change":"2024-09-13T15:34:35.335431+0000","last_active":"2024-09-13T15:51:00.097690+0000","last_peered":"2024-09-13T15:51:00.097690+0000","last_clean":"2024-09-13T15:51:00.097690+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:51:00.097690+0000","last_undegraded":"2024-09-13T15:51:00.097690+0000","last_fullsized":"2024-09-13T15:51:00.097690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:24.940353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.050410+0000","last_change":"2024-09-13T15:34:34.946174+0000","last_active":"2024-09-13T15:51:00.050410+0000","last_peered":"2024-09-13T15:51:00.050410+0000","last_clean":"2024-09-13T15:51:00.050410+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:51:00.050410+0000","last_undegraded":"2024-09-13T15:51:00.050410+0000","last_fullsized":"2024-09-13T15:51:00.050410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336516+0000","last_change":"2024-09-13T15:34:35.327755+0000","last_active":"2024-09-13T15:51:00.336516+0000","last_peered":"2024-09-13T15:51:00.336516+0000","last_clean":"2024-09-13T15:51:00.336516+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:51:00.336516+0000","last_undegraded":"2024-09-13T15:51:00.336516+0000","last_fullsized":"2024-09-13T15:51:00.336516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333413+0000","last_change":"2024-09-13T15:34:34.953984+0000","last_active":"2024-09-13T15:51:00.333413+0000","last_peered":"2024-09-13T15:51:00.333413+0000","last_clean":"2024-09-13T15:51:00.333413+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:51:00.333413+0000","last_undegraded":"2024-09-13T15:51:00.333413+0000","last_fullsized":"2024-09-13T15:51:00.333413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051639+0000","last_change":"2024-09-13T15:34:35.336428+0000","last_active":"2024-09-13T15:51:00.051639+0000","last_peered":"2024-09-13T15:51:00.051639+0000","last_clean":"2024-09-13T15:51:00.051639+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:51:00.051639+0000","last_undegraded":"2024-09-13T15:51:00.051639+0000","last_fullsized":"2024-09-13T15:51:00.051639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094577+0000","last_change":"2024-09-13T15:34:34.955761+0000","last_active":"2024-09-13T15:51:00.094577+0000","last_peered":"2024-09-13T15:51:00.094577+0000","last_clean":"2024-09-13T15:51:00.094577+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:51:00.094577+0000","last_undegraded":"2024-09-13T15:51:00.094577+0000","last_fullsized":"2024-09-13T15:51:00.094577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:37.814369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333727+0000","last_change":"2024-09-13T15:34:35.324328+0000","last_active":"2024-09-13T15:51:00.333727+0000","last_peered":"2024-09-13T15:51:00.333727+0000","last_clean":"2024-09-13T15:51:00.333727+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:51:00.333727+0000","last_undegraded":"2024-09-13T15:51:00.333727+0000","last_fullsized":"2024-09-13T15:51:00.333727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094121+0000","last_change":"2024-09-13T15:34:34.960919+0000","last_active":"2024-09-13T15:51:00.094121+0000","last_peered":"2024-09-13T15:51:00.094121+0000","last_clean":"2024-09-13T15:51:00.094121+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:51:00.094121+0000","last_undegraded":"2024-09-13T15:51:00.094121+0000","last_fullsized":"2024-09-13T15:51:00.094121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:47.211308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044732+0000","last_change":"2024-09-13T15:34:35.339727+0000","last_active":"2024-09-13T15:51:00.044732+0000","last_peered":"2024-09-13T15:51:00.044732+0000","last_clean":"2024-09-13T15:51:00.044732+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:51:00.044732+0000","last_undegraded":"2024-09-13T15:51:00.044732+0000","last_fullsized":"2024-09-13T15:51:00.044732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051805+0000","last_change":"2024-09-13T15:34:34.939804+0000","last_active":"2024-09-13T15:51:00.051805+0000","last_peered":"2024-09-13T15:51:00.051805+0000","last_clean":"2024-09-13T15:51:00.051805+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:51:00.051805+0000","last_undegraded":"2024-09-13T15:51:00.051805+0000","last_fullsized":"2024-09-13T15:51:00.051805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'108","reported_seq":228,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.047957+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:51:00.047957+0000","last_peered":"2024-09-13T15:51:00.047957+0000","last_clean":"2024-09-13T15:51:00.047957+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:51:00.047957+0000","last_undegraded":"2024-09-13T15:51:00.047957+0000","last_fullsized":"2024-09-13T15:51:00.047957+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:42.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062369+0000","last_change":"2024-09-13T15:34:35.333828+0000","last_active":"2024-09-13T15:51:00.062369+0000","last_peered":"2024-09-13T15:51:00.062369+0000","last_clean":"2024-09-13T15:51:00.062369+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:51:00.062369+0000","last_undegraded":"2024-09-13T15:51:00.062369+0000","last_fullsized":"2024-09-13T15:51:00.062369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095286+0000","last_change":"2024-09-13T15:34:34.956621+0000","last_active":"2024-09-13T15:51:00.095286+0000","last_peered":"2024-09-13T15:51:00.095286+0000","last_clean":"2024-09-13T15:51:00.095286+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:51:00.095286+0000","last_undegraded":"2024-09-13T15:51:00.095286+0000","last_fullsized":"2024-09-13T15:51:00.095286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336964+0000","last_change":"2024-09-13T15:34:35.330850+0000","last_active":"2024-09-13T15:51:00.336964+0000","last_peered":"2024-09-13T15:51:00.336964+0000","last_clean":"2024-09-13T15:51:00.336964+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:51:00.336964+0000","last_undegraded":"2024-09-13T15:51:00.336964+0000","last_fullsized":"2024-09-13T15:51:00.336964+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:53.423967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":59,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062130+0000","last_change":"2024-09-13T15:34:34.936361+0000","last_active":"2024-09-13T15:51:00.062130+0000","last_peered":"2024-09-13T15:51:00.062130+0000","last_clean":"2024-09-13T15:51:00.062130+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:51:00.062130+0000","last_undegraded":"2024-09-13T15:51:00.062130+0000","last_fullsized":"2024-09-13T15:51:00.062130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339823+0000","last_change":"2024-09-13T15:34:35.347478+0000","last_active":"2024-09-13T15:51:00.339823+0000","last_peered":"2024-09-13T15:51:00.339823+0000","last_clean":"2024-09-13T15:51:00.339823+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:51:00.339823+0000","last_undegraded":"2024-09-13T15:51:00.339823+0000","last_fullsized":"2024-09-13T15:51:00.339823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.481157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099045+0000","last_change":"2024-09-13T15:34:34.956480+0000","last_active":"2024-09-13T15:51:00.099045+0000","last_peered":"2024-09-13T15:51:00.099045+0000","last_clean":"2024-09-13T15:51:00.099045+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:51:00.099045+0000","last_undegraded":"2024-09-13T15:51:00.099045+0000","last_fullsized":"2024-09-13T15:51:00.099045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099265+0000","last_change":"2024-09-13T15:34:35.338609+0000","last_active":"2024-09-13T15:51:00.099265+0000","last_peered":"2024-09-13T15:51:00.099265+0000","last_clean":"2024-09-13T15:51:00.099265+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:51:00.099265+0000","last_undegraded":"2024-09-13T15:51:00.099265+0000","last_fullsized":"2024-09-13T15:51:00.099265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":60,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339396+0000","last_change":"2024-09-13T15:34:34.959935+0000","last_active":"2024-09-13T15:51:00.339396+0000","last_peered":"2024-09-13T15:51:00.339396+0000","last_clean":"2024-09-13T15:51:00.339396+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:51:00.339396+0000","last_undegraded":"2024-09-13T15:51:00.339396+0000","last_fullsized":"2024-09-13T15:51:00.339396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.342411+0000","last_change":"2024-09-13T15:34:35.335319+0000","last_active":"2024-09-13T15:51:02.342411+0000","last_peered":"2024-09-13T15:51:02.342411+0000","last_clean":"2024-09-13T15:51:02.342411+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:51:02.342411+0000","last_undegraded":"2024-09-13T15:51:02.342411+0000","last_fullsized":"2024-09-13T15:51:02.342411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":67,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094302+0000","last_change":"2024-09-13T15:34:34.959407+0000","last_active":"2024-09-13T15:51:00.094302+0000","last_peered":"2024-09-13T15:51:00.094302+0000","last_clean":"2024-09-13T15:51:00.094302+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:51:00.094302+0000","last_undegraded":"2024-09-13T15:51:00.094302+0000","last_fullsized":"2024-09-13T15:51:00.094302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:31.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.835106+0000","last_change":"2024-09-13T15:34:35.329165+0000","last_active":"2024-09-13T15:51:00.835106+0000","last_peered":"2024-09-13T15:51:00.835106+0000","last_clean":"2024-09-13T15:51:00.835106+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:51:00.835106+0000","last_undegraded":"2024-09-13T15:51:00.835106+0000","last_fullsized":"2024-09-13T15:51:00.835106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333066+0000","last_change":"2024-09-13T15:34:34.954181+0000","last_active":"2024-09-13T15:51:00.333066+0000","last_peered":"2024-09-13T15:51:00.333066+0000","last_clean":"2024-09-13T15:51:00.333066+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:51:00.333066+0000","last_undegraded":"2024-09-13T15:51:00.333066+0000","last_fullsized":"2024-09-13T15:51:00.333066+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.835603+0000","last_change":"2024-09-13T15:34:35.342732+0000","last_active":"2024-09-13T15:51:00.835603+0000","last_peered":"2024-09-13T15:51:00.835603+0000","last_clean":"2024-09-13T15:51:00.835603+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:51:00.835603+0000","last_undegraded":"2024-09-13T15:51:00.835603+0000","last_fullsized":"2024-09-13T15:51:00.835603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095713+0000","last_change":"2024-09-13T15:34:34.957763+0000","last_active":"2024-09-13T15:51:00.095713+0000","last_peered":"2024-09-13T15:51:00.095713+0000","last_clean":"2024-09-13T15:51:00.095713+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:51:00.095713+0000","last_undegraded":"2024-09-13T15:51:00.095713+0000","last_fullsized":"2024-09-13T15:51:00.095713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.105151+0000","last_change":"2024-09-13T15:34:35.334637+0000","last_active":"2024-09-13T15:51:02.105151+0000","last_peered":"2024-09-13T15:51:02.105151+0000","last_clean":"2024-09-13T15:51:02.105151+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:51:02.105151+0000","last_undegraded":"2024-09-13T15:51:02.105151+0000","last_fullsized":"2024-09-13T15:51:02.105151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:43.466895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.335970+0000","last_change":"2024-09-13T15:34:34.942058+0000","last_active":"2024-09-13T15:51:00.335970+0000","last_peered":"2024-09-13T15:51:00.335970+0000","last_clean":"2024-09-13T15:51:00.335970+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:51:00.335970+0000","last_undegraded":"2024-09-13T15:51:00.335970+0000","last_fullsized":"2024-09-13T15:51:00.335970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336293+0000","last_change":"2024-09-13T15:34:35.345452+0000","last_active":"2024-09-13T15:51:00.336293+0000","last_peered":"2024-09-13T15:51:00.336293+0000","last_clean":"2024-09-13T15:51:00.336293+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:51:00.336293+0000","last_undegraded":"2024-09-13T15:51:00.336293+0000","last_fullsized":"2024-09-13T15:51:00.336293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:08:25.983299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095566+0000","last_change":"2024-09-13T15:34:34.955883+0000","last_active":"2024-09-13T15:51:00.095566+0000","last_peered":"2024-09-13T15:51:00.095566+0000","last_clean":"2024-09-13T15:51:00.095566+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:51:00.095566+0000","last_undegraded":"2024-09-13T15:51:00.095566+0000","last_fullsized":"2024-09-13T15:51:00.095566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2638,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.837843+0000","last_change":"2024-09-13T15:34:35.341547+0000","last_active":"2024-09-13T15:51:00.837843+0000","last_peered":"2024-09-13T15:51:00.837843+0000","last_clean":"2024-09-13T15:51:00.837843+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:51:00.837843+0000","last_undegraded":"2024-09-13T15:51:00.837843+0000","last_fullsized":"2024-09-13T15:51:00.837843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062328+0000","last_change":"2024-09-13T15:34:34.949988+0000","last_active":"2024-09-13T15:51:00.062328+0000","last_peered":"2024-09-13T15:51:00.062328+0000","last_clean":"2024-09-13T15:51:00.062328+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:51:00.062328+0000","last_undegraded":"2024-09-13T15:51:00.062328+0000","last_fullsized":"2024-09-13T15:51:00.062328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339867+0000","last_change":"2024-09-13T15:34:35.347690+0000","last_active":"2024-09-13T15:51:00.339867+0000","last_peered":"2024-09-13T15:51:00.339867+0000","last_clean":"2024-09-13T15:51:00.339867+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:51:00.339867+0000","last_undegraded":"2024-09-13T15:51:00.339867+0000","last_fullsized":"2024-09-13T15:51:00.339867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:53.778485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336789+0000","last_change":"2024-09-13T15:34:34.953625+0000","last_active":"2024-09-13T15:51:00.336789+0000","last_peered":"2024-09-13T15:51:00.336789+0000","last_clean":"2024-09-13T15:51:00.336789+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:51:00.336789+0000","last_undegraded":"2024-09-13T15:51:00.336789+0000","last_fullsized":"2024-09-13T15:51:00.336789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099410+0000","last_change":"2024-09-13T15:34:35.338289+0000","last_active":"2024-09-13T15:51:00.099410+0000","last_peered":"2024-09-13T15:51:00.099410+0000","last_clean":"2024-09-13T15:51:00.099410+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:51:00.099410+0000","last_undegraded":"2024-09-13T15:51:00.099410+0000","last_fullsized":"2024-09-13T15:51:00.099410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:34.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.063208+0000","last_change":"2024-09-13T15:34:34.939305+0000","last_active":"2024-09-13T15:51:00.063208+0000","last_peered":"2024-09-13T15:51:00.063208+0000","last_clean":"2024-09-13T15:51:00.063208+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:51:00.063208+0000","last_undegraded":"2024-09-13T15:51:00.063208+0000","last_fullsized":"2024-09-13T15:51:00.063208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.050401+0000","last_change":"2024-09-13T15:34:35.335773+0000","last_active":"2024-09-13T15:51:00.050401+0000","last_peered":"2024-09-13T15:51:00.050401+0000","last_clean":"2024-09-13T15:51:00.050401+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:51:00.050401+0000","last_undegraded":"2024-09-13T15:51:00.050401+0000","last_fullsized":"2024-09-13T15:51:00.050401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.332732+0000","last_change":"2024-09-13T15:34:34.950709+0000","last_active":"2024-09-13T15:51:00.332732+0000","last_peered":"2024-09-13T15:51:00.332732+0000","last_clean":"2024-09-13T15:51:00.332732+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:51:00.332732+0000","last_undegraded":"2024-09-13T15:51:00.332732+0000","last_fullsized":"2024-09-13T15:51:00.332732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094585+0000","last_change":"2024-09-13T15:34:35.340304+0000","last_active":"2024-09-13T15:51:00.094585+0000","last_peered":"2024-09-13T15:51:00.094585+0000","last_clean":"2024-09-13T15:51:00.094585+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:51:00.094585+0000","last_undegraded":"2024-09-13T15:51:00.094585+0000","last_fullsized":"2024-09-13T15:51:00.094585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333255+0000","last_change":"2024-09-13T15:34:34.954475+0000","last_active":"2024-09-13T15:51:00.333255+0000","last_peered":"2024-09-13T15:51:00.333255+0000","last_clean":"2024-09-13T15:51:00.333255+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:51:00.333255+0000","last_undegraded":"2024-09-13T15:51:00.333255+0000","last_fullsized":"2024-09-13T15:51:00.333255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095814+0000","last_change":"2024-09-13T15:34:34.957379+0000","last_active":"2024-09-13T15:51:00.095814+0000","last_peered":"2024-09-13T15:51:00.095814+0000","last_clean":"2024-09-13T15:51:00.095814+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:51:00.095814+0000","last_undegraded":"2024-09-13T15:51:00.095814+0000","last_fullsized":"2024-09-13T15:51:00.095814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336793+0000","last_change":"2024-09-13T15:34:35.331843+0000","last_active":"2024-09-13T15:51:00.336793+0000","last_peered":"2024-09-13T15:51:00.336793+0000","last_clean":"2024-09-13T15:51:00.336793+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:51:00.336793+0000","last_undegraded":"2024-09-13T15:51:00.336793+0000","last_fullsized":"2024-09-13T15:51:00.336793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:43.103418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051973+0000","last_change":"2024-09-13T15:34:34.944458+0000","last_active":"2024-09-13T15:51:00.051973+0000","last_peered":"2024-09-13T15:51:00.051973+0000","last_clean":"2024-09-13T15:51:00.051973+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:51:00.051973+0000","last_undegraded":"2024-09-13T15:51:00.051973+0000","last_fullsized":"2024-09-13T15:51:00.051973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044815+0000","last_change":"2024-09-13T15:34:35.343571+0000","last_active":"2024-09-13T15:51:00.044815+0000","last_peered":"2024-09-13T15:51:00.044815+0000","last_clean":"2024-09-13T15:51:00.044815+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:51:00.044815+0000","last_undegraded":"2024-09-13T15:51:00.044815+0000","last_fullsized":"2024-09-13T15:51:00.044815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.096135+0000","last_change":"2024-09-13T15:34:35.331904+0000","last_active":"2024-09-13T15:51:00.096135+0000","last_peered":"2024-09-13T15:51:00.096135+0000","last_clean":"2024-09-13T15:51:00.096135+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:51:00.096135+0000","last_undegraded":"2024-09-13T15:51:00.096135+0000","last_fullsized":"2024-09-13T15:51:00.096135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094949+0000","last_change":"2024-09-13T15:34:35.335517+0000","last_active":"2024-09-13T15:51:00.094949+0000","last_peered":"2024-09-13T15:51:00.094949+0000","last_clean":"2024-09-13T15:51:00.094949+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:51:00.094949+0000","last_undegraded":"2024-09-13T15:51:00.094949+0000","last_fullsized":"2024-09-13T15:51:00.094949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:58.399592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334061+0000","last_change":"2024-09-13T15:34:35.324690+0000","last_active":"2024-09-13T15:51:00.334061+0000","last_peered":"2024-09-13T15:51:00.334061+0000","last_clean":"2024-09-13T15:51:00.334061+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:51:00.334061+0000","last_undegraded":"2024-09-13T15:51:00.334061+0000","last_fullsized":"2024-09-13T15:51:00.334061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336765+0000","last_change":"2024-09-13T15:34:35.331611+0000","last_active":"2024-09-13T15:51:00.336765+0000","last_peered":"2024-09-13T15:51:00.336765+0000","last_clean":"2024-09-13T15:51:00.336765+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:51:00.336765+0000","last_undegraded":"2024-09-13T15:51:00.336765+0000","last_fullsized":"2024-09-13T15:51:00.336765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:08.881292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.048264+0000","last_change":"2024-09-13T15:35:20.157986+0000","last_active":"2024-09-13T15:51:00.048264+0000","last_peered":"2024-09-13T15:51:00.048264+0000","last_clean":"2024-09-13T15:51:00.048264+0000","last_became_active":"2024-09-13T15:35:20.157317+0000","last_became_peered":"2024-09-13T15:35:20.157317+0000","last_unstale":"2024-09-13T15:51:00.048264+0000","last_undegraded":"2024-09-13T15:51:00.048264+0000","last_fullsized":"2024-09-13T15:51:00.048264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:21.036558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062666+0000","last_change":"2024-09-13T15:34:35.339305+0000","last_active":"2024-09-13T15:51:00.062666+0000","last_peered":"2024-09-13T15:51:00.062666+0000","last_clean":"2024-09-13T15:51:00.062666+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:51:00.062666+0000","last_undegraded":"2024-09-13T15:51:00.062666+0000","last_fullsized":"2024-09-13T15:51:00.062666+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099626+0000","last_change":"2024-09-13T15:34:35.335209+0000","last_active":"2024-09-13T15:51:00.099626+0000","last_peered":"2024-09-13T15:51:00.099626+0000","last_clean":"2024-09-13T15:51:00.099626+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:51:00.099626+0000","last_undegraded":"2024-09-13T15:51:00.099626+0000","last_fullsized":"2024-09-13T15:51:00.099626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099756+0000","last_change":"2024-09-13T15:34:35.336949+0000","last_active":"2024-09-13T15:51:00.099756+0000","last_peered":"2024-09-13T15:51:00.099756+0000","last_clean":"2024-09-13T15:51:00.099756+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:51:00.099756+0000","last_undegraded":"2024-09-13T15:51:00.099756+0000","last_fullsized":"2024-09-13T15:51:00.099756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:45.530761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.332962+0000","last_change":"2024-09-13T15:34:35.327879+0000","last_active":"2024-09-13T15:51:00.332962+0000","last_peered":"2024-09-13T15:51:00.332962+0000","last_clean":"2024-09-13T15:51:00.332962+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:51:00.332962+0000","last_undegraded":"2024-09-13T15:51:00.332962+0000","last_fullsized":"2024-09-13T15:51:00.332962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334238+0000","last_change":"2024-09-13T15:34:35.324523+0000","last_active":"2024-09-13T15:51:00.334238+0000","last_peered":"2024-09-13T15:51:00.334238+0000","last_clean":"2024-09-13T15:51:00.334238+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:51:00.334238+0000","last_undegraded":"2024-09-13T15:51:00.334238+0000","last_fullsized":"2024-09-13T15:51:00.334238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044962+0000","last_change":"2024-09-13T15:34:35.329712+0000","last_active":"2024-09-13T15:51:00.044962+0000","last_peered":"2024-09-13T15:51:00.044962+0000","last_clean":"2024-09-13T15:51:00.044962+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:51:00.044962+0000","last_undegraded":"2024-09-13T15:51:00.044962+0000","last_fullsized":"2024-09-13T15:51:00.044962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051700+0000","last_change":"2024-09-13T15:35:20.156675+0000","last_active":"2024-09-13T15:51:00.051700+0000","last_peered":"2024-09-13T15:51:00.051700+0000","last_clean":"2024-09-13T15:51:00.051700+0000","last_became_active":"2024-09-13T15:35:20.152889+0000","last_became_peered":"2024-09-13T15:35:20.152889+0000","last_unstale":"2024-09-13T15:51:00.051700+0000","last_undegraded":"2024-09-13T15:51:00.051700+0000","last_fullsized":"2024-09-13T15:51:00.051700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:12.515681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.338254+0000","last_change":"2024-09-13T15:34:35.346893+0000","last_active":"2024-09-13T15:51:00.338254+0000","last_peered":"2024-09-13T15:51:00.338254+0000","last_clean":"2024-09-13T15:51:00.338254+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:51:00.338254+0000","last_undegraded":"2024-09-13T15:51:00.338254+0000","last_fullsized":"2024-09-13T15:51:00.338254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:52.439034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336587+0000","last_change":"2024-09-13T15:34:35.324912+0000","last_active":"2024-09-13T15:51:00.336587+0000","last_peered":"2024-09-13T15:51:00.336587+0000","last_clean":"2024-09-13T15:51:00.336587+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:51:00.336587+0000","last_undegraded":"2024-09-13T15:51:00.336587+0000","last_fullsized":"2024-09-13T15:51:00.336587+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.352332+0000","last_change":"2024-09-13T15:34:35.335384+0000","last_active":"2024-09-13T15:51:02.352332+0000","last_peered":"2024-09-13T15:51:02.352332+0000","last_clean":"2024-09-13T15:51:02.352332+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:51:02.352332+0000","last_undegraded":"2024-09-13T15:51:02.352332+0000","last_fullsized":"2024-09-13T15:51:02.352332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.841051+0000","last_change":"2024-09-13T15:34:35.333522+0000","last_active":"2024-09-13T15:51:00.841051+0000","last_peered":"2024-09-13T15:51:00.841051+0000","last_clean":"2024-09-13T15:51:00.841051+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:51:00.841051+0000","last_undegraded":"2024-09-13T15:51:00.841051+0000","last_fullsized":"2024-09-13T15:51:00.841051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.342895+0000","last_change":"2024-09-13T15:34:35.331848+0000","last_active":"2024-09-13T15:51:02.342895+0000","last_peered":"2024-09-13T15:51:02.342895+0000","last_clean":"2024-09-13T15:51:02.342895+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:51:02.342895+0000","last_undegraded":"2024-09-13T15:51:02.342895+0000","last_fullsized":"2024-09-13T15:51:02.342895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.834589+0000","last_change":"2024-09-13T15:34:35.333765+0000","last_active":"2024-09-13T15:51:00.834589+0000","last_peered":"2024-09-13T15:51:00.834589+0000","last_clean":"2024-09-13T15:51:00.834589+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:51:00.834589+0000","last_undegraded":"2024-09-13T15:51:00.834589+0000","last_fullsized":"2024-09-13T15:51:00.834589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.108861+0000","last_change":"2024-09-13T15:34:35.335599+0000","last_active":"2024-09-13T15:51:02.108861+0000","last_peered":"2024-09-13T15:51:02.108861+0000","last_clean":"2024-09-13T15:51:02.108861+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:51:02.108861+0000","last_undegraded":"2024-09-13T15:51:02.108861+0000","last_fullsized":"2024-09-13T15:51:02.108861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:06.605564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.335794+0000","last_change":"2024-09-13T15:34:35.335252+0000","last_active":"2024-09-13T15:51:00.335794+0000","last_peered":"2024-09-13T15:51:00.335794+0000","last_clean":"2024-09-13T15:51:00.335794+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:51:00.335794+0000","last_undegraded":"2024-09-13T15:51:00.335794+0000","last_fullsized":"2024-09-13T15:51:00.335794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:37.432254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.338693+0000","last_change":"2024-09-13T15:34:35.330875+0000","last_active":"2024-09-13T15:51:00.338693+0000","last_peered":"2024-09-13T15:51:00.338693+0000","last_clean":"2024-09-13T15:51:00.338693+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:51:00.338693+0000","last_undegraded":"2024-09-13T15:51:00.338693+0000","last_fullsized":"2024-09-13T15:51:00.338693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:22.297990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336857+0000","last_change":"2024-09-13T15:34:35.331709+0000","last_active":"2024-09-13T15:51:00.336857+0000","last_peered":"2024-09-13T15:51:00.336857+0000","last_clean":"2024-09-13T15:51:00.336857+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:51:00.336857+0000","last_undegraded":"2024-09-13T15:51:00.336857+0000","last_fullsized":"2024-09-13T15:51:00.336857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:17.069173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.338009+0000","last_change":"2024-09-13T15:34:35.319299+0000","last_active":"2024-09-13T15:51:00.338009+0000","last_peered":"2024-09-13T15:51:00.338009+0000","last_clean":"2024-09-13T15:51:00.338009+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:51:00.338009+0000","last_undegraded":"2024-09-13T15:51:00.338009+0000","last_fullsized":"2024-09-13T15:51:00.338009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:16.700428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.069443+0000","last_change":"2024-09-13T15:34:35.345251+0000","last_active":"2024-09-13T15:51:00.069443+0000","last_peered":"2024-09-13T15:51:00.069443+0000","last_clean":"2024-09-13T15:51:00.069443+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:51:00.069443+0000","last_undegraded":"2024-09-13T15:51:00.069443+0000","last_fullsized":"2024-09-13T15:51:00.069443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095085+0000","last_change":"2024-09-13T15:34:35.335400+0000","last_active":"2024-09-13T15:51:00.095085+0000","last_peered":"2024-09-13T15:51:00.095085+0000","last_clean":"2024-09-13T15:51:00.095085+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:51:00.095085+0000","last_undegraded":"2024-09-13T15:51:00.095085+0000","last_fullsized":"2024-09-13T15:51:00.095085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334006+0000","last_change":"2024-09-13T15:34:35.334719+0000","last_active":"2024-09-13T15:51:00.334006+0000","last_peered":"2024-09-13T15:51:00.334006+0000","last_clean":"2024-09-13T15:51:00.334006+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:51:00.334006+0000","last_undegraded":"2024-09-13T15:51:00.334006+0000","last_fullsized":"2024-09-13T15:51:00.334006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:14.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095974+0000","last_change":"2024-09-13T15:34:35.329319+0000","last_active":"2024-09-13T15:51:00.095974+0000","last_peered":"2024-09-13T15:51:00.095974+0000","last_clean":"2024-09-13T15:51:00.095974+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:51:00.095974+0000","last_undegraded":"2024-09-13T15:51:00.095974+0000","last_fullsized":"2024-09-13T15:51:00.095974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336154+0000","last_change":"2024-09-13T15:34:35.327922+0000","last_active":"2024-09-13T15:51:00.336154+0000","last_peered":"2024-09-13T15:51:00.336154+0000","last_clean":"2024-09-13T15:51:00.336154+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:51:00.336154+0000","last_undegraded":"2024-09-13T15:51:00.336154+0000","last_fullsized":"2024-09-13T15:51:00.336154+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:22.066293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095681+0000","last_change":"2024-09-13T15:34:35.330864+0000","last_active":"2024-09-13T15:51:00.095681+0000","last_peered":"2024-09-13T15:51:00.095681+0000","last_clean":"2024-09-13T15:51:00.095681+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:51:00.095681+0000","last_undegraded":"2024-09-13T15:51:00.095681+0000","last_fullsized":"2024-09-13T15:51:00.095681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336165+0000","last_change":"2024-09-13T15:34:35.324580+0000","last_active":"2024-09-13T15:51:00.336165+0000","last_peered":"2024-09-13T15:51:00.336165+0000","last_clean":"2024-09-13T15:51:00.336165+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:51:00.336165+0000","last_undegraded":"2024-09-13T15:51:00.336165+0000","last_fullsized":"2024-09-13T15:51:00.336165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:08.082085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.058052+0000","last_change":"2024-09-13T15:34:35.329279+0000","last_active":"2024-09-13T15:51:00.058052+0000","last_peered":"2024-09-13T15:51:00.058052+0000","last_clean":"2024-09-13T15:51:00.058052+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:51:00.058052+0000","last_undegraded":"2024-09-13T15:51:00.058052+0000","last_fullsized":"2024-09-13T15:51:00.058052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.340148+0000","last_change":"2024-09-13T15:34:35.347293+0000","last_active":"2024-09-13T15:51:00.340148+0000","last_peered":"2024-09-13T15:51:00.340148+0000","last_clean":"2024-09-13T15:51:00.340148+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:51:00.340148+0000","last_undegraded":"2024-09-13T15:51:00.340148+0000","last_fullsized":"2024-09-13T15:51:00.340148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:52.388403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3436,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738571,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148124,"kb_used_data":48912,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94223716,"statfs":{"total":96636764160,"available":96485085184,"internally_reserved":0,"allocated":50085888,"data_stored":38240820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.42999999999999999},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.152},"max":{"1min":0.65600000000000003,"5min":0.83899999999999997,"15min":3.4550000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.46300000000000002},"min":{"1min":0.32300000000000001,"5min":0.248,"15min":0.18099999999999999},"max":{"1min":0.76900000000000002,"5min":0.97499999999999998,"15min":6.1989999999999998},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53600000000000003,"15min":0.46300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.185},"max":{"1min":0.82699999999999996,"5min":1.006,"15min":1.4790000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.495},"min":{"1min":0.31,"5min":0.30299999999999999,"15min":0.17799999999999999},"max":{"1min":0.73199999999999998,"5min":1.0589999999999999,"15min":1.399},"last":0.58399999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738570,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335876,"kb_used_data":188272,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":94035964,"statfs":{"total":96636764160,"available":96292827136,"internally_reserved":0,"allocated":192790528,"data_stored":179551003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45600000000000002,"15min":0.41599999999999998},"min":{"1min":0.26900000000000002,"5min":0.214,"15min":0.159},"max":{"1min":0.64700000000000002,"5min":0.69599999999999995,"15min":4.2400000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.432},"min":{"1min":0.33900000000000002,"5min":0.20399999999999999,"15min":0.17100000000000001},"max":{"1min":0.70399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.443},"min":{"1min":0.42099999999999999,"5min":0.26400000000000001,"15min":0.17199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.82999999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57299999999999995,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.253,"15min":0.189},"max":{"1min":0.86099999999999999,"5min":0.93000000000000005,"15min":1.2789999999999999},"last":0.86099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738572,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187712,"kb_used_data":30260,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94184128,"statfs":{"total":96636764160,"available":96444547072,"internally_reserved":0,"allocated":30986240,"data_stored":20392376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":161216966},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47899999999999998,"15min":0.40799999999999997},"min":{"1min":0.28399999999999997,"5min":0.20399999999999999,"15min":0.158},"max":{"1min":0.755,"5min":0.80900000000000005,"15min":0.873},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.42699999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.186},"max":{"1min":0.68200000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53700000000000003,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.17899999999999999},"max":{"1min":0.77400000000000002,"5min":0.82099999999999995,"15min":9.4610000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.48599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.20300000000000001},"max":{"1min":0.67700000000000005,"5min":0.84899999999999998,"15min":0.90700000000000003},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:51:03.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:51:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.708+0000 7f385d00c640 1 Processor -- start 2024-09-13T15:51:03.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.708+0000 7f385d00c640 1 -- start start 2024-09-13T15:51:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.708+0000 7f385d00c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38580bebb0 0x7f38580a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.708+0000 7f385d00c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38581515b0 con 0x7f38580b4010 2024-09-13T15:51:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.708+0000 7f385d00c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385814e2c0 con 0x7f38580bebb0 2024-09-13T15:51:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.708+0000 7f3856d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38580bebb0 0x7f38580a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.708+0000 7f385659c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f38580b4010 0x7f385806e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49558/0 (socket says 172.21.15.40:49558) 2024-09-13T15:51:03.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.708+0000 7f385659c640 1 -- 172.21.15.40:0/3721163383 learned_addr learned my addr 172.21.15.40:0/3721163383 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:51:03.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.708+0000 7f3855d9b640 1 -- 172.21.15.40:0/3721163383 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302038020 0 0) 0x7f38581515b0 con 0x7f38580b4010 2024-09-13T15:51:03.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.708+0000 7f3855d9b640 1 -- 172.21.15.40:0/3721163383 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3840003530 con 0x7f38580b4010 2024-09-13T15:51:03.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.708+0000 7f3856d9d640 1 -- 172.21.15.40:0/3721163383 >> v1:172.21.15.40:6789/0 conn(0x7f38580b4010 legacy=0x7f385806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:03.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.708+0000 7f3856d9d640 1 -- 172.21.15.40:0/3721163383 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385806f830 con 0x7f38580bebb0 2024-09-13T15:51:03.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.712+0000 7f3856d9d640 1 --2- 172.21.15.40:0/3721163383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38580bebb0 0x7f38580a4d70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3848009740 tx=0x7f384801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1499361260ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:03.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.712+0000 7f3855d9b640 1 -- 172.21.15.40:0/3721163383 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38580b6bc0 con 0x7f38580bebb0 2024-09-13T15:51:03.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.712+0000 7f3855d9b640 1 -- 172.21.15.40:0/3721163383 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38480a7050 con 0x7f38580bebb0 2024-09-13T15:51:03.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.712+0000 7f3855d9b640 1 -- 172.21.15.40:0/3721163383 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38480ab680 con 0x7f38580bebb0 2024-09-13T15:51:03.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.712+0000 7f385d00c640 1 -- 172.21.15.40:0/3721163383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38580bebb0 msgr2=0x7f38580a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:03.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.712+0000 7f385d00c640 1 --2- 172.21.15.40:0/3721163383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38580bebb0 0x7f38580a4d70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3848009740 tx=0x7f384801c420 comp rx=0 tx=0).stop 2024-09-13T15:51:03.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.712+0000 7f385d00c640 1 -- 172.21.15.40:0/3721163383 shutdown_connections 2024-09-13T15:51:03.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.712+0000 7f385d00c640 1 --2- 172.21.15.40:0/3721163383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38580bebb0 0x7f38580a4d70 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:03.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.712+0000 7f385d00c640 1 -- 172.21.15.40:0/3721163383 >> 172.21.15.40:0/3721163383 conn(0x7f385806a540 msgr2=0x7f38580a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:03.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.712+0000 7f385d00c640 1 -- 172.21.15.40:0/3721163383 shutdown_connections 2024-09-13T15:51:03.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.712+0000 7f385d00c640 1 -- 172.21.15.40:0/3721163383 wait complete. 2024-09-13T15:51:03.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f385d00c640 1 Processor -- start 2024-09-13T15:51:03.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f385d00c640 1 -- start start 2024-09-13T15:51:03.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f385d00c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38580b4010 0x7f385813eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:03.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f385d00c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385814b550 con 0x7f38580b4010 2024-09-13T15:51:03.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f3856d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38580b4010 0x7f385813eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:03.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f3856d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38580b4010 0x7f385813eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53376/0 (socket says 172.21.15.40:53376) 2024-09-13T15:51:03.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f3856d9d640 1 -- 172.21.15.40:0/3522767150 learned_addr learned my addr 172.21.15.40:0/3522767150 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:03.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f3856d9d640 1 -- 172.21.15.40:0/3522767150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3848009420 con 0x7f38580b4010 2024-09-13T15:51:03.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f3856d9d640 1 --2- 172.21.15.40:0/3522767150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38580b4010 0x7f385813eae0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f38480ae040 tx=0x7f38480191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:03.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f383f7fe640 1 -- 172.21.15.40:0/3522767150 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38480b4540 con 0x7f38580b4010 2024-09-13T15:51:03.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f383f7fe640 1 -- 172.21.15.40:0/3522767150 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38480b46a0 con 0x7f38580b4010 2024-09-13T15:51:03.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f383f7fe640 1 -- 172.21.15.40:0/3522767150 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38480b4960 con 0x7f38580b4010 2024-09-13T15:51:03.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f385d00c640 1 -- 172.21.15.40:0/3522767150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385813f020 con 0x7f38580b4010 2024-09-13T15:51:03.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f385d00c640 1 -- 172.21.15.40:0/3522767150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38580719b0 con 0x7f38580b4010 2024-09-13T15:51:03.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f383f7fe640 1 -- 172.21.15.40:0/3522767150 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f38480b2040 con 0x7f38580b4010 2024-09-13T15:51:03.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f385d00c640 1 -- 172.21.15.40:0/3522767150 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38580a4d70 con 0x7f38580b4010 2024-09-13T15:51:03.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f383f7fe640 1 --2- 172.21.15.40:0/3522767150 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3844035530 0x7f38440379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:03.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f383f7fe640 1 -- 172.21.15.40:0/3522767150 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f38480e2270 con 0x7f38580b4010 2024-09-13T15:51:03.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.716+0000 7f385659c640 1 --2- 172.21.15.40:0/3522767150 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3844035530 0x7f38440379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:03.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.720+0000 7f385659c640 1 --2- 172.21.15.40:0/3522767150 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3844035530 0x7f38440379f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f384c007fd0 tx=0x7f384c007980 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:03.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.724+0000 7f383f7fe640 1 -- 172.21.15.40:0/3522767150 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f38480b4e40 con 0x7f38580b4010 2024-09-13T15:51:03.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.908+0000 7f385d00c640 1 -- 172.21.15.40:0/3522767150 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3858071c00 con 0x7f3844035530 2024-09-13T15:51:03.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.924+0000 7f383f7fe640 1 -- 172.21.15.40:0/3522767150 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249952 (secure 0 0 0) 0x7f3858071c00 con 0x7f3844035530 2024-09-13T15:51:03.931 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:51:03.933 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:51:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.928+0000 7f385d00c640 1 -- 172.21.15.40:0/3522767150 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3844035530 msgr2=0x7f38440379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.928+0000 7f385d00c640 1 --2- 172.21.15.40:0/3522767150 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3844035530 0x7f38440379f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f384c007fd0 tx=0x7f384c007980 comp rx=0 tx=0).stop 2024-09-13T15:51:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.928+0000 7f385d00c640 1 -- 172.21.15.40:0/3522767150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38580b4010 msgr2=0x7f385813eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.928+0000 7f385d00c640 1 --2- 172.21.15.40:0/3522767150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38580b4010 0x7f385813eae0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f38480ae040 tx=0x7f38480191c0 comp rx=0 tx=0).stop 2024-09-13T15:51:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.928+0000 7f385d00c640 1 -- 172.21.15.40:0/3522767150 shutdown_connections 2024-09-13T15:51:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.928+0000 7f385d00c640 1 --2- 172.21.15.40:0/3522767150 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3844035530 0x7f38440379f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.928+0000 7f385d00c640 1 --2- 172.21.15.40:0/3522767150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f38580b4010 0x7f385813eae0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.928+0000 7f385d00c640 1 -- 172.21.15.40:0/3522767150 >> 172.21.15.40:0/3522767150 conn(0x7f385806a540 msgr2=0x7f385806fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.928+0000 7f385d00c640 1 -- 172.21.15.40:0/3522767150 shutdown_connections 2024-09-13T15:51:03.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:03.928+0000 7f385d00c640 1 -- 172.21.15.40:0/3522767150 wait complete. 2024-09-13T15:51:03.951 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":455,"stamp":"2024-09-13T15:51:03.847228+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593804,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":208,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":368,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":671712,"kb_used_data":267444,"kb_used_omap":4,"kb_used_meta":404219,"kb_avail":282443808,"statfs":{"total":289910292480,"available":289222459392,"internally_reserved":0,"allocated":273862656,"data_stored":238184199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":413920594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-261536172,"num_objects":-4670,"num_object_clones":-60,"num_object_copies":-9340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4670,"num_whiteouts":0,"num_read":-18696,"num_read_kb":-170253,"num_write":-15658,"num_write_kb":-264556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.178937"},"pg_stats":[{"pgid":"2.1f","version":"15'4","reported_seq":63,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339591+0000","last_change":"2024-09-13T15:34:34.960705+0000","last_active":"2024-09-13T15:51:00.339591+0000","last_peered":"2024-09-13T15:51:00.339591+0000","last_clean":"2024-09-13T15:51:00.339591+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:51:00.339591+0000","last_undegraded":"2024-09-13T15:51:00.339591+0000","last_fullsized":"2024-09-13T15:51:00.339591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099521+0000","last_change":"2024-09-13T15:34:35.338454+0000","last_active":"2024-09-13T15:51:00.099521+0000","last_peered":"2024-09-13T15:51:00.099521+0000","last_clean":"2024-09-13T15:51:00.099521+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:51:00.099521+0000","last_undegraded":"2024-09-13T15:51:00.099521+0000","last_fullsized":"2024-09-13T15:51:00.099521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:49.904225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099261+0000","last_change":"2024-09-13T15:34:34.955842+0000","last_active":"2024-09-13T15:51:00.099261+0000","last_peered":"2024-09-13T15:51:00.099261+0000","last_clean":"2024-09-13T15:51:00.099261+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:51:00.099261+0000","last_undegraded":"2024-09-13T15:51:00.099261+0000","last_fullsized":"2024-09-13T15:51:00.099261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.340160+0000","last_change":"2024-09-13T15:34:35.350474+0000","last_active":"2024-09-13T15:51:00.340160+0000","last_peered":"2024-09-13T15:51:00.340160+0000","last_clean":"2024-09-13T15:51:00.340160+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:51:00.340160+0000","last_undegraded":"2024-09-13T15:51:00.340160+0000","last_fullsized":"2024-09-13T15:51:00.340160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:08:45.573183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":60,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.335889+0000","last_change":"2024-09-13T15:34:34.950125+0000","last_active":"2024-09-13T15:51:00.335889+0000","last_peered":"2024-09-13T15:51:00.335889+0000","last_clean":"2024-09-13T15:51:00.335889+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:51:00.335889+0000","last_undegraded":"2024-09-13T15:51:00.335889+0000","last_fullsized":"2024-09-13T15:51:00.335889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051068+0000","last_change":"2024-09-13T15:34:35.333710+0000","last_active":"2024-09-13T15:51:00.051068+0000","last_peered":"2024-09-13T15:51:00.051068+0000","last_clean":"2024-09-13T15:51:00.051068+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:51:00.051068+0000","last_undegraded":"2024-09-13T15:51:00.051068+0000","last_fullsized":"2024-09-13T15:51:00.051068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095970+0000","last_change":"2024-09-13T15:35:20.173539+0000","last_active":"2024-09-13T15:51:00.095970+0000","last_peered":"2024-09-13T15:51:00.095970+0000","last_clean":"2024-09-13T15:51:00.095970+0000","last_became_active":"2024-09-13T15:35:20.165658+0000","last_became_peered":"2024-09-13T15:35:20.165658+0000","last_unstale":"2024-09-13T15:51:00.095970+0000","last_undegraded":"2024-09-13T15:51:00.095970+0000","last_fullsized":"2024-09-13T15:51:00.095970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:35.807536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.097424+0000","last_change":"2024-09-13T15:34:35.329220+0000","last_active":"2024-09-13T15:51:00.097424+0000","last_peered":"2024-09-13T15:51:00.097424+0000","last_clean":"2024-09-13T15:51:00.097424+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:51:00.097424+0000","last_undegraded":"2024-09-13T15:51:00.097424+0000","last_fullsized":"2024-09-13T15:51:00.097424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334413+0000","last_change":"2024-09-13T15:34:35.334308+0000","last_active":"2024-09-13T15:51:00.334413+0000","last_peered":"2024-09-13T15:51:00.334413+0000","last_clean":"2024-09-13T15:51:00.334413+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:51:00.334413+0000","last_undegraded":"2024-09-13T15:51:00.334413+0000","last_fullsized":"2024-09-13T15:51:00.334413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:50.918862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334863+0000","last_change":"2024-09-13T15:34:34.943033+0000","last_active":"2024-09-13T15:51:00.334863+0000","last_peered":"2024-09-13T15:51:00.334863+0000","last_clean":"2024-09-13T15:51:00.334863+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:51:00.334863+0000","last_undegraded":"2024-09-13T15:51:00.334863+0000","last_fullsized":"2024-09-13T15:51:00.334863+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.052739+0000","last_change":"2024-09-13T15:34:35.339704+0000","last_active":"2024-09-13T15:51:00.052739+0000","last_peered":"2024-09-13T15:51:00.052739+0000","last_clean":"2024-09-13T15:51:00.052739+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:51:00.052739+0000","last_undegraded":"2024-09-13T15:51:00.052739+0000","last_fullsized":"2024-09-13T15:51:00.052739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044596+0000","last_change":"2024-09-13T15:34:34.943732+0000","last_active":"2024-09-13T15:51:00.044596+0000","last_peered":"2024-09-13T15:51:00.044596+0000","last_clean":"2024-09-13T15:51:00.044596+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:51:00.044596+0000","last_undegraded":"2024-09-13T15:51:00.044596+0000","last_fullsized":"2024-09-13T15:51:00.044596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094473+0000","last_change":"2024-09-13T15:34:35.340037+0000","last_active":"2024-09-13T15:51:00.094473+0000","last_peered":"2024-09-13T15:51:00.094473+0000","last_clean":"2024-09-13T15:51:00.094473+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:51:00.094473+0000","last_undegraded":"2024-09-13T15:51:00.094473+0000","last_fullsized":"2024-09-13T15:51:00.094473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.048410+0000","last_change":"2024-09-13T15:34:34.943197+0000","last_active":"2024-09-13T15:51:00.048410+0000","last_peered":"2024-09-13T15:51:00.048410+0000","last_clean":"2024-09-13T15:51:00.048410+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:51:00.048410+0000","last_undegraded":"2024-09-13T15:51:00.048410+0000","last_fullsized":"2024-09-13T15:51:00.048410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333855+0000","last_change":"2024-09-13T15:34:35.327260+0000","last_active":"2024-09-13T15:51:00.333855+0000","last_peered":"2024-09-13T15:51:00.333855+0000","last_clean":"2024-09-13T15:51:00.333855+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:51:00.333855+0000","last_undegraded":"2024-09-13T15:51:00.333855+0000","last_fullsized":"2024-09-13T15:51:00.333855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.332568+0000","last_change":"2024-09-13T15:34:34.941308+0000","last_active":"2024-09-13T15:51:00.332568+0000","last_peered":"2024-09-13T15:51:00.332568+0000","last_clean":"2024-09-13T15:51:00.332568+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:51:00.332568+0000","last_undegraded":"2024-09-13T15:51:00.332568+0000","last_fullsized":"2024-09-13T15:51:00.332568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.337585+0000","last_change":"2024-09-13T15:34:35.334433+0000","last_active":"2024-09-13T15:51:00.337585+0000","last_peered":"2024-09-13T15:51:00.337585+0000","last_clean":"2024-09-13T15:51:00.337585+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:51:00.337585+0000","last_undegraded":"2024-09-13T15:51:00.337585+0000","last_fullsized":"2024-09-13T15:51:00.337585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:34.847820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.058322+0000","last_change":"2024-09-13T15:34:34.946540+0000","last_active":"2024-09-13T15:51:00.058322+0000","last_peered":"2024-09-13T15:51:00.058322+0000","last_clean":"2024-09-13T15:51:00.058322+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:51:00.058322+0000","last_undegraded":"2024-09-13T15:51:00.058322+0000","last_fullsized":"2024-09-13T15:51:00.058322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099890+0000","last_change":"2024-09-13T15:34:35.337361+0000","last_active":"2024-09-13T15:51:00.099890+0000","last_peered":"2024-09-13T15:51:00.099890+0000","last_clean":"2024-09-13T15:51:00.099890+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:51:00.099890+0000","last_undegraded":"2024-09-13T15:51:00.099890+0000","last_fullsized":"2024-09-13T15:51:00.099890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:27.081960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":59,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.057520+0000","last_change":"2024-09-13T15:34:34.942452+0000","last_active":"2024-09-13T15:51:00.057520+0000","last_peered":"2024-09-13T15:51:00.057520+0000","last_clean":"2024-09-13T15:51:00.057520+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:51:00.057520+0000","last_undegraded":"2024-09-13T15:51:00.057520+0000","last_fullsized":"2024-09-13T15:51:00.057520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.050628+0000","last_change":"2024-09-13T15:34:35.339676+0000","last_active":"2024-09-13T15:51:00.050628+0000","last_peered":"2024-09-13T15:51:00.050628+0000","last_clean":"2024-09-13T15:51:00.050628+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:51:00.050628+0000","last_undegraded":"2024-09-13T15:51:00.050628+0000","last_fullsized":"2024-09-13T15:51:00.050628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062116+0000","last_change":"2024-09-13T15:34:34.949805+0000","last_active":"2024-09-13T15:51:00.062116+0000","last_peered":"2024-09-13T15:51:00.062116+0000","last_clean":"2024-09-13T15:51:00.062116+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:51:00.062116+0000","last_undegraded":"2024-09-13T15:51:00.062116+0000","last_fullsized":"2024-09-13T15:51:00.062116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.097690+0000","last_change":"2024-09-13T15:34:35.335431+0000","last_active":"2024-09-13T15:51:00.097690+0000","last_peered":"2024-09-13T15:51:00.097690+0000","last_clean":"2024-09-13T15:51:00.097690+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:51:00.097690+0000","last_undegraded":"2024-09-13T15:51:00.097690+0000","last_fullsized":"2024-09-13T15:51:00.097690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:24.940353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.050410+0000","last_change":"2024-09-13T15:34:34.946174+0000","last_active":"2024-09-13T15:51:00.050410+0000","last_peered":"2024-09-13T15:51:00.050410+0000","last_clean":"2024-09-13T15:51:00.050410+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:51:00.050410+0000","last_undegraded":"2024-09-13T15:51:00.050410+0000","last_fullsized":"2024-09-13T15:51:00.050410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336516+0000","last_change":"2024-09-13T15:34:35.327755+0000","last_active":"2024-09-13T15:51:00.336516+0000","last_peered":"2024-09-13T15:51:00.336516+0000","last_clean":"2024-09-13T15:51:00.336516+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:51:00.336516+0000","last_undegraded":"2024-09-13T15:51:00.336516+0000","last_fullsized":"2024-09-13T15:51:00.336516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333413+0000","last_change":"2024-09-13T15:34:34.953984+0000","last_active":"2024-09-13T15:51:00.333413+0000","last_peered":"2024-09-13T15:51:00.333413+0000","last_clean":"2024-09-13T15:51:00.333413+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:51:00.333413+0000","last_undegraded":"2024-09-13T15:51:00.333413+0000","last_fullsized":"2024-09-13T15:51:00.333413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051639+0000","last_change":"2024-09-13T15:34:35.336428+0000","last_active":"2024-09-13T15:51:00.051639+0000","last_peered":"2024-09-13T15:51:00.051639+0000","last_clean":"2024-09-13T15:51:00.051639+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:51:00.051639+0000","last_undegraded":"2024-09-13T15:51:00.051639+0000","last_fullsized":"2024-09-13T15:51:00.051639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094577+0000","last_change":"2024-09-13T15:34:34.955761+0000","last_active":"2024-09-13T15:51:00.094577+0000","last_peered":"2024-09-13T15:51:00.094577+0000","last_clean":"2024-09-13T15:51:00.094577+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:51:00.094577+0000","last_undegraded":"2024-09-13T15:51:00.094577+0000","last_fullsized":"2024-09-13T15:51:00.094577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:37.814369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333727+0000","last_change":"2024-09-13T15:34:35.324328+0000","last_active":"2024-09-13T15:51:00.333727+0000","last_peered":"2024-09-13T15:51:00.333727+0000","last_clean":"2024-09-13T15:51:00.333727+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:51:00.333727+0000","last_undegraded":"2024-09-13T15:51:00.333727+0000","last_fullsized":"2024-09-13T15:51:00.333727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094121+0000","last_change":"2024-09-13T15:34:34.960919+0000","last_active":"2024-09-13T15:51:00.094121+0000","last_peered":"2024-09-13T15:51:00.094121+0000","last_clean":"2024-09-13T15:51:00.094121+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:51:00.094121+0000","last_undegraded":"2024-09-13T15:51:00.094121+0000","last_fullsized":"2024-09-13T15:51:00.094121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:47.211308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044732+0000","last_change":"2024-09-13T15:34:35.339727+0000","last_active":"2024-09-13T15:51:00.044732+0000","last_peered":"2024-09-13T15:51:00.044732+0000","last_clean":"2024-09-13T15:51:00.044732+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:51:00.044732+0000","last_undegraded":"2024-09-13T15:51:00.044732+0000","last_fullsized":"2024-09-13T15:51:00.044732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051805+0000","last_change":"2024-09-13T15:34:34.939804+0000","last_active":"2024-09-13T15:51:00.051805+0000","last_peered":"2024-09-13T15:51:00.051805+0000","last_clean":"2024-09-13T15:51:00.051805+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:51:00.051805+0000","last_undegraded":"2024-09-13T15:51:00.051805+0000","last_fullsized":"2024-09-13T15:51:00.051805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'108","reported_seq":228,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.047957+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:51:00.047957+0000","last_peered":"2024-09-13T15:51:00.047957+0000","last_clean":"2024-09-13T15:51:00.047957+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:51:00.047957+0000","last_undegraded":"2024-09-13T15:51:00.047957+0000","last_fullsized":"2024-09-13T15:51:00.047957+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:42.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062369+0000","last_change":"2024-09-13T15:34:35.333828+0000","last_active":"2024-09-13T15:51:00.062369+0000","last_peered":"2024-09-13T15:51:00.062369+0000","last_clean":"2024-09-13T15:51:00.062369+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:51:00.062369+0000","last_undegraded":"2024-09-13T15:51:00.062369+0000","last_fullsized":"2024-09-13T15:51:00.062369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095286+0000","last_change":"2024-09-13T15:34:34.956621+0000","last_active":"2024-09-13T15:51:00.095286+0000","last_peered":"2024-09-13T15:51:00.095286+0000","last_clean":"2024-09-13T15:51:00.095286+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:51:00.095286+0000","last_undegraded":"2024-09-13T15:51:00.095286+0000","last_fullsized":"2024-09-13T15:51:00.095286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336964+0000","last_change":"2024-09-13T15:34:35.330850+0000","last_active":"2024-09-13T15:51:00.336964+0000","last_peered":"2024-09-13T15:51:00.336964+0000","last_clean":"2024-09-13T15:51:00.336964+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:51:00.336964+0000","last_undegraded":"2024-09-13T15:51:00.336964+0000","last_fullsized":"2024-09-13T15:51:00.336964+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:53.423967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":59,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062130+0000","last_change":"2024-09-13T15:34:34.936361+0000","last_active":"2024-09-13T15:51:00.062130+0000","last_peered":"2024-09-13T15:51:00.062130+0000","last_clean":"2024-09-13T15:51:00.062130+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:51:00.062130+0000","last_undegraded":"2024-09-13T15:51:00.062130+0000","last_fullsized":"2024-09-13T15:51:00.062130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339823+0000","last_change":"2024-09-13T15:34:35.347478+0000","last_active":"2024-09-13T15:51:00.339823+0000","last_peered":"2024-09-13T15:51:00.339823+0000","last_clean":"2024-09-13T15:51:00.339823+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:51:00.339823+0000","last_undegraded":"2024-09-13T15:51:00.339823+0000","last_fullsized":"2024-09-13T15:51:00.339823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.481157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099045+0000","last_change":"2024-09-13T15:34:34.956480+0000","last_active":"2024-09-13T15:51:00.099045+0000","last_peered":"2024-09-13T15:51:00.099045+0000","last_clean":"2024-09-13T15:51:00.099045+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:51:00.099045+0000","last_undegraded":"2024-09-13T15:51:00.099045+0000","last_fullsized":"2024-09-13T15:51:00.099045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099265+0000","last_change":"2024-09-13T15:34:35.338609+0000","last_active":"2024-09-13T15:51:00.099265+0000","last_peered":"2024-09-13T15:51:00.099265+0000","last_clean":"2024-09-13T15:51:00.099265+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:51:00.099265+0000","last_undegraded":"2024-09-13T15:51:00.099265+0000","last_fullsized":"2024-09-13T15:51:00.099265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":60,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339396+0000","last_change":"2024-09-13T15:34:34.959935+0000","last_active":"2024-09-13T15:51:00.339396+0000","last_peered":"2024-09-13T15:51:00.339396+0000","last_clean":"2024-09-13T15:51:00.339396+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:51:00.339396+0000","last_undegraded":"2024-09-13T15:51:00.339396+0000","last_fullsized":"2024-09-13T15:51:00.339396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.342411+0000","last_change":"2024-09-13T15:34:35.335319+0000","last_active":"2024-09-13T15:51:02.342411+0000","last_peered":"2024-09-13T15:51:02.342411+0000","last_clean":"2024-09-13T15:51:02.342411+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:51:02.342411+0000","last_undegraded":"2024-09-13T15:51:02.342411+0000","last_fullsized":"2024-09-13T15:51:02.342411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":67,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094302+0000","last_change":"2024-09-13T15:34:34.959407+0000","last_active":"2024-09-13T15:51:00.094302+0000","last_peered":"2024-09-13T15:51:00.094302+0000","last_clean":"2024-09-13T15:51:00.094302+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:51:00.094302+0000","last_undegraded":"2024-09-13T15:51:00.094302+0000","last_fullsized":"2024-09-13T15:51:00.094302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:31.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.835106+0000","last_change":"2024-09-13T15:34:35.329165+0000","last_active":"2024-09-13T15:51:00.835106+0000","last_peered":"2024-09-13T15:51:00.835106+0000","last_clean":"2024-09-13T15:51:00.835106+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:51:00.835106+0000","last_undegraded":"2024-09-13T15:51:00.835106+0000","last_fullsized":"2024-09-13T15:51:00.835106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333066+0000","last_change":"2024-09-13T15:34:34.954181+0000","last_active":"2024-09-13T15:51:00.333066+0000","last_peered":"2024-09-13T15:51:00.333066+0000","last_clean":"2024-09-13T15:51:00.333066+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:51:00.333066+0000","last_undegraded":"2024-09-13T15:51:00.333066+0000","last_fullsized":"2024-09-13T15:51:00.333066+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.835603+0000","last_change":"2024-09-13T15:34:35.342732+0000","last_active":"2024-09-13T15:51:00.835603+0000","last_peered":"2024-09-13T15:51:00.835603+0000","last_clean":"2024-09-13T15:51:00.835603+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:51:00.835603+0000","last_undegraded":"2024-09-13T15:51:00.835603+0000","last_fullsized":"2024-09-13T15:51:00.835603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095713+0000","last_change":"2024-09-13T15:34:34.957763+0000","last_active":"2024-09-13T15:51:00.095713+0000","last_peered":"2024-09-13T15:51:00.095713+0000","last_clean":"2024-09-13T15:51:00.095713+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:51:00.095713+0000","last_undegraded":"2024-09-13T15:51:00.095713+0000","last_fullsized":"2024-09-13T15:51:00.095713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.105151+0000","last_change":"2024-09-13T15:34:35.334637+0000","last_active":"2024-09-13T15:51:02.105151+0000","last_peered":"2024-09-13T15:51:02.105151+0000","last_clean":"2024-09-13T15:51:02.105151+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:51:02.105151+0000","last_undegraded":"2024-09-13T15:51:02.105151+0000","last_fullsized":"2024-09-13T15:51:02.105151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:43.466895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.335970+0000","last_change":"2024-09-13T15:34:34.942058+0000","last_active":"2024-09-13T15:51:00.335970+0000","last_peered":"2024-09-13T15:51:00.335970+0000","last_clean":"2024-09-13T15:51:00.335970+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:51:00.335970+0000","last_undegraded":"2024-09-13T15:51:00.335970+0000","last_fullsized":"2024-09-13T15:51:00.335970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336293+0000","last_change":"2024-09-13T15:34:35.345452+0000","last_active":"2024-09-13T15:51:00.336293+0000","last_peered":"2024-09-13T15:51:00.336293+0000","last_clean":"2024-09-13T15:51:00.336293+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:51:00.336293+0000","last_undegraded":"2024-09-13T15:51:00.336293+0000","last_fullsized":"2024-09-13T15:51:00.336293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:08:25.983299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095566+0000","last_change":"2024-09-13T15:34:34.955883+0000","last_active":"2024-09-13T15:51:00.095566+0000","last_peered":"2024-09-13T15:51:00.095566+0000","last_clean":"2024-09-13T15:51:00.095566+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:51:00.095566+0000","last_undegraded":"2024-09-13T15:51:00.095566+0000","last_fullsized":"2024-09-13T15:51:00.095566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2638,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.837843+0000","last_change":"2024-09-13T15:34:35.341547+0000","last_active":"2024-09-13T15:51:00.837843+0000","last_peered":"2024-09-13T15:51:00.837843+0000","last_clean":"2024-09-13T15:51:00.837843+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:51:00.837843+0000","last_undegraded":"2024-09-13T15:51:00.837843+0000","last_fullsized":"2024-09-13T15:51:00.837843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062328+0000","last_change":"2024-09-13T15:34:34.949988+0000","last_active":"2024-09-13T15:51:00.062328+0000","last_peered":"2024-09-13T15:51:00.062328+0000","last_clean":"2024-09-13T15:51:00.062328+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:51:00.062328+0000","last_undegraded":"2024-09-13T15:51:00.062328+0000","last_fullsized":"2024-09-13T15:51:00.062328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339867+0000","last_change":"2024-09-13T15:34:35.347690+0000","last_active":"2024-09-13T15:51:00.339867+0000","last_peered":"2024-09-13T15:51:00.339867+0000","last_clean":"2024-09-13T15:51:00.339867+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:51:00.339867+0000","last_undegraded":"2024-09-13T15:51:00.339867+0000","last_fullsized":"2024-09-13T15:51:00.339867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:53.778485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336789+0000","last_change":"2024-09-13T15:34:34.953625+0000","last_active":"2024-09-13T15:51:00.336789+0000","last_peered":"2024-09-13T15:51:00.336789+0000","last_clean":"2024-09-13T15:51:00.336789+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:51:00.336789+0000","last_undegraded":"2024-09-13T15:51:00.336789+0000","last_fullsized":"2024-09-13T15:51:00.336789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099410+0000","last_change":"2024-09-13T15:34:35.338289+0000","last_active":"2024-09-13T15:51:00.099410+0000","last_peered":"2024-09-13T15:51:00.099410+0000","last_clean":"2024-09-13T15:51:00.099410+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:51:00.099410+0000","last_undegraded":"2024-09-13T15:51:00.099410+0000","last_fullsized":"2024-09-13T15:51:00.099410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:34.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.063208+0000","last_change":"2024-09-13T15:34:34.939305+0000","last_active":"2024-09-13T15:51:00.063208+0000","last_peered":"2024-09-13T15:51:00.063208+0000","last_clean":"2024-09-13T15:51:00.063208+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:51:00.063208+0000","last_undegraded":"2024-09-13T15:51:00.063208+0000","last_fullsized":"2024-09-13T15:51:00.063208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.050401+0000","last_change":"2024-09-13T15:34:35.335773+0000","last_active":"2024-09-13T15:51:00.050401+0000","last_peered":"2024-09-13T15:51:00.050401+0000","last_clean":"2024-09-13T15:51:00.050401+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:51:00.050401+0000","last_undegraded":"2024-09-13T15:51:00.050401+0000","last_fullsized":"2024-09-13T15:51:00.050401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.332732+0000","last_change":"2024-09-13T15:34:34.950709+0000","last_active":"2024-09-13T15:51:00.332732+0000","last_peered":"2024-09-13T15:51:00.332732+0000","last_clean":"2024-09-13T15:51:00.332732+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:51:00.332732+0000","last_undegraded":"2024-09-13T15:51:00.332732+0000","last_fullsized":"2024-09-13T15:51:00.332732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094585+0000","last_change":"2024-09-13T15:34:35.340304+0000","last_active":"2024-09-13T15:51:00.094585+0000","last_peered":"2024-09-13T15:51:00.094585+0000","last_clean":"2024-09-13T15:51:00.094585+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:51:00.094585+0000","last_undegraded":"2024-09-13T15:51:00.094585+0000","last_fullsized":"2024-09-13T15:51:00.094585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333255+0000","last_change":"2024-09-13T15:34:34.954475+0000","last_active":"2024-09-13T15:51:00.333255+0000","last_peered":"2024-09-13T15:51:00.333255+0000","last_clean":"2024-09-13T15:51:00.333255+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:51:00.333255+0000","last_undegraded":"2024-09-13T15:51:00.333255+0000","last_fullsized":"2024-09-13T15:51:00.333255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095814+0000","last_change":"2024-09-13T15:34:34.957379+0000","last_active":"2024-09-13T15:51:00.095814+0000","last_peered":"2024-09-13T15:51:00.095814+0000","last_clean":"2024-09-13T15:51:00.095814+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:51:00.095814+0000","last_undegraded":"2024-09-13T15:51:00.095814+0000","last_fullsized":"2024-09-13T15:51:00.095814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336793+0000","last_change":"2024-09-13T15:34:35.331843+0000","last_active":"2024-09-13T15:51:00.336793+0000","last_peered":"2024-09-13T15:51:00.336793+0000","last_clean":"2024-09-13T15:51:00.336793+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:51:00.336793+0000","last_undegraded":"2024-09-13T15:51:00.336793+0000","last_fullsized":"2024-09-13T15:51:00.336793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:43.103418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051973+0000","last_change":"2024-09-13T15:34:34.944458+0000","last_active":"2024-09-13T15:51:00.051973+0000","last_peered":"2024-09-13T15:51:00.051973+0000","last_clean":"2024-09-13T15:51:00.051973+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:51:00.051973+0000","last_undegraded":"2024-09-13T15:51:00.051973+0000","last_fullsized":"2024-09-13T15:51:00.051973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044815+0000","last_change":"2024-09-13T15:34:35.343571+0000","last_active":"2024-09-13T15:51:00.044815+0000","last_peered":"2024-09-13T15:51:00.044815+0000","last_clean":"2024-09-13T15:51:00.044815+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:51:00.044815+0000","last_undegraded":"2024-09-13T15:51:00.044815+0000","last_fullsized":"2024-09-13T15:51:00.044815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.096135+0000","last_change":"2024-09-13T15:34:35.331904+0000","last_active":"2024-09-13T15:51:00.096135+0000","last_peered":"2024-09-13T15:51:00.096135+0000","last_clean":"2024-09-13T15:51:00.096135+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:51:00.096135+0000","last_undegraded":"2024-09-13T15:51:00.096135+0000","last_fullsized":"2024-09-13T15:51:00.096135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094949+0000","last_change":"2024-09-13T15:34:35.335517+0000","last_active":"2024-09-13T15:51:00.094949+0000","last_peered":"2024-09-13T15:51:00.094949+0000","last_clean":"2024-09-13T15:51:00.094949+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:51:00.094949+0000","last_undegraded":"2024-09-13T15:51:00.094949+0000","last_fullsized":"2024-09-13T15:51:00.094949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:58.399592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334061+0000","last_change":"2024-09-13T15:34:35.324690+0000","last_active":"2024-09-13T15:51:00.334061+0000","last_peered":"2024-09-13T15:51:00.334061+0000","last_clean":"2024-09-13T15:51:00.334061+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:51:00.334061+0000","last_undegraded":"2024-09-13T15:51:00.334061+0000","last_fullsized":"2024-09-13T15:51:00.334061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336765+0000","last_change":"2024-09-13T15:34:35.331611+0000","last_active":"2024-09-13T15:51:00.336765+0000","last_peered":"2024-09-13T15:51:00.336765+0000","last_clean":"2024-09-13T15:51:00.336765+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:51:00.336765+0000","last_undegraded":"2024-09-13T15:51:00.336765+0000","last_fullsized":"2024-09-13T15:51:00.336765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:08.881292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.048264+0000","last_change":"2024-09-13T15:35:20.157986+0000","last_active":"2024-09-13T15:51:00.048264+0000","last_peered":"2024-09-13T15:51:00.048264+0000","last_clean":"2024-09-13T15:51:00.048264+0000","last_became_active":"2024-09-13T15:35:20.157317+0000","last_became_peered":"2024-09-13T15:35:20.157317+0000","last_unstale":"2024-09-13T15:51:00.048264+0000","last_undegraded":"2024-09-13T15:51:00.048264+0000","last_fullsized":"2024-09-13T15:51:00.048264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:21.036558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062666+0000","last_change":"2024-09-13T15:34:35.339305+0000","last_active":"2024-09-13T15:51:00.062666+0000","last_peered":"2024-09-13T15:51:00.062666+0000","last_clean":"2024-09-13T15:51:00.062666+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:51:00.062666+0000","last_undegraded":"2024-09-13T15:51:00.062666+0000","last_fullsized":"2024-09-13T15:51:00.062666+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099626+0000","last_change":"2024-09-13T15:34:35.335209+0000","last_active":"2024-09-13T15:51:00.099626+0000","last_peered":"2024-09-13T15:51:00.099626+0000","last_clean":"2024-09-13T15:51:00.099626+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:51:00.099626+0000","last_undegraded":"2024-09-13T15:51:00.099626+0000","last_fullsized":"2024-09-13T15:51:00.099626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099756+0000","last_change":"2024-09-13T15:34:35.336949+0000","last_active":"2024-09-13T15:51:00.099756+0000","last_peered":"2024-09-13T15:51:00.099756+0000","last_clean":"2024-09-13T15:51:00.099756+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:51:00.099756+0000","last_undegraded":"2024-09-13T15:51:00.099756+0000","last_fullsized":"2024-09-13T15:51:00.099756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:45.530761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.332962+0000","last_change":"2024-09-13T15:34:35.327879+0000","last_active":"2024-09-13T15:51:00.332962+0000","last_peered":"2024-09-13T15:51:00.332962+0000","last_clean":"2024-09-13T15:51:00.332962+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:51:00.332962+0000","last_undegraded":"2024-09-13T15:51:00.332962+0000","last_fullsized":"2024-09-13T15:51:00.332962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334238+0000","last_change":"2024-09-13T15:34:35.324523+0000","last_active":"2024-09-13T15:51:00.334238+0000","last_peered":"2024-09-13T15:51:00.334238+0000","last_clean":"2024-09-13T15:51:00.334238+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:51:00.334238+0000","last_undegraded":"2024-09-13T15:51:00.334238+0000","last_fullsized":"2024-09-13T15:51:00.334238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044962+0000","last_change":"2024-09-13T15:34:35.329712+0000","last_active":"2024-09-13T15:51:00.044962+0000","last_peered":"2024-09-13T15:51:00.044962+0000","last_clean":"2024-09-13T15:51:00.044962+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:51:00.044962+0000","last_undegraded":"2024-09-13T15:51:00.044962+0000","last_fullsized":"2024-09-13T15:51:00.044962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051700+0000","last_change":"2024-09-13T15:35:20.156675+0000","last_active":"2024-09-13T15:51:00.051700+0000","last_peered":"2024-09-13T15:51:00.051700+0000","last_clean":"2024-09-13T15:51:00.051700+0000","last_became_active":"2024-09-13T15:35:20.152889+0000","last_became_peered":"2024-09-13T15:35:20.152889+0000","last_unstale":"2024-09-13T15:51:00.051700+0000","last_undegraded":"2024-09-13T15:51:00.051700+0000","last_fullsized":"2024-09-13T15:51:00.051700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:12.515681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.338254+0000","last_change":"2024-09-13T15:34:35.346893+0000","last_active":"2024-09-13T15:51:00.338254+0000","last_peered":"2024-09-13T15:51:00.338254+0000","last_clean":"2024-09-13T15:51:00.338254+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:51:00.338254+0000","last_undegraded":"2024-09-13T15:51:00.338254+0000","last_fullsized":"2024-09-13T15:51:00.338254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:52.439034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336587+0000","last_change":"2024-09-13T15:34:35.324912+0000","last_active":"2024-09-13T15:51:00.336587+0000","last_peered":"2024-09-13T15:51:00.336587+0000","last_clean":"2024-09-13T15:51:00.336587+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:51:00.336587+0000","last_undegraded":"2024-09-13T15:51:00.336587+0000","last_fullsized":"2024-09-13T15:51:00.336587+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.352332+0000","last_change":"2024-09-13T15:34:35.335384+0000","last_active":"2024-09-13T15:51:02.352332+0000","last_peered":"2024-09-13T15:51:02.352332+0000","last_clean":"2024-09-13T15:51:02.352332+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:51:02.352332+0000","last_undegraded":"2024-09-13T15:51:02.352332+0000","last_fullsized":"2024-09-13T15:51:02.352332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.841051+0000","last_change":"2024-09-13T15:34:35.333522+0000","last_active":"2024-09-13T15:51:00.841051+0000","last_peered":"2024-09-13T15:51:00.841051+0000","last_clean":"2024-09-13T15:51:00.841051+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:51:00.841051+0000","last_undegraded":"2024-09-13T15:51:00.841051+0000","last_fullsized":"2024-09-13T15:51:00.841051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.342895+0000","last_change":"2024-09-13T15:34:35.331848+0000","last_active":"2024-09-13T15:51:02.342895+0000","last_peered":"2024-09-13T15:51:02.342895+0000","last_clean":"2024-09-13T15:51:02.342895+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:51:02.342895+0000","last_undegraded":"2024-09-13T15:51:02.342895+0000","last_fullsized":"2024-09-13T15:51:02.342895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.834589+0000","last_change":"2024-09-13T15:34:35.333765+0000","last_active":"2024-09-13T15:51:00.834589+0000","last_peered":"2024-09-13T15:51:00.834589+0000","last_clean":"2024-09-13T15:51:00.834589+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:51:00.834589+0000","last_undegraded":"2024-09-13T15:51:00.834589+0000","last_fullsized":"2024-09-13T15:51:00.834589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.108861+0000","last_change":"2024-09-13T15:34:35.335599+0000","last_active":"2024-09-13T15:51:02.108861+0000","last_peered":"2024-09-13T15:51:02.108861+0000","last_clean":"2024-09-13T15:51:02.108861+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:51:02.108861+0000","last_undegraded":"2024-09-13T15:51:02.108861+0000","last_fullsized":"2024-09-13T15:51:02.108861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:06.605564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.335794+0000","last_change":"2024-09-13T15:34:35.335252+0000","last_active":"2024-09-13T15:51:00.335794+0000","last_peered":"2024-09-13T15:51:00.335794+0000","last_clean":"2024-09-13T15:51:00.335794+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:51:00.335794+0000","last_undegraded":"2024-09-13T15:51:00.335794+0000","last_fullsized":"2024-09-13T15:51:00.335794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:37.432254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.338693+0000","last_change":"2024-09-13T15:34:35.330875+0000","last_active":"2024-09-13T15:51:00.338693+0000","last_peered":"2024-09-13T15:51:00.338693+0000","last_clean":"2024-09-13T15:51:00.338693+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:51:00.338693+0000","last_undegraded":"2024-09-13T15:51:00.338693+0000","last_fullsized":"2024-09-13T15:51:00.338693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:22.297990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336857+0000","last_change":"2024-09-13T15:34:35.331709+0000","last_active":"2024-09-13T15:51:00.336857+0000","last_peered":"2024-09-13T15:51:00.336857+0000","last_clean":"2024-09-13T15:51:00.336857+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:51:00.336857+0000","last_undegraded":"2024-09-13T15:51:00.336857+0000","last_fullsized":"2024-09-13T15:51:00.336857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:17.069173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.338009+0000","last_change":"2024-09-13T15:34:35.319299+0000","last_active":"2024-09-13T15:51:00.338009+0000","last_peered":"2024-09-13T15:51:00.338009+0000","last_clean":"2024-09-13T15:51:00.338009+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:51:00.338009+0000","last_undegraded":"2024-09-13T15:51:00.338009+0000","last_fullsized":"2024-09-13T15:51:00.338009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:16.700428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.069443+0000","last_change":"2024-09-13T15:34:35.345251+0000","last_active":"2024-09-13T15:51:00.069443+0000","last_peered":"2024-09-13T15:51:00.069443+0000","last_clean":"2024-09-13T15:51:00.069443+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:51:00.069443+0000","last_undegraded":"2024-09-13T15:51:00.069443+0000","last_fullsized":"2024-09-13T15:51:00.069443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095085+0000","last_change":"2024-09-13T15:34:35.335400+0000","last_active":"2024-09-13T15:51:00.095085+0000","last_peered":"2024-09-13T15:51:00.095085+0000","last_clean":"2024-09-13T15:51:00.095085+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:51:00.095085+0000","last_undegraded":"2024-09-13T15:51:00.095085+0000","last_fullsized":"2024-09-13T15:51:00.095085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334006+0000","last_change":"2024-09-13T15:34:35.334719+0000","last_active":"2024-09-13T15:51:00.334006+0000","last_peered":"2024-09-13T15:51:00.334006+0000","last_clean":"2024-09-13T15:51:00.334006+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:51:00.334006+0000","last_undegraded":"2024-09-13T15:51:00.334006+0000","last_fullsized":"2024-09-13T15:51:00.334006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:14.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095974+0000","last_change":"2024-09-13T15:34:35.329319+0000","last_active":"2024-09-13T15:51:00.095974+0000","last_peered":"2024-09-13T15:51:00.095974+0000","last_clean":"2024-09-13T15:51:00.095974+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:51:00.095974+0000","last_undegraded":"2024-09-13T15:51:00.095974+0000","last_fullsized":"2024-09-13T15:51:00.095974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336154+0000","last_change":"2024-09-13T15:34:35.327922+0000","last_active":"2024-09-13T15:51:00.336154+0000","last_peered":"2024-09-13T15:51:00.336154+0000","last_clean":"2024-09-13T15:51:00.336154+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:51:00.336154+0000","last_undegraded":"2024-09-13T15:51:00.336154+0000","last_fullsized":"2024-09-13T15:51:00.336154+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:22.066293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095681+0000","last_change":"2024-09-13T15:34:35.330864+0000","last_active":"2024-09-13T15:51:00.095681+0000","last_peered":"2024-09-13T15:51:00.095681+0000","last_clean":"2024-09-13T15:51:00.095681+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:51:00.095681+0000","last_undegraded":"2024-09-13T15:51:00.095681+0000","last_fullsized":"2024-09-13T15:51:00.095681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336165+0000","last_change":"2024-09-13T15:34:35.324580+0000","last_active":"2024-09-13T15:51:00.336165+0000","last_peered":"2024-09-13T15:51:00.336165+0000","last_clean":"2024-09-13T15:51:00.336165+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:51:00.336165+0000","last_undegraded":"2024-09-13T15:51:00.336165+0000","last_fullsized":"2024-09-13T15:51:00.336165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:08.082085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.058052+0000","last_change":"2024-09-13T15:34:35.329279+0000","last_active":"2024-09-13T15:51:00.058052+0000","last_peered":"2024-09-13T15:51:00.058052+0000","last_clean":"2024-09-13T15:51:00.058052+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:51:00.058052+0000","last_undegraded":"2024-09-13T15:51:00.058052+0000","last_fullsized":"2024-09-13T15:51:00.058052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.340148+0000","last_change":"2024-09-13T15:34:35.347293+0000","last_active":"2024-09-13T15:51:00.340148+0000","last_peered":"2024-09-13T15:51:00.340148+0000","last_clean":"2024-09-13T15:51:00.340148+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:51:00.340148+0000","last_undegraded":"2024-09-13T15:51:00.340148+0000","last_fullsized":"2024-09-13T15:51:00.340148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:52.388403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3436,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738571,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148124,"kb_used_data":48912,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94223716,"statfs":{"total":96636764160,"available":96485085184,"internally_reserved":0,"allocated":50085888,"data_stored":38240820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.42999999999999999},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.152},"max":{"1min":0.65600000000000003,"5min":0.83899999999999997,"15min":3.4550000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.46300000000000002},"min":{"1min":0.32300000000000001,"5min":0.248,"15min":0.18099999999999999},"max":{"1min":0.76900000000000002,"5min":0.97499999999999998,"15min":6.1989999999999998},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53600000000000003,"15min":0.46300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.185},"max":{"1min":0.82699999999999996,"5min":1.006,"15min":1.4790000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.495},"min":{"1min":0.31,"5min":0.30299999999999999,"15min":0.17799999999999999},"max":{"1min":0.73199999999999998,"5min":1.0589999999999999,"15min":1.399},"last":0.58399999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738570,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335876,"kb_used_data":188272,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":94035964,"statfs":{"total":96636764160,"available":96292827136,"internally_reserved":0,"allocated":192790528,"data_stored":179551003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45600000000000002,"15min":0.41599999999999998},"min":{"1min":0.26900000000000002,"5min":0.214,"15min":0.159},"max":{"1min":0.64700000000000002,"5min":0.69599999999999995,"15min":4.2400000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.432},"min":{"1min":0.33900000000000002,"5min":0.20399999999999999,"15min":0.17100000000000001},"max":{"1min":0.70399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.443},"min":{"1min":0.42099999999999999,"5min":0.26400000000000001,"15min":0.17199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.82999999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57299999999999995,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.253,"15min":0.189},"max":{"1min":0.86099999999999999,"5min":0.93000000000000005,"15min":1.2789999999999999},"last":0.86099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738572,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187712,"kb_used_data":30260,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94184128,"statfs":{"total":96636764160,"available":96444547072,"internally_reserved":0,"allocated":30986240,"data_stored":20392376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":161216966},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47899999999999998,"15min":0.40799999999999997},"min":{"1min":0.28399999999999997,"5min":0.20399999999999999,"15min":0.158},"max":{"1min":0.755,"5min":0.80900000000000005,"15min":0.873},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.42699999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.186},"max":{"1min":0.68200000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53700000000000003,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.17899999999999999},"max":{"1min":0.77400000000000002,"5min":0.82099999999999995,"15min":9.4610000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.48599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.20300000000000001},"max":{"1min":0.67700000000000005,"5min":0.84899999999999998,"15min":0.90700000000000003},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:51:03.955 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T15:51:03.955 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:51:04.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.108+0000 7fa146cb9640 1 Processor -- start 2024-09-13T15:51:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.108+0000 7fa146cb9640 1 -- start start 2024-09-13T15:51:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.108+0000 7fa146cb9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa14008ab90 0x7fa1400be440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.108+0000 7fa146cb9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1400bfab0 con 0x7fa14008a7b0 2024-09-13T15:51:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.108+0000 7fa146cb9640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1400bd670 con 0x7fa14008ab90 2024-09-13T15:51:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.108+0000 7fa144a55640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa14008a7b0 0x7fa14006b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59462/0 (socket says 172.21.15.40:59462) 2024-09-13T15:51:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.108+0000 7fa144a55640 1 -- 172.21.15.40:0/2896171203 learned_addr learned my addr 172.21.15.40:0/2896171203 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:51:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.108+0000 7fa13ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa14008ab90 0x7fa1400be440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.108+0000 7fa13f7fe640 1 -- 172.21.15.40:0/2896171203 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46669863 0 0) 0x7fa1400bfab0 con 0x7fa14008a7b0 2024-09-13T15:51:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.116+0000 7fa13f7fe640 1 -- 172.21.15.40:0/2896171203 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa130003510 con 0x7fa14008a7b0 2024-09-13T15:51:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.116+0000 7fa13ffff640 1 -- 172.21.15.40:0/2896171203 >> v1:172.21.15.40:6789/0 conn(0x7fa14008a7b0 legacy=0x7fa14006b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:04.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.116+0000 7fa13ffff640 1 -- 172.21.15.40:0/2896171203 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1400bf6d0 con 0x7fa14008ab90 2024-09-13T15:51:04.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa13ffff640 1 --2- 172.21.15.40:0/2896171203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa14008ab90 0x7fa1400be440 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa134009880 tx=0x7fa13401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b917261e5ad392 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa13f7fe640 1 -- 172.21.15.40:0/2896171203 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1340b0530 con 0x7fa14008ab90 2024-09-13T15:51:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa13f7fe640 1 -- 172.21.15.40:0/2896171203 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1340b0690 con 0x7fa14008ab90 2024-09-13T15:51:04.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa13f7fe640 1 -- 172.21.15.40:0/2896171203 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1340b0950 con 0x7fa14008ab90 2024-09-13T15:51:04.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa146cb9640 1 -- 172.21.15.40:0/2896171203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa14008ab90 msgr2=0x7fa1400be440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:04.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa146cb9640 1 --2- 172.21.15.40:0/2896171203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa14008ab90 0x7fa1400be440 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fa134009880 tx=0x7fa13401c4a0 comp rx=0 tx=0).stop 2024-09-13T15:51:04.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa146cb9640 1 -- 172.21.15.40:0/2896171203 shutdown_connections 2024-09-13T15:51:04.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa146cb9640 1 --2- 172.21.15.40:0/2896171203 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa14008ab90 0x7fa1400be440 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:04.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa146cb9640 1 -- 172.21.15.40:0/2896171203 >> 172.21.15.40:0/2896171203 conn(0x7fa1400a4510 msgr2=0x7fa1400a4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:04.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa146cb9640 1 -- 172.21.15.40:0/2896171203 shutdown_connections 2024-09-13T15:51:04.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa146cb9640 1 -- 172.21.15.40:0/2896171203 wait complete. 2024-09-13T15:51:04.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa146cb9640 1 Processor -- start 2024-09-13T15:51:04.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.120+0000 7fa146cb9640 1 -- start start 2024-09-13T15:51:04.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa146cb9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa14008a7b0 0x7fa1400833d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:04.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa146cb9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa140088970 con 0x7fa14008a7b0 2024-09-13T15:51:04.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa144a55640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa14008a7b0 0x7fa1400833d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:04.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa144a55640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa14008a7b0 0x7fa1400833d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35806/0 (socket says 172.21.15.40:35806) 2024-09-13T15:51:04.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa144a55640 1 -- 172.21.15.40:0/1472217575 learned_addr learned my addr 172.21.15.40:0/1472217575 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:04.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa144a55640 1 -- 172.21.15.40:0/1472217575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa134009560 con 0x7fa14008a7b0 2024-09-13T15:51:04.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa144a55640 1 --2- 172.21.15.40:0/1472217575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa14008a7b0 0x7fa1400833d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c450 tx=0x7fa12c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:04.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa13d7fa640 1 -- 172.21.15.40:0/1472217575 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa12c005c20 con 0x7fa14008a7b0 2024-09-13T15:51:04.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa13d7fa640 1 -- 172.21.15.40:0/1472217575 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c005d80 con 0x7fa14008a7b0 2024-09-13T15:51:04.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa146cb9640 1 -- 172.21.15.40:0/1472217575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1400801b0 con 0x7fa14008a7b0 2024-09-13T15:51:04.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa13d7fa640 1 -- 172.21.15.40:0/1472217575 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa12c0071a0 con 0x7fa14008a7b0 2024-09-13T15:51:04.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa146cb9640 1 -- 172.21.15.40:0/1472217575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14015aec0 con 0x7fa14008a7b0 2024-09-13T15:51:04.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa13d7fa640 1 -- 172.21.15.40:0/1472217575 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7fa12c007300 con 0x7fa14008a7b0 2024-09-13T15:51:04.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa146cb9640 1 -- 172.21.15.40:0/1472217575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1400887d0 con 0x7fa14008a7b0 2024-09-13T15:51:04.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa13d7fa640 1 --2- 172.21.15.40:0/1472217575 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fa124035530 0x7fa1240379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:04.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa13d7fa640 1 -- 172.21.15.40:0/1472217575 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7fa12c0472f0 con 0x7fa14008a7b0 2024-09-13T15:51:04.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa13ffff640 1 --2- 172.21.15.40:0/1472217575 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fa124035530 0x7fa1240379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:04.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.124+0000 7fa13ffff640 1 --2- 172.21.15.40:0/1472217575 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fa124035530 0x7fa1240379f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa1340af000 tx=0x7fa1340a7000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:04.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.128+0000 7fa13d7fa640 1 -- 172.21.15.40:0/1472217575 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa1400887d0 con 0x7fa14008a7b0 2024-09-13T15:51:04.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.288+0000 7fa146cb9640 1 -- 172.21.15.40:0/1472217575 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1400887d0 con 0x7fa124035530 2024-09-13T15:51:04.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.304+0000 7fa13d7fa640 1 -- 172.21.15.40:0/1472217575 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249952 (secure 0 0 0) 0x7fa1400887d0 con 0x7fa124035530 2024-09-13T15:51:04.311 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:51:04.312 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:51:04.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.308+0000 7fa146cb9640 1 -- 172.21.15.40:0/1472217575 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fa124035530 msgr2=0x7fa1240379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:04.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.308+0000 7fa146cb9640 1 --2- 172.21.15.40:0/1472217575 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fa124035530 0x7fa1240379f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa1340af000 tx=0x7fa1340a7000 comp rx=0 tx=0).stop 2024-09-13T15:51:04.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.308+0000 7fa146cb9640 1 -- 172.21.15.40:0/1472217575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa14008a7b0 msgr2=0x7fa1400833d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:04.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.308+0000 7fa146cb9640 1 --2- 172.21.15.40:0/1472217575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa14008a7b0 0x7fa1400833d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c450 tx=0x7fa12c00c910 comp rx=0 tx=0).stop 2024-09-13T15:51:04.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.308+0000 7fa146cb9640 1 -- 172.21.15.40:0/1472217575 shutdown_connections 2024-09-13T15:51:04.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.308+0000 7fa146cb9640 1 --2- 172.21.15.40:0/1472217575 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fa124035530 0x7fa1240379f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:04.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.308+0000 7fa146cb9640 1 --2- 172.21.15.40:0/1472217575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa14008a7b0 0x7fa1400833d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:04.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.308+0000 7fa146cb9640 1 -- 172.21.15.40:0/1472217575 >> 172.21.15.40:0/1472217575 conn(0x7fa1400a4510 msgr2=0x7fa14006a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:04.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.308+0000 7fa146cb9640 1 -- 172.21.15.40:0/1472217575 shutdown_connections 2024-09-13T15:51:04.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.308+0000 7fa146cb9640 1 -- 172.21.15.40:0/1472217575 wait complete. 2024-09-13T15:51:04.331 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":455,"stamp":"2024-09-13T15:51:03.847228+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593804,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":208,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":368,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":671712,"kb_used_data":267444,"kb_used_omap":4,"kb_used_meta":404219,"kb_avail":282443808,"statfs":{"total":289910292480,"available":289222459392,"internally_reserved":0,"allocated":273862656,"data_stored":238184199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":413920594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-261536172,"num_objects":-4670,"num_object_clones":-60,"num_object_copies":-9340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4670,"num_whiteouts":0,"num_read":-18696,"num_read_kb":-170253,"num_write":-15658,"num_write_kb":-264556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.178937"},"pg_stats":[{"pgid":"2.1f","version":"15'4","reported_seq":63,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339591+0000","last_change":"2024-09-13T15:34:34.960705+0000","last_active":"2024-09-13T15:51:00.339591+0000","last_peered":"2024-09-13T15:51:00.339591+0000","last_clean":"2024-09-13T15:51:00.339591+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:51:00.339591+0000","last_undegraded":"2024-09-13T15:51:00.339591+0000","last_fullsized":"2024-09-13T15:51:00.339591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099521+0000","last_change":"2024-09-13T15:34:35.338454+0000","last_active":"2024-09-13T15:51:00.099521+0000","last_peered":"2024-09-13T15:51:00.099521+0000","last_clean":"2024-09-13T15:51:00.099521+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:51:00.099521+0000","last_undegraded":"2024-09-13T15:51:00.099521+0000","last_fullsized":"2024-09-13T15:51:00.099521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:49.904225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099261+0000","last_change":"2024-09-13T15:34:34.955842+0000","last_active":"2024-09-13T15:51:00.099261+0000","last_peered":"2024-09-13T15:51:00.099261+0000","last_clean":"2024-09-13T15:51:00.099261+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:51:00.099261+0000","last_undegraded":"2024-09-13T15:51:00.099261+0000","last_fullsized":"2024-09-13T15:51:00.099261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.340160+0000","last_change":"2024-09-13T15:34:35.350474+0000","last_active":"2024-09-13T15:51:00.340160+0000","last_peered":"2024-09-13T15:51:00.340160+0000","last_clean":"2024-09-13T15:51:00.340160+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:51:00.340160+0000","last_undegraded":"2024-09-13T15:51:00.340160+0000","last_fullsized":"2024-09-13T15:51:00.340160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:08:45.573183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":60,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.335889+0000","last_change":"2024-09-13T15:34:34.950125+0000","last_active":"2024-09-13T15:51:00.335889+0000","last_peered":"2024-09-13T15:51:00.335889+0000","last_clean":"2024-09-13T15:51:00.335889+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:51:00.335889+0000","last_undegraded":"2024-09-13T15:51:00.335889+0000","last_fullsized":"2024-09-13T15:51:00.335889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051068+0000","last_change":"2024-09-13T15:34:35.333710+0000","last_active":"2024-09-13T15:51:00.051068+0000","last_peered":"2024-09-13T15:51:00.051068+0000","last_clean":"2024-09-13T15:51:00.051068+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:51:00.051068+0000","last_undegraded":"2024-09-13T15:51:00.051068+0000","last_fullsized":"2024-09-13T15:51:00.051068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095970+0000","last_change":"2024-09-13T15:35:20.173539+0000","last_active":"2024-09-13T15:51:00.095970+0000","last_peered":"2024-09-13T15:51:00.095970+0000","last_clean":"2024-09-13T15:51:00.095970+0000","last_became_active":"2024-09-13T15:35:20.165658+0000","last_became_peered":"2024-09-13T15:35:20.165658+0000","last_unstale":"2024-09-13T15:51:00.095970+0000","last_undegraded":"2024-09-13T15:51:00.095970+0000","last_fullsized":"2024-09-13T15:51:00.095970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:35.807536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.097424+0000","last_change":"2024-09-13T15:34:35.329220+0000","last_active":"2024-09-13T15:51:00.097424+0000","last_peered":"2024-09-13T15:51:00.097424+0000","last_clean":"2024-09-13T15:51:00.097424+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:51:00.097424+0000","last_undegraded":"2024-09-13T15:51:00.097424+0000","last_fullsized":"2024-09-13T15:51:00.097424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334413+0000","last_change":"2024-09-13T15:34:35.334308+0000","last_active":"2024-09-13T15:51:00.334413+0000","last_peered":"2024-09-13T15:51:00.334413+0000","last_clean":"2024-09-13T15:51:00.334413+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:51:00.334413+0000","last_undegraded":"2024-09-13T15:51:00.334413+0000","last_fullsized":"2024-09-13T15:51:00.334413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:50.918862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334863+0000","last_change":"2024-09-13T15:34:34.943033+0000","last_active":"2024-09-13T15:51:00.334863+0000","last_peered":"2024-09-13T15:51:00.334863+0000","last_clean":"2024-09-13T15:51:00.334863+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:51:00.334863+0000","last_undegraded":"2024-09-13T15:51:00.334863+0000","last_fullsized":"2024-09-13T15:51:00.334863+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.052739+0000","last_change":"2024-09-13T15:34:35.339704+0000","last_active":"2024-09-13T15:51:00.052739+0000","last_peered":"2024-09-13T15:51:00.052739+0000","last_clean":"2024-09-13T15:51:00.052739+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:51:00.052739+0000","last_undegraded":"2024-09-13T15:51:00.052739+0000","last_fullsized":"2024-09-13T15:51:00.052739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044596+0000","last_change":"2024-09-13T15:34:34.943732+0000","last_active":"2024-09-13T15:51:00.044596+0000","last_peered":"2024-09-13T15:51:00.044596+0000","last_clean":"2024-09-13T15:51:00.044596+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:51:00.044596+0000","last_undegraded":"2024-09-13T15:51:00.044596+0000","last_fullsized":"2024-09-13T15:51:00.044596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094473+0000","last_change":"2024-09-13T15:34:35.340037+0000","last_active":"2024-09-13T15:51:00.094473+0000","last_peered":"2024-09-13T15:51:00.094473+0000","last_clean":"2024-09-13T15:51:00.094473+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:51:00.094473+0000","last_undegraded":"2024-09-13T15:51:00.094473+0000","last_fullsized":"2024-09-13T15:51:00.094473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.048410+0000","last_change":"2024-09-13T15:34:34.943197+0000","last_active":"2024-09-13T15:51:00.048410+0000","last_peered":"2024-09-13T15:51:00.048410+0000","last_clean":"2024-09-13T15:51:00.048410+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:51:00.048410+0000","last_undegraded":"2024-09-13T15:51:00.048410+0000","last_fullsized":"2024-09-13T15:51:00.048410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333855+0000","last_change":"2024-09-13T15:34:35.327260+0000","last_active":"2024-09-13T15:51:00.333855+0000","last_peered":"2024-09-13T15:51:00.333855+0000","last_clean":"2024-09-13T15:51:00.333855+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:51:00.333855+0000","last_undegraded":"2024-09-13T15:51:00.333855+0000","last_fullsized":"2024-09-13T15:51:00.333855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.332568+0000","last_change":"2024-09-13T15:34:34.941308+0000","last_active":"2024-09-13T15:51:00.332568+0000","last_peered":"2024-09-13T15:51:00.332568+0000","last_clean":"2024-09-13T15:51:00.332568+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:51:00.332568+0000","last_undegraded":"2024-09-13T15:51:00.332568+0000","last_fullsized":"2024-09-13T15:51:00.332568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.337585+0000","last_change":"2024-09-13T15:34:35.334433+0000","last_active":"2024-09-13T15:51:00.337585+0000","last_peered":"2024-09-13T15:51:00.337585+0000","last_clean":"2024-09-13T15:51:00.337585+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:51:00.337585+0000","last_undegraded":"2024-09-13T15:51:00.337585+0000","last_fullsized":"2024-09-13T15:51:00.337585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:34.847820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.058322+0000","last_change":"2024-09-13T15:34:34.946540+0000","last_active":"2024-09-13T15:51:00.058322+0000","last_peered":"2024-09-13T15:51:00.058322+0000","last_clean":"2024-09-13T15:51:00.058322+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:51:00.058322+0000","last_undegraded":"2024-09-13T15:51:00.058322+0000","last_fullsized":"2024-09-13T15:51:00.058322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099890+0000","last_change":"2024-09-13T15:34:35.337361+0000","last_active":"2024-09-13T15:51:00.099890+0000","last_peered":"2024-09-13T15:51:00.099890+0000","last_clean":"2024-09-13T15:51:00.099890+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:51:00.099890+0000","last_undegraded":"2024-09-13T15:51:00.099890+0000","last_fullsized":"2024-09-13T15:51:00.099890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:27.081960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":59,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.057520+0000","last_change":"2024-09-13T15:34:34.942452+0000","last_active":"2024-09-13T15:51:00.057520+0000","last_peered":"2024-09-13T15:51:00.057520+0000","last_clean":"2024-09-13T15:51:00.057520+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:51:00.057520+0000","last_undegraded":"2024-09-13T15:51:00.057520+0000","last_fullsized":"2024-09-13T15:51:00.057520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.050628+0000","last_change":"2024-09-13T15:34:35.339676+0000","last_active":"2024-09-13T15:51:00.050628+0000","last_peered":"2024-09-13T15:51:00.050628+0000","last_clean":"2024-09-13T15:51:00.050628+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:51:00.050628+0000","last_undegraded":"2024-09-13T15:51:00.050628+0000","last_fullsized":"2024-09-13T15:51:00.050628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062116+0000","last_change":"2024-09-13T15:34:34.949805+0000","last_active":"2024-09-13T15:51:00.062116+0000","last_peered":"2024-09-13T15:51:00.062116+0000","last_clean":"2024-09-13T15:51:00.062116+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:51:00.062116+0000","last_undegraded":"2024-09-13T15:51:00.062116+0000","last_fullsized":"2024-09-13T15:51:00.062116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.097690+0000","last_change":"2024-09-13T15:34:35.335431+0000","last_active":"2024-09-13T15:51:00.097690+0000","last_peered":"2024-09-13T15:51:00.097690+0000","last_clean":"2024-09-13T15:51:00.097690+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:51:00.097690+0000","last_undegraded":"2024-09-13T15:51:00.097690+0000","last_fullsized":"2024-09-13T15:51:00.097690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:24.940353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.050410+0000","last_change":"2024-09-13T15:34:34.946174+0000","last_active":"2024-09-13T15:51:00.050410+0000","last_peered":"2024-09-13T15:51:00.050410+0000","last_clean":"2024-09-13T15:51:00.050410+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:51:00.050410+0000","last_undegraded":"2024-09-13T15:51:00.050410+0000","last_fullsized":"2024-09-13T15:51:00.050410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336516+0000","last_change":"2024-09-13T15:34:35.327755+0000","last_active":"2024-09-13T15:51:00.336516+0000","last_peered":"2024-09-13T15:51:00.336516+0000","last_clean":"2024-09-13T15:51:00.336516+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:51:00.336516+0000","last_undegraded":"2024-09-13T15:51:00.336516+0000","last_fullsized":"2024-09-13T15:51:00.336516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333413+0000","last_change":"2024-09-13T15:34:34.953984+0000","last_active":"2024-09-13T15:51:00.333413+0000","last_peered":"2024-09-13T15:51:00.333413+0000","last_clean":"2024-09-13T15:51:00.333413+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:51:00.333413+0000","last_undegraded":"2024-09-13T15:51:00.333413+0000","last_fullsized":"2024-09-13T15:51:00.333413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051639+0000","last_change":"2024-09-13T15:34:35.336428+0000","last_active":"2024-09-13T15:51:00.051639+0000","last_peered":"2024-09-13T15:51:00.051639+0000","last_clean":"2024-09-13T15:51:00.051639+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:51:00.051639+0000","last_undegraded":"2024-09-13T15:51:00.051639+0000","last_fullsized":"2024-09-13T15:51:00.051639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094577+0000","last_change":"2024-09-13T15:34:34.955761+0000","last_active":"2024-09-13T15:51:00.094577+0000","last_peered":"2024-09-13T15:51:00.094577+0000","last_clean":"2024-09-13T15:51:00.094577+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:51:00.094577+0000","last_undegraded":"2024-09-13T15:51:00.094577+0000","last_fullsized":"2024-09-13T15:51:00.094577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:37.814369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333727+0000","last_change":"2024-09-13T15:34:35.324328+0000","last_active":"2024-09-13T15:51:00.333727+0000","last_peered":"2024-09-13T15:51:00.333727+0000","last_clean":"2024-09-13T15:51:00.333727+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:51:00.333727+0000","last_undegraded":"2024-09-13T15:51:00.333727+0000","last_fullsized":"2024-09-13T15:51:00.333727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094121+0000","last_change":"2024-09-13T15:34:34.960919+0000","last_active":"2024-09-13T15:51:00.094121+0000","last_peered":"2024-09-13T15:51:00.094121+0000","last_clean":"2024-09-13T15:51:00.094121+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:51:00.094121+0000","last_undegraded":"2024-09-13T15:51:00.094121+0000","last_fullsized":"2024-09-13T15:51:00.094121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:47.211308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044732+0000","last_change":"2024-09-13T15:34:35.339727+0000","last_active":"2024-09-13T15:51:00.044732+0000","last_peered":"2024-09-13T15:51:00.044732+0000","last_clean":"2024-09-13T15:51:00.044732+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:51:00.044732+0000","last_undegraded":"2024-09-13T15:51:00.044732+0000","last_fullsized":"2024-09-13T15:51:00.044732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051805+0000","last_change":"2024-09-13T15:34:34.939804+0000","last_active":"2024-09-13T15:51:00.051805+0000","last_peered":"2024-09-13T15:51:00.051805+0000","last_clean":"2024-09-13T15:51:00.051805+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:51:00.051805+0000","last_undegraded":"2024-09-13T15:51:00.051805+0000","last_fullsized":"2024-09-13T15:51:00.051805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'108","reported_seq":228,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.047957+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:51:00.047957+0000","last_peered":"2024-09-13T15:51:00.047957+0000","last_clean":"2024-09-13T15:51:00.047957+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:51:00.047957+0000","last_undegraded":"2024-09-13T15:51:00.047957+0000","last_fullsized":"2024-09-13T15:51:00.047957+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:42.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062369+0000","last_change":"2024-09-13T15:34:35.333828+0000","last_active":"2024-09-13T15:51:00.062369+0000","last_peered":"2024-09-13T15:51:00.062369+0000","last_clean":"2024-09-13T15:51:00.062369+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:51:00.062369+0000","last_undegraded":"2024-09-13T15:51:00.062369+0000","last_fullsized":"2024-09-13T15:51:00.062369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095286+0000","last_change":"2024-09-13T15:34:34.956621+0000","last_active":"2024-09-13T15:51:00.095286+0000","last_peered":"2024-09-13T15:51:00.095286+0000","last_clean":"2024-09-13T15:51:00.095286+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:51:00.095286+0000","last_undegraded":"2024-09-13T15:51:00.095286+0000","last_fullsized":"2024-09-13T15:51:00.095286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336964+0000","last_change":"2024-09-13T15:34:35.330850+0000","last_active":"2024-09-13T15:51:00.336964+0000","last_peered":"2024-09-13T15:51:00.336964+0000","last_clean":"2024-09-13T15:51:00.336964+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:51:00.336964+0000","last_undegraded":"2024-09-13T15:51:00.336964+0000","last_fullsized":"2024-09-13T15:51:00.336964+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:53.423967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":59,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062130+0000","last_change":"2024-09-13T15:34:34.936361+0000","last_active":"2024-09-13T15:51:00.062130+0000","last_peered":"2024-09-13T15:51:00.062130+0000","last_clean":"2024-09-13T15:51:00.062130+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:51:00.062130+0000","last_undegraded":"2024-09-13T15:51:00.062130+0000","last_fullsized":"2024-09-13T15:51:00.062130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339823+0000","last_change":"2024-09-13T15:34:35.347478+0000","last_active":"2024-09-13T15:51:00.339823+0000","last_peered":"2024-09-13T15:51:00.339823+0000","last_clean":"2024-09-13T15:51:00.339823+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:51:00.339823+0000","last_undegraded":"2024-09-13T15:51:00.339823+0000","last_fullsized":"2024-09-13T15:51:00.339823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.481157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099045+0000","last_change":"2024-09-13T15:34:34.956480+0000","last_active":"2024-09-13T15:51:00.099045+0000","last_peered":"2024-09-13T15:51:00.099045+0000","last_clean":"2024-09-13T15:51:00.099045+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:51:00.099045+0000","last_undegraded":"2024-09-13T15:51:00.099045+0000","last_fullsized":"2024-09-13T15:51:00.099045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099265+0000","last_change":"2024-09-13T15:34:35.338609+0000","last_active":"2024-09-13T15:51:00.099265+0000","last_peered":"2024-09-13T15:51:00.099265+0000","last_clean":"2024-09-13T15:51:00.099265+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:51:00.099265+0000","last_undegraded":"2024-09-13T15:51:00.099265+0000","last_fullsized":"2024-09-13T15:51:00.099265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":60,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339396+0000","last_change":"2024-09-13T15:34:34.959935+0000","last_active":"2024-09-13T15:51:00.339396+0000","last_peered":"2024-09-13T15:51:00.339396+0000","last_clean":"2024-09-13T15:51:00.339396+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:51:00.339396+0000","last_undegraded":"2024-09-13T15:51:00.339396+0000","last_fullsized":"2024-09-13T15:51:00.339396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.342411+0000","last_change":"2024-09-13T15:34:35.335319+0000","last_active":"2024-09-13T15:51:02.342411+0000","last_peered":"2024-09-13T15:51:02.342411+0000","last_clean":"2024-09-13T15:51:02.342411+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:51:02.342411+0000","last_undegraded":"2024-09-13T15:51:02.342411+0000","last_fullsized":"2024-09-13T15:51:02.342411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":67,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094302+0000","last_change":"2024-09-13T15:34:34.959407+0000","last_active":"2024-09-13T15:51:00.094302+0000","last_peered":"2024-09-13T15:51:00.094302+0000","last_clean":"2024-09-13T15:51:00.094302+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:51:00.094302+0000","last_undegraded":"2024-09-13T15:51:00.094302+0000","last_fullsized":"2024-09-13T15:51:00.094302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:31.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.835106+0000","last_change":"2024-09-13T15:34:35.329165+0000","last_active":"2024-09-13T15:51:00.835106+0000","last_peered":"2024-09-13T15:51:00.835106+0000","last_clean":"2024-09-13T15:51:00.835106+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:51:00.835106+0000","last_undegraded":"2024-09-13T15:51:00.835106+0000","last_fullsized":"2024-09-13T15:51:00.835106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333066+0000","last_change":"2024-09-13T15:34:34.954181+0000","last_active":"2024-09-13T15:51:00.333066+0000","last_peered":"2024-09-13T15:51:00.333066+0000","last_clean":"2024-09-13T15:51:00.333066+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:51:00.333066+0000","last_undegraded":"2024-09-13T15:51:00.333066+0000","last_fullsized":"2024-09-13T15:51:00.333066+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.835603+0000","last_change":"2024-09-13T15:34:35.342732+0000","last_active":"2024-09-13T15:51:00.835603+0000","last_peered":"2024-09-13T15:51:00.835603+0000","last_clean":"2024-09-13T15:51:00.835603+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:51:00.835603+0000","last_undegraded":"2024-09-13T15:51:00.835603+0000","last_fullsized":"2024-09-13T15:51:00.835603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095713+0000","last_change":"2024-09-13T15:34:34.957763+0000","last_active":"2024-09-13T15:51:00.095713+0000","last_peered":"2024-09-13T15:51:00.095713+0000","last_clean":"2024-09-13T15:51:00.095713+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:51:00.095713+0000","last_undegraded":"2024-09-13T15:51:00.095713+0000","last_fullsized":"2024-09-13T15:51:00.095713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.105151+0000","last_change":"2024-09-13T15:34:35.334637+0000","last_active":"2024-09-13T15:51:02.105151+0000","last_peered":"2024-09-13T15:51:02.105151+0000","last_clean":"2024-09-13T15:51:02.105151+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:51:02.105151+0000","last_undegraded":"2024-09-13T15:51:02.105151+0000","last_fullsized":"2024-09-13T15:51:02.105151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:43.466895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.335970+0000","last_change":"2024-09-13T15:34:34.942058+0000","last_active":"2024-09-13T15:51:00.335970+0000","last_peered":"2024-09-13T15:51:00.335970+0000","last_clean":"2024-09-13T15:51:00.335970+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:51:00.335970+0000","last_undegraded":"2024-09-13T15:51:00.335970+0000","last_fullsized":"2024-09-13T15:51:00.335970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336293+0000","last_change":"2024-09-13T15:34:35.345452+0000","last_active":"2024-09-13T15:51:00.336293+0000","last_peered":"2024-09-13T15:51:00.336293+0000","last_clean":"2024-09-13T15:51:00.336293+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:51:00.336293+0000","last_undegraded":"2024-09-13T15:51:00.336293+0000","last_fullsized":"2024-09-13T15:51:00.336293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:08:25.983299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095566+0000","last_change":"2024-09-13T15:34:34.955883+0000","last_active":"2024-09-13T15:51:00.095566+0000","last_peered":"2024-09-13T15:51:00.095566+0000","last_clean":"2024-09-13T15:51:00.095566+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:51:00.095566+0000","last_undegraded":"2024-09-13T15:51:00.095566+0000","last_fullsized":"2024-09-13T15:51:00.095566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2638,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.837843+0000","last_change":"2024-09-13T15:34:35.341547+0000","last_active":"2024-09-13T15:51:00.837843+0000","last_peered":"2024-09-13T15:51:00.837843+0000","last_clean":"2024-09-13T15:51:00.837843+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:51:00.837843+0000","last_undegraded":"2024-09-13T15:51:00.837843+0000","last_fullsized":"2024-09-13T15:51:00.837843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062328+0000","last_change":"2024-09-13T15:34:34.949988+0000","last_active":"2024-09-13T15:51:00.062328+0000","last_peered":"2024-09-13T15:51:00.062328+0000","last_clean":"2024-09-13T15:51:00.062328+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:51:00.062328+0000","last_undegraded":"2024-09-13T15:51:00.062328+0000","last_fullsized":"2024-09-13T15:51:00.062328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339867+0000","last_change":"2024-09-13T15:34:35.347690+0000","last_active":"2024-09-13T15:51:00.339867+0000","last_peered":"2024-09-13T15:51:00.339867+0000","last_clean":"2024-09-13T15:51:00.339867+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:51:00.339867+0000","last_undegraded":"2024-09-13T15:51:00.339867+0000","last_fullsized":"2024-09-13T15:51:00.339867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:53.778485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336789+0000","last_change":"2024-09-13T15:34:34.953625+0000","last_active":"2024-09-13T15:51:00.336789+0000","last_peered":"2024-09-13T15:51:00.336789+0000","last_clean":"2024-09-13T15:51:00.336789+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:51:00.336789+0000","last_undegraded":"2024-09-13T15:51:00.336789+0000","last_fullsized":"2024-09-13T15:51:00.336789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099410+0000","last_change":"2024-09-13T15:34:35.338289+0000","last_active":"2024-09-13T15:51:00.099410+0000","last_peered":"2024-09-13T15:51:00.099410+0000","last_clean":"2024-09-13T15:51:00.099410+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:51:00.099410+0000","last_undegraded":"2024-09-13T15:51:00.099410+0000","last_fullsized":"2024-09-13T15:51:00.099410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:34.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.063208+0000","last_change":"2024-09-13T15:34:34.939305+0000","last_active":"2024-09-13T15:51:00.063208+0000","last_peered":"2024-09-13T15:51:00.063208+0000","last_clean":"2024-09-13T15:51:00.063208+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:51:00.063208+0000","last_undegraded":"2024-09-13T15:51:00.063208+0000","last_fullsized":"2024-09-13T15:51:00.063208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.050401+0000","last_change":"2024-09-13T15:34:35.335773+0000","last_active":"2024-09-13T15:51:00.050401+0000","last_peered":"2024-09-13T15:51:00.050401+0000","last_clean":"2024-09-13T15:51:00.050401+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:51:00.050401+0000","last_undegraded":"2024-09-13T15:51:00.050401+0000","last_fullsized":"2024-09-13T15:51:00.050401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.332732+0000","last_change":"2024-09-13T15:34:34.950709+0000","last_active":"2024-09-13T15:51:00.332732+0000","last_peered":"2024-09-13T15:51:00.332732+0000","last_clean":"2024-09-13T15:51:00.332732+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:51:00.332732+0000","last_undegraded":"2024-09-13T15:51:00.332732+0000","last_fullsized":"2024-09-13T15:51:00.332732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094585+0000","last_change":"2024-09-13T15:34:35.340304+0000","last_active":"2024-09-13T15:51:00.094585+0000","last_peered":"2024-09-13T15:51:00.094585+0000","last_clean":"2024-09-13T15:51:00.094585+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:51:00.094585+0000","last_undegraded":"2024-09-13T15:51:00.094585+0000","last_fullsized":"2024-09-13T15:51:00.094585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333255+0000","last_change":"2024-09-13T15:34:34.954475+0000","last_active":"2024-09-13T15:51:00.333255+0000","last_peered":"2024-09-13T15:51:00.333255+0000","last_clean":"2024-09-13T15:51:00.333255+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:51:00.333255+0000","last_undegraded":"2024-09-13T15:51:00.333255+0000","last_fullsized":"2024-09-13T15:51:00.333255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095814+0000","last_change":"2024-09-13T15:34:34.957379+0000","last_active":"2024-09-13T15:51:00.095814+0000","last_peered":"2024-09-13T15:51:00.095814+0000","last_clean":"2024-09-13T15:51:00.095814+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:51:00.095814+0000","last_undegraded":"2024-09-13T15:51:00.095814+0000","last_fullsized":"2024-09-13T15:51:00.095814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336793+0000","last_change":"2024-09-13T15:34:35.331843+0000","last_active":"2024-09-13T15:51:00.336793+0000","last_peered":"2024-09-13T15:51:00.336793+0000","last_clean":"2024-09-13T15:51:00.336793+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:51:00.336793+0000","last_undegraded":"2024-09-13T15:51:00.336793+0000","last_fullsized":"2024-09-13T15:51:00.336793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:43.103418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051973+0000","last_change":"2024-09-13T15:34:34.944458+0000","last_active":"2024-09-13T15:51:00.051973+0000","last_peered":"2024-09-13T15:51:00.051973+0000","last_clean":"2024-09-13T15:51:00.051973+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:51:00.051973+0000","last_undegraded":"2024-09-13T15:51:00.051973+0000","last_fullsized":"2024-09-13T15:51:00.051973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044815+0000","last_change":"2024-09-13T15:34:35.343571+0000","last_active":"2024-09-13T15:51:00.044815+0000","last_peered":"2024-09-13T15:51:00.044815+0000","last_clean":"2024-09-13T15:51:00.044815+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:51:00.044815+0000","last_undegraded":"2024-09-13T15:51:00.044815+0000","last_fullsized":"2024-09-13T15:51:00.044815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.096135+0000","last_change":"2024-09-13T15:34:35.331904+0000","last_active":"2024-09-13T15:51:00.096135+0000","last_peered":"2024-09-13T15:51:00.096135+0000","last_clean":"2024-09-13T15:51:00.096135+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:51:00.096135+0000","last_undegraded":"2024-09-13T15:51:00.096135+0000","last_fullsized":"2024-09-13T15:51:00.096135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094949+0000","last_change":"2024-09-13T15:34:35.335517+0000","last_active":"2024-09-13T15:51:00.094949+0000","last_peered":"2024-09-13T15:51:00.094949+0000","last_clean":"2024-09-13T15:51:00.094949+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:51:00.094949+0000","last_undegraded":"2024-09-13T15:51:00.094949+0000","last_fullsized":"2024-09-13T15:51:00.094949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:58.399592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334061+0000","last_change":"2024-09-13T15:34:35.324690+0000","last_active":"2024-09-13T15:51:00.334061+0000","last_peered":"2024-09-13T15:51:00.334061+0000","last_clean":"2024-09-13T15:51:00.334061+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:51:00.334061+0000","last_undegraded":"2024-09-13T15:51:00.334061+0000","last_fullsized":"2024-09-13T15:51:00.334061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336765+0000","last_change":"2024-09-13T15:34:35.331611+0000","last_active":"2024-09-13T15:51:00.336765+0000","last_peered":"2024-09-13T15:51:00.336765+0000","last_clean":"2024-09-13T15:51:00.336765+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:51:00.336765+0000","last_undegraded":"2024-09-13T15:51:00.336765+0000","last_fullsized":"2024-09-13T15:51:00.336765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:08.881292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.048264+0000","last_change":"2024-09-13T15:35:20.157986+0000","last_active":"2024-09-13T15:51:00.048264+0000","last_peered":"2024-09-13T15:51:00.048264+0000","last_clean":"2024-09-13T15:51:00.048264+0000","last_became_active":"2024-09-13T15:35:20.157317+0000","last_became_peered":"2024-09-13T15:35:20.157317+0000","last_unstale":"2024-09-13T15:51:00.048264+0000","last_undegraded":"2024-09-13T15:51:00.048264+0000","last_fullsized":"2024-09-13T15:51:00.048264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:21.036558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062666+0000","last_change":"2024-09-13T15:34:35.339305+0000","last_active":"2024-09-13T15:51:00.062666+0000","last_peered":"2024-09-13T15:51:00.062666+0000","last_clean":"2024-09-13T15:51:00.062666+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:51:00.062666+0000","last_undegraded":"2024-09-13T15:51:00.062666+0000","last_fullsized":"2024-09-13T15:51:00.062666+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099626+0000","last_change":"2024-09-13T15:34:35.335209+0000","last_active":"2024-09-13T15:51:00.099626+0000","last_peered":"2024-09-13T15:51:00.099626+0000","last_clean":"2024-09-13T15:51:00.099626+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:51:00.099626+0000","last_undegraded":"2024-09-13T15:51:00.099626+0000","last_fullsized":"2024-09-13T15:51:00.099626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099756+0000","last_change":"2024-09-13T15:34:35.336949+0000","last_active":"2024-09-13T15:51:00.099756+0000","last_peered":"2024-09-13T15:51:00.099756+0000","last_clean":"2024-09-13T15:51:00.099756+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:51:00.099756+0000","last_undegraded":"2024-09-13T15:51:00.099756+0000","last_fullsized":"2024-09-13T15:51:00.099756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:45.530761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.332962+0000","last_change":"2024-09-13T15:34:35.327879+0000","last_active":"2024-09-13T15:51:00.332962+0000","last_peered":"2024-09-13T15:51:00.332962+0000","last_clean":"2024-09-13T15:51:00.332962+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:51:00.332962+0000","last_undegraded":"2024-09-13T15:51:00.332962+0000","last_fullsized":"2024-09-13T15:51:00.332962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334238+0000","last_change":"2024-09-13T15:34:35.324523+0000","last_active":"2024-09-13T15:51:00.334238+0000","last_peered":"2024-09-13T15:51:00.334238+0000","last_clean":"2024-09-13T15:51:00.334238+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:51:00.334238+0000","last_undegraded":"2024-09-13T15:51:00.334238+0000","last_fullsized":"2024-09-13T15:51:00.334238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044962+0000","last_change":"2024-09-13T15:34:35.329712+0000","last_active":"2024-09-13T15:51:00.044962+0000","last_peered":"2024-09-13T15:51:00.044962+0000","last_clean":"2024-09-13T15:51:00.044962+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:51:00.044962+0000","last_undegraded":"2024-09-13T15:51:00.044962+0000","last_fullsized":"2024-09-13T15:51:00.044962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051700+0000","last_change":"2024-09-13T15:35:20.156675+0000","last_active":"2024-09-13T15:51:00.051700+0000","last_peered":"2024-09-13T15:51:00.051700+0000","last_clean":"2024-09-13T15:51:00.051700+0000","last_became_active":"2024-09-13T15:35:20.152889+0000","last_became_peered":"2024-09-13T15:35:20.152889+0000","last_unstale":"2024-09-13T15:51:00.051700+0000","last_undegraded":"2024-09-13T15:51:00.051700+0000","last_fullsized":"2024-09-13T15:51:00.051700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:12.515681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.338254+0000","last_change":"2024-09-13T15:34:35.346893+0000","last_active":"2024-09-13T15:51:00.338254+0000","last_peered":"2024-09-13T15:51:00.338254+0000","last_clean":"2024-09-13T15:51:00.338254+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:51:00.338254+0000","last_undegraded":"2024-09-13T15:51:00.338254+0000","last_fullsized":"2024-09-13T15:51:00.338254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:52.439034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336587+0000","last_change":"2024-09-13T15:34:35.324912+0000","last_active":"2024-09-13T15:51:00.336587+0000","last_peered":"2024-09-13T15:51:00.336587+0000","last_clean":"2024-09-13T15:51:00.336587+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:51:00.336587+0000","last_undegraded":"2024-09-13T15:51:00.336587+0000","last_fullsized":"2024-09-13T15:51:00.336587+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.352332+0000","last_change":"2024-09-13T15:34:35.335384+0000","last_active":"2024-09-13T15:51:02.352332+0000","last_peered":"2024-09-13T15:51:02.352332+0000","last_clean":"2024-09-13T15:51:02.352332+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:51:02.352332+0000","last_undegraded":"2024-09-13T15:51:02.352332+0000","last_fullsized":"2024-09-13T15:51:02.352332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.841051+0000","last_change":"2024-09-13T15:34:35.333522+0000","last_active":"2024-09-13T15:51:00.841051+0000","last_peered":"2024-09-13T15:51:00.841051+0000","last_clean":"2024-09-13T15:51:00.841051+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:51:00.841051+0000","last_undegraded":"2024-09-13T15:51:00.841051+0000","last_fullsized":"2024-09-13T15:51:00.841051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.342895+0000","last_change":"2024-09-13T15:34:35.331848+0000","last_active":"2024-09-13T15:51:02.342895+0000","last_peered":"2024-09-13T15:51:02.342895+0000","last_clean":"2024-09-13T15:51:02.342895+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:51:02.342895+0000","last_undegraded":"2024-09-13T15:51:02.342895+0000","last_fullsized":"2024-09-13T15:51:02.342895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.834589+0000","last_change":"2024-09-13T15:34:35.333765+0000","last_active":"2024-09-13T15:51:00.834589+0000","last_peered":"2024-09-13T15:51:00.834589+0000","last_clean":"2024-09-13T15:51:00.834589+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:51:00.834589+0000","last_undegraded":"2024-09-13T15:51:00.834589+0000","last_fullsized":"2024-09-13T15:51:00.834589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.108861+0000","last_change":"2024-09-13T15:34:35.335599+0000","last_active":"2024-09-13T15:51:02.108861+0000","last_peered":"2024-09-13T15:51:02.108861+0000","last_clean":"2024-09-13T15:51:02.108861+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:51:02.108861+0000","last_undegraded":"2024-09-13T15:51:02.108861+0000","last_fullsized":"2024-09-13T15:51:02.108861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:06.605564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.335794+0000","last_change":"2024-09-13T15:34:35.335252+0000","last_active":"2024-09-13T15:51:00.335794+0000","last_peered":"2024-09-13T15:51:00.335794+0000","last_clean":"2024-09-13T15:51:00.335794+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:51:00.335794+0000","last_undegraded":"2024-09-13T15:51:00.335794+0000","last_fullsized":"2024-09-13T15:51:00.335794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:37.432254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.338693+0000","last_change":"2024-09-13T15:34:35.330875+0000","last_active":"2024-09-13T15:51:00.338693+0000","last_peered":"2024-09-13T15:51:00.338693+0000","last_clean":"2024-09-13T15:51:00.338693+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:51:00.338693+0000","last_undegraded":"2024-09-13T15:51:00.338693+0000","last_fullsized":"2024-09-13T15:51:00.338693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:22.297990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336857+0000","last_change":"2024-09-13T15:34:35.331709+0000","last_active":"2024-09-13T15:51:00.336857+0000","last_peered":"2024-09-13T15:51:00.336857+0000","last_clean":"2024-09-13T15:51:00.336857+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:51:00.336857+0000","last_undegraded":"2024-09-13T15:51:00.336857+0000","last_fullsized":"2024-09-13T15:51:00.336857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:17.069173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.338009+0000","last_change":"2024-09-13T15:34:35.319299+0000","last_active":"2024-09-13T15:51:00.338009+0000","last_peered":"2024-09-13T15:51:00.338009+0000","last_clean":"2024-09-13T15:51:00.338009+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:51:00.338009+0000","last_undegraded":"2024-09-13T15:51:00.338009+0000","last_fullsized":"2024-09-13T15:51:00.338009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:16.700428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.069443+0000","last_change":"2024-09-13T15:34:35.345251+0000","last_active":"2024-09-13T15:51:00.069443+0000","last_peered":"2024-09-13T15:51:00.069443+0000","last_clean":"2024-09-13T15:51:00.069443+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:51:00.069443+0000","last_undegraded":"2024-09-13T15:51:00.069443+0000","last_fullsized":"2024-09-13T15:51:00.069443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095085+0000","last_change":"2024-09-13T15:34:35.335400+0000","last_active":"2024-09-13T15:51:00.095085+0000","last_peered":"2024-09-13T15:51:00.095085+0000","last_clean":"2024-09-13T15:51:00.095085+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:51:00.095085+0000","last_undegraded":"2024-09-13T15:51:00.095085+0000","last_fullsized":"2024-09-13T15:51:00.095085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334006+0000","last_change":"2024-09-13T15:34:35.334719+0000","last_active":"2024-09-13T15:51:00.334006+0000","last_peered":"2024-09-13T15:51:00.334006+0000","last_clean":"2024-09-13T15:51:00.334006+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:51:00.334006+0000","last_undegraded":"2024-09-13T15:51:00.334006+0000","last_fullsized":"2024-09-13T15:51:00.334006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:14.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095974+0000","last_change":"2024-09-13T15:34:35.329319+0000","last_active":"2024-09-13T15:51:00.095974+0000","last_peered":"2024-09-13T15:51:00.095974+0000","last_clean":"2024-09-13T15:51:00.095974+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:51:00.095974+0000","last_undegraded":"2024-09-13T15:51:00.095974+0000","last_fullsized":"2024-09-13T15:51:00.095974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336154+0000","last_change":"2024-09-13T15:34:35.327922+0000","last_active":"2024-09-13T15:51:00.336154+0000","last_peered":"2024-09-13T15:51:00.336154+0000","last_clean":"2024-09-13T15:51:00.336154+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:51:00.336154+0000","last_undegraded":"2024-09-13T15:51:00.336154+0000","last_fullsized":"2024-09-13T15:51:00.336154+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:22.066293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095681+0000","last_change":"2024-09-13T15:34:35.330864+0000","last_active":"2024-09-13T15:51:00.095681+0000","last_peered":"2024-09-13T15:51:00.095681+0000","last_clean":"2024-09-13T15:51:00.095681+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:51:00.095681+0000","last_undegraded":"2024-09-13T15:51:00.095681+0000","last_fullsized":"2024-09-13T15:51:00.095681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336165+0000","last_change":"2024-09-13T15:34:35.324580+0000","last_active":"2024-09-13T15:51:00.336165+0000","last_peered":"2024-09-13T15:51:00.336165+0000","last_clean":"2024-09-13T15:51:00.336165+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:51:00.336165+0000","last_undegraded":"2024-09-13T15:51:00.336165+0000","last_fullsized":"2024-09-13T15:51:00.336165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:08.082085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.058052+0000","last_change":"2024-09-13T15:34:35.329279+0000","last_active":"2024-09-13T15:51:00.058052+0000","last_peered":"2024-09-13T15:51:00.058052+0000","last_clean":"2024-09-13T15:51:00.058052+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:51:00.058052+0000","last_undegraded":"2024-09-13T15:51:00.058052+0000","last_fullsized":"2024-09-13T15:51:00.058052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.340148+0000","last_change":"2024-09-13T15:34:35.347293+0000","last_active":"2024-09-13T15:51:00.340148+0000","last_peered":"2024-09-13T15:51:00.340148+0000","last_clean":"2024-09-13T15:51:00.340148+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:51:00.340148+0000","last_undegraded":"2024-09-13T15:51:00.340148+0000","last_fullsized":"2024-09-13T15:51:00.340148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:52.388403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3436,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738571,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148124,"kb_used_data":48912,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94223716,"statfs":{"total":96636764160,"available":96485085184,"internally_reserved":0,"allocated":50085888,"data_stored":38240820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.42999999999999999},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.152},"max":{"1min":0.65600000000000003,"5min":0.83899999999999997,"15min":3.4550000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.46300000000000002},"min":{"1min":0.32300000000000001,"5min":0.248,"15min":0.18099999999999999},"max":{"1min":0.76900000000000002,"5min":0.97499999999999998,"15min":6.1989999999999998},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53600000000000003,"15min":0.46300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.185},"max":{"1min":0.82699999999999996,"5min":1.006,"15min":1.4790000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.495},"min":{"1min":0.31,"5min":0.30299999999999999,"15min":0.17799999999999999},"max":{"1min":0.73199999999999998,"5min":1.0589999999999999,"15min":1.399},"last":0.58399999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738570,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335876,"kb_used_data":188272,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":94035964,"statfs":{"total":96636764160,"available":96292827136,"internally_reserved":0,"allocated":192790528,"data_stored":179551003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45600000000000002,"15min":0.41599999999999998},"min":{"1min":0.26900000000000002,"5min":0.214,"15min":0.159},"max":{"1min":0.64700000000000002,"5min":0.69599999999999995,"15min":4.2400000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.432},"min":{"1min":0.33900000000000002,"5min":0.20399999999999999,"15min":0.17100000000000001},"max":{"1min":0.70399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.443},"min":{"1min":0.42099999999999999,"5min":0.26400000000000001,"15min":0.17199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.82999999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57299999999999995,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.253,"15min":0.189},"max":{"1min":0.86099999999999999,"5min":0.93000000000000005,"15min":1.2789999999999999},"last":0.86099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738572,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187712,"kb_used_data":30260,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94184128,"statfs":{"total":96636764160,"available":96444547072,"internally_reserved":0,"allocated":30986240,"data_stored":20392376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":161216966},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47899999999999998,"15min":0.40799999999999997},"min":{"1min":0.28399999999999997,"5min":0.20399999999999999,"15min":0.158},"max":{"1min":0.755,"5min":0.80900000000000005,"15min":0.873},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.42699999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.186},"max":{"1min":0.68200000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53700000000000003,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.17899999999999999},"max":{"1min":0.77400000000000002,"5min":0.82099999999999995,"15min":9.4610000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.48599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.20300000000000001},"max":{"1min":0.67700000000000005,"5min":0.84899999999999998,"15min":0.90700000000000003},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:51:04.463 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:51:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.592+0000 7f86221c5640 1 Processor -- start 2024-09-13T15:51:04.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.592+0000 7f86221c5640 1 -- start start 2024-09-13T15:51:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f86221c5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f861c0bebb0 0x7f861c0a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f86221c5640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861c1515b0 con 0x7f861c0b4010 2024-09-13T15:51:04.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f86221c5640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861c14e2c0 con 0x7f861c0bebb0 2024-09-13T15:51:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f861b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f861c0bebb0 0x7f861c0a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f861b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f861c0bebb0 0x7f861c0a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35818/0 (socket says 172.21.15.40:35818) 2024-09-13T15:51:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f861b7fe640 1 -- 172.21.15.40:0/172397116 learned_addr learned my addr 172.21.15.40:0/172397116 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f8613fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f861c0b4010 0x7f861c06e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59466/0 (socket says 172.21.15.40:59466) 2024-09-13T15:51:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f861b7fe640 1 -- 172.21.15.40:0/172397116 >> v1:172.21.15.40:6789/0 conn(0x7f861c0b4010 legacy=0x7f861c06e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f861b7fe640 1 -- 172.21.15.40:0/172397116 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c06f830 con 0x7f861c0bebb0 2024-09-13T15:51:04.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f861affd640 1 -- 172.21.15.40:0/172397116 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020116612 0 0) 0x7f861c1515b0 con 0x7f861c0b4010 2024-09-13T15:51:04.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f861b7fe640 1 --2- 172.21.15.40:0/172397116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c0bebb0 0x7f861c0a4d70 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f860c0097f0 tx=0x7f860c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04e70977a4d88dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:04.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f861affd640 1 -- 172.21.15.40:0/172397116 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f861c0b6bc0 con 0x7f861c0bebb0 2024-09-13T15:51:04.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f861affd640 1 -- 172.21.15.40:0/172397116 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c0a7050 con 0x7f861c0bebb0 2024-09-13T15:51:04.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f861affd640 1 -- 172.21.15.40:0/172397116 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f860c0ab680 con 0x7f861c0bebb0 2024-09-13T15:51:04.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f86221c5640 1 -- 172.21.15.40:0/172397116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c0bebb0 msgr2=0x7f861c0a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:04.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f86221c5640 1 --2- 172.21.15.40:0/172397116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c0bebb0 0x7f861c0a4d70 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f860c0097f0 tx=0x7f860c01c4e0 comp rx=0 tx=0).stop 2024-09-13T15:51:04.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f86221c5640 1 -- 172.21.15.40:0/172397116 shutdown_connections 2024-09-13T15:51:04.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f86221c5640 1 --2- 172.21.15.40:0/172397116 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c0bebb0 0x7f861c0a4d70 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:04.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f86221c5640 1 -- 172.21.15.40:0/172397116 >> 172.21.15.40:0/172397116 conn(0x7f861c06a540 msgr2=0x7f861c0a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:04.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f86221c5640 1 -- 172.21.15.40:0/172397116 shutdown_connections 2024-09-13T15:51:04.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.596+0000 7f86221c5640 1 -- 172.21.15.40:0/172397116 wait complete. 2024-09-13T15:51:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f86221c5640 1 Processor -- start 2024-09-13T15:51:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f86221c5640 1 -- start start 2024-09-13T15:51:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f86221c5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c0b4010 0x7f861c147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:04.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f86221c5640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c143f10 con 0x7f861c0b4010 2024-09-13T15:51:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f861b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c0b4010 0x7f861c147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f861b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c0b4010 0x7f861c147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35824/0 (socket says 172.21.15.40:35824) 2024-09-13T15:51:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f861b7fe640 1 -- 172.21.15.40:0/1342325885 learned_addr learned my addr 172.21.15.40:0/1342325885 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f861b7fe640 1 -- 172.21.15.40:0/1342325885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0094d0 con 0x7f861c0b4010 2024-09-13T15:51:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f861b7fe640 1 --2- 172.21.15.40:0/1342325885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c0b4010 0x7f861c147f70 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f860c01a110 tx=0x7f860c01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f8618ff9640 1 -- 172.21.15.40:0/1342325885 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f860c0b6550 con 0x7f861c0b4010 2024-09-13T15:51:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f8618ff9640 1 -- 172.21.15.40:0/1342325885 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c0b66b0 con 0x7f861c0b4010 2024-09-13T15:51:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f86221c5640 1 -- 172.21.15.40:0/1342325885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861c147870 con 0x7f861c0b4010 2024-09-13T15:51:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f8618ff9640 1 -- 172.21.15.40:0/1342325885 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f860c0b6970 con 0x7f861c0b4010 2024-09-13T15:51:04.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f86221c5640 1 -- 172.21.15.40:0/1342325885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861c147cf0 con 0x7f861c0b4010 2024-09-13T15:51:04.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f8618ff9640 1 -- 172.21.15.40:0/1342325885 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f860c0b2040 con 0x7f861c0b4010 2024-09-13T15:51:04.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f8618ff9640 1 --2- 172.21.15.40:0/1342325885 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f85fc035530 0x7f85fc0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:04.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f8618ff9640 1 -- 172.21.15.40:0/1342325885 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f860c0e2980 con 0x7f861c0b4010 2024-09-13T15:51:04.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f86221c5640 1 -- 172.21.15.40:0/1342325885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861c1484b0 con 0x7f861c0b4010 2024-09-13T15:51:04.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f8613fff640 1 --2- 172.21.15.40:0/1342325885 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f85fc035530 0x7f85fc0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:04.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.600+0000 7f8613fff640 1 --2- 172.21.15.40:0/1342325885 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f85fc035530 0x7f85fc0379f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8604007fd0 tx=0x7f8604007940 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:04.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.608+0000 7f8618ff9640 1 -- 172.21.15.40:0/1342325885 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f860c0b0020 con 0x7f861c0b4010 2024-09-13T15:51:04.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.768+0000 7f86221c5640 1 -- 172.21.15.40:0/1342325885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f861c0a4d70 con 0x7f861c0b4010 2024-09-13T15:51:04.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.768+0000 7f8618ff9640 1 -- 172.21.15.40:0/1342325885 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+13015 (secure 0 0 0) 0x7f860c0cd090 con 0x7f861c0b4010 2024-09-13T15:51:04.773 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:51:04.774 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":58,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:51:03.098535+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.2699999809265137,"score_stable":1.2699999809265137,"optimal_score":1,"raw_score_acting":1.2699999809265137,"raw_score_stable":1.2699999809265137,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1c","mappings":[{"from":0,"to":2}]},{"pgid":"3.24","mappings":[{"from":0,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/2772625282":"2024-09-13T16:50:59.680754+0000","172.21.15.40:6832/3545499514":"2024-09-14T15:51:00.082976+0000","172.21.15.40:6831/3545499514":"2024-09-14T15:51:00.082976+0000","172.21.15.40:0/2310847763":"2024-09-13T16:50:58.674341+0000","172.21.15.40:6833/3266942466":"2024-09-14T15:50:56.633962+0000","172.21.15.40:0/3574317467":"2024-09-13T16:50:27.040813+0000","172.21.15.40:0/3464899269":"2024-09-13T16:49:52.021920+0000","172.21.15.40:0/2020191347":"2024-09-13T16:39:12.695853+0000","172.21.15.40:0/3215060720":"2024-09-13T16:37:48.656072+0000","172.21.15.40:0/2096071371":"2024-09-13T16:41:43.833379+0000","172.21.15.40:0/1024811135":"2024-09-13T16:46:02.884335+0000","172.21.15.40:0/1371435748":"2024-09-13T16:49:08.427332+0000","172.21.15.40:0/1725367853":"2024-09-13T16:38:36.652988+0000","172.21.15.40:0/2070755866":"2024-09-13T16:38:12.598575+0000","172.21.15.40:0/695475091":"2024-09-13T16:40:02.785567+0000","172.21.15.40:0/276304017":"2024-09-13T16:45:37.498754+0000","172.21.15.40:0/3286012502":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/2241829794":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/2301478808":"2024-09-13T16:40:27.738146+0000","172.21.15.40:0/2561014458":"2024-09-13T16:50:58.307880+0000","172.21.15.40:6824/3185150828":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/690822190":"2024-09-13T16:39:37.683949+0000","172.21.15.40:0/414904326":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/3777702470":"2024-09-13T16:43:17.229644+0000","172.21.15.40:0/3514360215":"2024-09-13T16:44:32.325869+0000","172.21.15.40:0/3853947452":"2024-09-13T16:46:26.907170+0000","172.21.15.40:0/1991235795":"2024-09-13T16:40:52.760615+0000","172.21.15.40:6825/3185150828":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/1455634917":"2024-09-13T16:47:13.340610+0000","172.21.15.40:0/2753473479":"2024-09-13T16:42:16.865910+0000","172.21.15.40:0/3230130657":"2024-09-13T16:42:51.908956+0000","172.21.15.40:6830/3266942466":"2024-09-14T15:50:56.633962+0000","172.21.15.40:0/3833267415":"2024-09-13T16:48:42.495533+0000","172.21.15.40:0/1708466797":"2024-09-13T16:43:42.271124+0000","172.21.15.40:0/3629684271":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/3494260782":"2024-09-13T16:41:17.861368+0000","172.21.15.40:0/1861863246":"2024-09-13T16:44:07.288889+0000","172.21.15.40:0/1129415438":"2024-09-13T16:47:37.323733+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:51:04.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.772+0000 7f86221c5640 1 -- 172.21.15.40:0/1342325885 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f85fc035530 msgr2=0x7f85fc0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.772+0000 7f86221c5640 1 --2- 172.21.15.40:0/1342325885 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f85fc035530 0x7f85fc0379f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8604007fd0 tx=0x7f8604007940 comp rx=0 tx=0).stop 2024-09-13T15:51:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.772+0000 7f86221c5640 1 -- 172.21.15.40:0/1342325885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c0b4010 msgr2=0x7f861c147f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.772+0000 7f86221c5640 1 --2- 172.21.15.40:0/1342325885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c0b4010 0x7f861c147f70 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f860c01a110 tx=0x7f860c01ad20 comp rx=0 tx=0).stop 2024-09-13T15:51:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.772+0000 7f86221c5640 1 -- 172.21.15.40:0/1342325885 shutdown_connections 2024-09-13T15:51:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.772+0000 7f86221c5640 1 --2- 172.21.15.40:0/1342325885 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f85fc035530 0x7f85fc0379f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.772+0000 7f86221c5640 1 --2- 172.21.15.40:0/1342325885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f861c0b4010 0x7f861c147f70 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.772+0000 7f86221c5640 1 -- 172.21.15.40:0/1342325885 >> 172.21.15.40:0/1342325885 conn(0x7f861c06a540 msgr2=0x7f861c0b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.772+0000 7f86221c5640 1 -- 172.21.15.40:0/1342325885 shutdown_connections 2024-09-13T15:51:04.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:04.772+0000 7f86221c5640 1 -- 172.21.15.40:0/1342325885 wait complete. 2024-09-13T15:51:05.795 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T15:51:05.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:51:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.936+0000 7f2dd1f85640 1 Processor -- start 2024-09-13T15:51:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.936+0000 7f2dd1f85640 1 -- start start 2024-09-13T15:51:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.936+0000 7f2dd1f85640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2dcc0ba8a0 0x7f2dcc0beb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.936+0000 7f2dd1f85640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dcc06d140 con 0x7f2dcc0ba4c0 2024-09-13T15:51:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.936+0000 7f2dd1f85640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dcc06cad0 con 0x7f2dcc0ba8a0 2024-09-13T15:51:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.936+0000 7f2dc2ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2dcc0ba8a0 0x7f2dcc0beb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.936+0000 7f2dc2ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2dcc0ba8a0 0x7f2dcc0beb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35840/0 (socket says 172.21.15.40:35840) 2024-09-13T15:51:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.936+0000 7f2dc2ffd640 1 -- 172.21.15.40:0/741187629 learned_addr learned my addr 172.21.15.40:0/741187629 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.936+0000 7f2dc2ffd640 1 -- 172.21.15.40:0/741187629 >> v1:172.21.15.40:6789/0 conn(0x7f2dcc0ba4c0 legacy=0x7f2dcc0c0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.936+0000 7f2dc2ffd640 1 -- 172.21.15.40:0/741187629 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc0bf080 con 0x7f2dcc0ba8a0 2024-09-13T15:51:05.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dc2ffd640 1 --2- 172.21.15.40:0/741187629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc0ba8a0 0x7f2dcc0beb40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f2db40097f0 tx=0x7f2db401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116b112052b6e86a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:05.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dcaffd640 1 -- 172.21.15.40:0/741187629 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2db40ab530 con 0x7f2dcc0ba8a0 2024-09-13T15:51:05.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dcaffd640 1 -- 172.21.15.40:0/741187629 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db40a7050 con 0x7f2dcc0ba8a0 2024-09-13T15:51:05.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dcaffd640 1 -- 172.21.15.40:0/741187629 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2db40ab7e0 con 0x7f2dcc0ba8a0 2024-09-13T15:51:05.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dd1f85640 1 -- 172.21.15.40:0/741187629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc0ba8a0 msgr2=0x7f2dcc0beb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:05.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dd1f85640 1 --2- 172.21.15.40:0/741187629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc0ba8a0 0x7f2dcc0beb40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f2db40097f0 tx=0x7f2db401c4e0 comp rx=0 tx=0).stop 2024-09-13T15:51:05.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dd1f85640 1 -- 172.21.15.40:0/741187629 shutdown_connections 2024-09-13T15:51:05.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dd1f85640 1 --2- 172.21.15.40:0/741187629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc0ba8a0 0x7f2dcc0beb40 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:05.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dd1f85640 1 -- 172.21.15.40:0/741187629 >> 172.21.15.40:0/741187629 conn(0x7f2dcc065d40 msgr2=0x7f2dcc066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:05.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dd1f85640 1 -- 172.21.15.40:0/741187629 shutdown_connections 2024-09-13T15:51:05.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dd1f85640 1 -- 172.21.15.40:0/741187629 wait complete. 2024-09-13T15:51:05.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dd1f85640 1 Processor -- start 2024-09-13T15:51:05.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dd1f85640 1 -- start start 2024-09-13T15:51:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dd1f85640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc0ba4c0 0x7f2dcc161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.940+0000 7f2dd1f85640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc161920 con 0x7f2dcc0ba4c0 2024-09-13T15:51:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dcb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc0ba4c0 0x7f2dcc161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dcb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc0ba4c0 0x7f2dcc161330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35850/0 (socket says 172.21.15.40:35850) 2024-09-13T15:51:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dcb7fe640 1 -- 172.21.15.40:0/1372334915 learned_addr learned my addr 172.21.15.40:0/1372334915 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dcb7fe640 1 -- 172.21.15.40:0/1372334915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db40094d0 con 0x7f2dcc0ba4c0 2024-09-13T15:51:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dcb7fe640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc0ba4c0 0x7f2dcc161330 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00c480 tx=0x7f2dbc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dc8ff9640 1 -- 172.21.15.40:0/1372334915 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dbc005150 con 0x7f2dcc0ba4c0 2024-09-13T15:51:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dc8ff9640 1 -- 172.21.15.40:0/1372334915 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dbc0052b0 con 0x7f2dcc0ba4c0 2024-09-13T15:51:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dd1f85640 1 -- 172.21.15.40:0/1372334915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dcc15f490 con 0x7f2dcc0ba4c0 2024-09-13T15:51:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dc8ff9640 1 -- 172.21.15.40:0/1372334915 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2dbc007030 con 0x7f2dcc0ba4c0 2024-09-13T15:51:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dd1f85640 1 -- 172.21.15.40:0/1372334915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc15d570 con 0x7f2dcc0ba4c0 2024-09-13T15:51:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dd1f85640 1 -- 172.21.15.40:0/1372334915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2dcc154360 con 0x7f2dcc0ba4c0 2024-09-13T15:51:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dc8ff9640 1 -- 172.21.15.40:0/1372334915 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f2dbc007190 con 0x7f2dcc0ba4c0 2024-09-13T15:51:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dc8ff9640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2dac035530 0x7f2dac0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dc8ff9640 1 -- 172.21.15.40:0/1372334915 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f2dbc047320 con 0x7f2dcc0ba4c0 2024-09-13T15:51:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dc8ff9640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] conn(0x7f2dac03d430 0x7f2dac03f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dc8ff9640 1 -- 172.21.15.40:0/1372334915 --> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2dac03ffa0 con 0x7f2dac03d430 2024-09-13T15:51:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dc8ff9640 1 -- 172.21.15.40:0/1372334915 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dbc047620 con 0x7f2dcc0ba4c0 2024-09-13T15:51:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dc2ffd640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2dac035530 0x7f2dac0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dcbfff640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] conn(0x7f2dac03d430 0x7f2dac03f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dc2ffd640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2dac035530 0x7f2dac0379f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2db40ad000 tx=0x7f2db40a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dcbfff640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] conn(0x7f2dac03d430 0x7f2dac03f8d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.944+0000 7f2dc8ff9640 1 -- 172.21.15.40:0/1372334915 <== osd.0 v2:172.21.15.40:6808/3314126899 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2dac03ffa0 con 0x7f2dac03d430 2024-09-13T15:51:05.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 -- 172.21.15.40:0/1372334915 --> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2dcc0bfae0 con 0x7f2dac03d430 2024-09-13T15:51:05.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dc8ff9640 1 -- 172.21.15.40:0/1372334915 <== osd.0 v2:172.21.15.40:6808/3314126899 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2dc4011040 con 0x7f2dac03d430 2024-09-13T15:51:05.963 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-13T15:51:05.963 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:51:05.963 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-13T15:51:05.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 -- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] conn(0x7f2dac03d430 msgr2=0x7f2dac03f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:05.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] conn(0x7f2dac03d430 0x7f2dac03f8d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:05.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 -- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2dac035530 msgr2=0x7f2dac0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:05.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2dac035530 0x7f2dac0379f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2db40ad000 tx=0x7f2db40a6000 comp rx=0 tx=0).stop 2024-09-13T15:51:05.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 -- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc0ba4c0 msgr2=0x7f2dcc161330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc0ba4c0 0x7f2dcc161330 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00c480 tx=0x7f2dbc00c940 comp rx=0 tx=0).stop 2024-09-13T15:51:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 -- 172.21.15.40:0/1372334915 shutdown_connections 2024-09-13T15:51:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:6808/3314126899,v1:172.21.15.40:6809/3314126899] conn(0x7f2dac03d430 0x7f2dac03f8d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2dac035530 0x7f2dac0379f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 --2- 172.21.15.40:0/1372334915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2dcc0ba4c0 0x7f2dcc161330 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 -- 172.21.15.40:0/1372334915 >> 172.21.15.40:0/1372334915 conn(0x7f2dcc065d40 msgr2=0x7f2dcc0c2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 -- 172.21.15.40:0/1372334915 shutdown_connections 2024-09-13T15:51:05.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:05.960+0000 7f2dd1f85640 1 -- 172.21.15.40:0/1372334915 wait complete. 2024-09-13T15:51:05.981 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T15:51:06.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.100+0000 7fb0d0854640 1 Processor -- start 2024-09-13T15:51:06.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.100+0000 7fb0d0854640 1 -- start start 2024-09-13T15:51:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.100+0000 7fb0d0854640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb0cc06b6a0 0x7fb0cc0bdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.100+0000 7fb0d0854640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0cc0bec50 con 0x7fb0cc0b3f70 2024-09-13T15:51:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.100+0000 7fb0d0854640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0cc0bf080 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.100+0000 7fb0ca59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb0cc06b6a0 0x7fb0cc0bdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.100+0000 7fb0ca59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb0cc06b6a0 0x7fb0cc0bdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35852/0 (socket says 172.21.15.40:35852) 2024-09-13T15:51:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.100+0000 7fb0c9d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb0cc0b3f70 0x7fb0cc0b5330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59490/0 (socket says 172.21.15.40:59490) 2024-09-13T15:51:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.100+0000 7fb0ca59c640 1 -- 172.21.15.40:0/3187424804 learned_addr learned my addr 172.21.15.40:0/3187424804 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.100+0000 7fb0ca59c640 1 -- 172.21.15.40:0/3187424804 >> v1:172.21.15.40:6789/0 conn(0x7fb0cc0b3f70 legacy=0x7fb0cc0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.100+0000 7fb0ca59c640 1 -- 172.21.15.40:0/3187424804 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc0b63d0 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.104+0000 7fb0ca59c640 1 --2- 172.21.15.40:0/3187424804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0cc06b6a0 0x7fb0cc0bdf20 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0097f0 tx=0x7fb0bc01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca19b3d592779c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.104+0000 7fb0c959a640 1 -- 172.21.15.40:0/3187424804 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0bc0aa570 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.104+0000 7fb0c959a640 1 -- 172.21.15.40:0/3187424804 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc0aa6d0 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.104+0000 7fb0c959a640 1 -- 172.21.15.40:0/3187424804 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0bc0aa990 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.104+0000 7fb0d0854640 1 -- 172.21.15.40:0/3187424804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0cc06b6a0 msgr2=0x7fb0cc0bdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.104+0000 7fb0d0854640 1 --2- 172.21.15.40:0/3187424804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0cc06b6a0 0x7fb0cc0bdf20 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0097f0 tx=0x7fb0bc01c4c0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.104+0000 7fb0d0854640 1 -- 172.21.15.40:0/3187424804 shutdown_connections 2024-09-13T15:51:06.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.104+0000 7fb0d0854640 1 --2- 172.21.15.40:0/3187424804 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0cc06b6a0 0x7fb0cc0bdf20 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.104+0000 7fb0d0854640 1 -- 172.21.15.40:0/3187424804 >> 172.21.15.40:0/3187424804 conn(0x7fb0cc06a370 msgr2=0x7fb0cc06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:06.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.104+0000 7fb0d0854640 1 -- 172.21.15.40:0/3187424804 shutdown_connections 2024-09-13T15:51:06.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.104+0000 7fb0d0854640 1 -- 172.21.15.40:0/3187424804 wait complete. 2024-09-13T15:51:06.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0d0854640 1 Processor -- start 2024-09-13T15:51:06.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0d0854640 1 -- start start 2024-09-13T15:51:06.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0d0854640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0cc06b6a0 0x7fb0cc15d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0d0854640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc1e9d40 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0ca59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0cc06b6a0 0x7fb0cc15d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0ca59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0cc06b6a0 0x7fb0cc15d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35868/0 (socket says 172.21.15.40:35868) 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0ca59c640 1 -- 172.21.15.40:0/3050255979 learned_addr learned my addr 172.21.15.40:0/3050255979 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0ca59c640 1 -- 172.21.15.40:0/3050255979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc0094d0 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0ca59c640 1 --2- 172.21.15.40:0/3050255979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0cc06b6a0 0x7fb0cc15d580 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0190d0 tx=0x7fb0bc01ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0baffd640 1 -- 172.21.15.40:0/3050255979 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0bc0bd3f0 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0baffd640 1 -- 172.21.15.40:0/3050255979 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc0bd570 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0d0854640 1 -- 172.21.15.40:0/3050255979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0cc15caf0 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0baffd640 1 -- 172.21.15.40:0/3050255979 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0bc0bd850 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0d0854640 1 -- 172.21.15.40:0/3050255979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0cc15fd00 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0baffd640 1 -- 172.21.15.40:0/3050255979 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7fb0bc0a8050 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0d0854640 1 -- 172.21.15.40:0/3050255979 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0cc0b6d20 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0baffd640 1 --2- 172.21.15.40:0/3050255979 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb0ac035530 0x7fb0ac0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0baffd640 1 -- 172.21.15.40:0/3050255979 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7fb0bc0e26a0 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0c9d9b640 1 --2- 172.21.15.40:0/3050255979 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb0ac035530 0x7fb0ac0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.108+0000 7fb0c9d9b640 1 --2- 172.21.15.40:0/3050255979 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb0ac035530 0x7fb0ac0379f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0001600 tx=0x7fb0c0007a50 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.112+0000 7fb0baffd640 1 -- 172.21.15.40:0/3050255979 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0bc0a97b0 con 0x7fb0cc06b6a0 2024-09-13T15:51:06.276 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.272+0000 7fb0d0854640 1 -- 172.21.15.40:0/3050255979 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0cc15fef0 con 0x7fb0ac035530 2024-09-13T15:51:06.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.272+0000 7fb0baffd640 1 -- 172.21.15.40:0/3050255979 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb0cc15fef0 con 0x7fb0ac035530 2024-09-13T15:51:06.277 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T15:51:06.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.276+0000 7fb0d0854640 1 -- 172.21.15.40:0/3050255979 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb0ac035530 msgr2=0x7fb0ac0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.276+0000 7fb0d0854640 1 --2- 172.21.15.40:0/3050255979 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb0ac035530 0x7fb0ac0379f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0001600 tx=0x7fb0c0007a50 comp rx=0 tx=0).stop 2024-09-13T15:51:06.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.276+0000 7fb0d0854640 1 -- 172.21.15.40:0/3050255979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0cc06b6a0 msgr2=0x7fb0cc15d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.276+0000 7fb0d0854640 1 --2- 172.21.15.40:0/3050255979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0cc06b6a0 0x7fb0cc15d580 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0190d0 tx=0x7fb0bc01ad00 comp rx=0 tx=0).stop 2024-09-13T15:51:06.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.276+0000 7fb0d0854640 1 -- 172.21.15.40:0/3050255979 shutdown_connections 2024-09-13T15:51:06.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.276+0000 7fb0d0854640 1 --2- 172.21.15.40:0/3050255979 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb0ac035530 0x7fb0ac0379f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.276+0000 7fb0d0854640 1 --2- 172.21.15.40:0/3050255979 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0cc06b6a0 0x7fb0cc15d580 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.276+0000 7fb0d0854640 1 -- 172.21.15.40:0/3050255979 >> 172.21.15.40:0/3050255979 conn(0x7fb0cc06a370 msgr2=0x7fb0cc14ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:06.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.276+0000 7fb0d0854640 1 -- 172.21.15.40:0/3050255979 shutdown_connections 2024-09-13T15:51:06.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.276+0000 7fb0d0854640 1 -- 172.21.15.40:0/3050255979 wait complete. 2024-09-13T15:51:06.295 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T15:51:06.295 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:51:06.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.412+0000 7f42276b3640 1 Processor -- start 2024-09-13T15:51:06.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.412+0000 7f42276b3640 1 -- start start 2024-09-13T15:51:06.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.412+0000 7f42276b3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f422006f400 0x7f42200b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.412+0000 7f42276b3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42200b48d0 con 0x7f422014f3d0 2024-09-13T15:51:06.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.412+0000 7f42276b3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42200b5240 con 0x7f422006f400 2024-09-13T15:51:06.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.412+0000 7f422544f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f422014f3d0 0x7f422006e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59498/0 (socket says 172.21.15.40:59498) 2024-09-13T15:51:06.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.412+0000 7f4224c4e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f422006f400 0x7f42200b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.412+0000 7f422544f640 1 -- 172.21.15.40:0/577162040 learned_addr learned my addr 172.21.15.40:0/577162040 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:51:06.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.412+0000 7f4224c4e640 1 -- 172.21.15.40:0/577162040 >> v1:172.21.15.40:6789/0 conn(0x7f422014f3d0 legacy=0x7f422006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.412+0000 7f4224c4e640 1 -- 172.21.15.40:0/577162040 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422014e7b0 con 0x7f422006f400 2024-09-13T15:51:06.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f4224c4e640 1 --2- 172.21.15.40:0/577162040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422006f400 0x7f42200b4d00 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f421000a8e0 tx=0x7f421001d760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696286a4e1630f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f4217fff640 1 -- 172.21.15.40:0/577162040 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42100a7600 con 0x7f422006f400 2024-09-13T15:51:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f4217fff640 1 -- 172.21.15.40:0/577162040 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42100a7760 con 0x7f422006f400 2024-09-13T15:51:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f4217fff640 1 -- 172.21.15.40:0/577162040 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f42100a7a20 con 0x7f422006f400 2024-09-13T15:51:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f42276b3640 1 -- 172.21.15.40:0/577162040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422006f400 msgr2=0x7f42200b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f42276b3640 1 --2- 172.21.15.40:0/577162040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422006f400 0x7f42200b4d00 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f421000a8e0 tx=0x7f421001d760 comp rx=0 tx=0).stop 2024-09-13T15:51:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f42276b3640 1 -- 172.21.15.40:0/577162040 shutdown_connections 2024-09-13T15:51:06.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f42276b3640 1 --2- 172.21.15.40:0/577162040 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422006f400 0x7f42200b4d00 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f42276b3640 1 -- 172.21.15.40:0/577162040 >> 172.21.15.40:0/577162040 conn(0x7f422006a540 msgr2=0x7f42200a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:06.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f42276b3640 1 -- 172.21.15.40:0/577162040 shutdown_connections 2024-09-13T15:51:06.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f42276b3640 1 -- 172.21.15.40:0/577162040 wait complete. 2024-09-13T15:51:06.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f42276b3640 1 Processor -- start 2024-09-13T15:51:06.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f42276b3640 1 -- start start 2024-09-13T15:51:06.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f42276b3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422006f400 0x7f4220147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f42276b3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422009a5d0 con 0x7f422006f400 2024-09-13T15:51:06.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f422544f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422006f400 0x7f4220147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f422544f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422006f400 0x7f4220147040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35878/0 (socket says 172.21.15.40:35878) 2024-09-13T15:51:06.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f422544f640 1 -- 172.21.15.40:0/4088176226 learned_addr learned my addr 172.21.15.40:0/4088176226 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:06.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f422544f640 1 -- 172.21.15.40:0/4088176226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421000a5c0 con 0x7f422006f400 2024-09-13T15:51:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.416+0000 7f422544f640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422006f400 0x7f4220147040 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f421c00c430 tx=0x7f421c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4215ffb640 1 -- 172.21.15.40:0/4088176226 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f421c005c20 con 0x7f422006f400 2024-09-13T15:51:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4215ffb640 1 -- 172.21.15.40:0/4088176226 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c005d80 con 0x7f422006f400 2024-09-13T15:51:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f42276b3640 1 -- 172.21.15.40:0/4088176226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42200b9d00 con 0x7f422006f400 2024-09-13T15:51:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4215ffb640 1 -- 172.21.15.40:0/4088176226 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f421c0071a0 con 0x7f422006f400 2024-09-13T15:51:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f42276b3640 1 -- 172.21.15.40:0/4088176226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42200b9a90 con 0x7f422006f400 2024-09-13T15:51:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f42276b3640 1 -- 172.21.15.40:0/4088176226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42200b4d00 con 0x7f422006f400 2024-09-13T15:51:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4215ffb640 1 -- 172.21.15.40:0/4088176226 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f421c007300 con 0x7f422006f400 2024-09-13T15:51:06.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4215ffb640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4204035530 0x7f42040379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4215ffb640 1 -- 172.21.15.40:0/4088176226 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f421c047300 con 0x7f422006f400 2024-09-13T15:51:06.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4224c4e640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4204035530 0x7f42040379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4215ffb640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] conn(0x7f420403d430 0x7f420403f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4215ffb640 1 -- 172.21.15.40:0/4088176226 --> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f420403ffa0 con 0x7f420403d430 2024-09-13T15:51:06.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4215ffb640 1 -- 172.21.15.40:0/4088176226 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f421c049970 con 0x7f422006f400 2024-09-13T15:51:06.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4225c50640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] conn(0x7f420403d430 0x7f420403f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4224c4e640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4204035530 0x7f42040379f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f42100b0000 tx=0x7f4210008040 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4225c50640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] conn(0x7f420403d430 0x7f420403f8d0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.420+0000 7f4215ffb640 1 -- 172.21.15.40:0/4088176226 <== osd.1 v2:172.21.15.40:6800/884315373 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f420403ffa0 con 0x7f420403d430 2024-09-13T15:51:06.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 -- 172.21.15.40:0/4088176226 --> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f42200a3030 con 0x7f420403d430 2024-09-13T15:51:06.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f4215ffb640 1 -- 172.21.15.40:0/4088176226 <== osd.1 v2:172.21.15.40:6800/884315373 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f42200a3030 con 0x7f420403d430 2024-09-13T15:51:06.437 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-13T15:51:06.437 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:51:06.437 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-13T15:51:06.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 -- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] conn(0x7f420403d430 msgr2=0x7f420403f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] conn(0x7f420403d430 0x7f420403f8d0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 -- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4204035530 msgr2=0x7f42040379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4204035530 0x7f42040379f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f42100b0000 tx=0x7f4210008040 comp rx=0 tx=0).stop 2024-09-13T15:51:06.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 -- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422006f400 msgr2=0x7f4220147040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422006f400 0x7f4220147040 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f421c00c430 tx=0x7f421c00c8f0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 -- 172.21.15.40:0/4088176226 shutdown_connections 2024-09-13T15:51:06.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:6800/884315373,v1:172.21.15.40:6801/884315373] conn(0x7f420403d430 0x7f420403f8d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4204035530 0x7f42040379f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 --2- 172.21.15.40:0/4088176226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f422006f400 0x7f4220147040 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 -- 172.21.15.40:0/4088176226 >> 172.21.15.40:0/4088176226 conn(0x7f422006a540 msgr2=0x7f4220149a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:06.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 -- 172.21.15.40:0/4088176226 shutdown_connections 2024-09-13T15:51:06.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.432+0000 7f42276b3640 1 -- 172.21.15.40:0/4088176226 wait complete. 2024-09-13T15:51:06.452 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T15:51:06.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.560+0000 7f6f62ff1640 1 Processor -- start 2024-09-13T15:51:06.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.560+0000 7f6f62ff1640 1 -- start start 2024-09-13T15:51:06.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.560+0000 7f6f62ff1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f5c0b7bd0 0x7f6f5c0c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.560+0000 7f6f62ff1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0a7850 con 0x7f6f5c153f60 2024-09-13T15:51:06.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.560+0000 7f6f62ff1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c08c4f0 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f5bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f5c0b7bd0 0x7f6f5c0c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f60d8d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6f5c153f60 0x7f6f5c0c4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59504/0 (socket says 172.21.15.40:59504) 2024-09-13T15:51:06.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f60d8d640 1 -- 172.21.15.40:0/4080890314 learned_addr learned my addr 172.21.15.40:0/4080890314 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:51:06.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f5bfff640 1 -- 172.21.15.40:0/4080890314 >> v1:172.21.15.40:6789/0 conn(0x7f6f5c153f60 legacy=0x7f6f5c0c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f5bfff640 1 -- 172.21.15.40:0/4080890314 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c08bdb0 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f5bfff640 1 --2- 172.21.15.40:0/4080890314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5c0b7bd0 0x7f6f5c0c06e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009770 tx=0x7f6f4401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d11ca6461c351b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f5b7fe640 1 -- 172.21.15.40:0/4080890314 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f440ab530 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f5b7fe640 1 -- 172.21.15.40:0/4080890314 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f440a7050 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f5b7fe640 1 -- 172.21.15.40:0/4080890314 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f440ab7e0 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f62ff1640 1 -- 172.21.15.40:0/4080890314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5c0b7bd0 msgr2=0x7f6f5c0c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f62ff1640 1 --2- 172.21.15.40:0/4080890314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5c0b7bd0 0x7f6f5c0c06e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009770 tx=0x7f6f4401c420 comp rx=0 tx=0).stop 2024-09-13T15:51:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f62ff1640 1 -- 172.21.15.40:0/4080890314 shutdown_connections 2024-09-13T15:51:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f62ff1640 1 --2- 172.21.15.40:0/4080890314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5c0b7bd0 0x7f6f5c0c06e0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f62ff1640 1 -- 172.21.15.40:0/4080890314 >> 172.21.15.40:0/4080890314 conn(0x7f6f5c0a8640 msgr2=0x7f6f5c065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f62ff1640 1 -- 172.21.15.40:0/4080890314 shutdown_connections 2024-09-13T15:51:06.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.564+0000 7f6f62ff1640 1 -- 172.21.15.40:0/4080890314 wait complete. 2024-09-13T15:51:06.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f62ff1640 1 Processor -- start 2024-09-13T15:51:06.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f62ff1640 1 -- start start 2024-09-13T15:51:06.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f62ff1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5c0b7bd0 0x7f6f5c143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f62ff1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c154720 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f60d8d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5c0b7bd0 0x7f6f5c143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f60d8d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5c0b7bd0 0x7f6f5c143ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35896/0 (socket says 172.21.15.40:35896) 2024-09-13T15:51:06.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f60d8d640 1 -- 172.21.15.40:0/517332629 learned_addr learned my addr 172.21.15.40:0/517332629 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:06.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f60d8d640 1 -- 172.21.15.40:0/517332629 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f44009420 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f60d8d640 1 --2- 172.21.15.40:0/517332629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5c0b7bd0 0x7f6f5c143ab0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c480 tx=0x7f6f4c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f597fa640 1 -- 172.21.15.40:0/517332629 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c005c20 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f597fa640 1 -- 172.21.15.40:0/517332629 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c005d80 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f62ff1640 1 -- 172.21.15.40:0/517332629 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c1567f0 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f597fa640 1 -- 172.21.15.40:0/517332629 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6f4c0071a0 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f62ff1640 1 -- 172.21.15.40:0/517332629 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c156cd0 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f62ff1640 1 -- 172.21.15.40:0/517332629 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c067510 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f597fa640 1 -- 172.21.15.40:0/517332629 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f6f4c007300 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f597fa640 1 --2- 172.21.15.40:0/517332629 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6f3c035530 0x7f6f3c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f597fa640 1 -- 172.21.15.40:0/517332629 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f6f4c047330 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.568+0000 7f6f5bfff640 1 --2- 172.21.15.40:0/517332629 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6f3c035530 0x7f6f3c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.572+0000 7f6f5bfff640 1 --2- 172.21.15.40:0/517332629 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6f3c035530 0x7f6f3c0379f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009770 tx=0x7f6f440a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.576+0000 7f6f597fa640 1 -- 172.21.15.40:0/517332629 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6f4c01b3b0 con 0x7f6f5c0b7bd0 2024-09-13T15:51:06.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.728+0000 7f6f62ff1640 1 -- 172.21.15.40:0/517332629 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f5c156980 con 0x7f6f3c035530 2024-09-13T15:51:06.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.728+0000 7f6f597fa640 1 -- 172.21.15.40:0/517332629 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6f440ab720 con 0x7f6f3c035530 2024-09-13T15:51:06.732 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T15:51:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.732+0000 7f6f62ff1640 1 -- 172.21.15.40:0/517332629 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6f3c035530 msgr2=0x7f6f3c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.732+0000 7f6f62ff1640 1 --2- 172.21.15.40:0/517332629 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6f3c035530 0x7f6f3c0379f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009770 tx=0x7f6f440a6000 comp rx=0 tx=0).stop 2024-09-13T15:51:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.732+0000 7f6f62ff1640 1 -- 172.21.15.40:0/517332629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5c0b7bd0 msgr2=0x7f6f5c143ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.732+0000 7f6f62ff1640 1 --2- 172.21.15.40:0/517332629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5c0b7bd0 0x7f6f5c143ab0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c480 tx=0x7f6f4c00c940 comp rx=0 tx=0).stop 2024-09-13T15:51:06.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.732+0000 7f6f62ff1640 1 -- 172.21.15.40:0/517332629 shutdown_connections 2024-09-13T15:51:06.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.732+0000 7f6f62ff1640 1 --2- 172.21.15.40:0/517332629 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6f3c035530 0x7f6f3c0379f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.732+0000 7f6f62ff1640 1 --2- 172.21.15.40:0/517332629 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f5c0b7bd0 0x7f6f5c143ab0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.732+0000 7f6f62ff1640 1 -- 172.21.15.40:0/517332629 >> 172.21.15.40:0/517332629 conn(0x7f6f5c0a8640 msgr2=0x7f6f5c0c4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:06.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.732+0000 7f6f62ff1640 1 -- 172.21.15.40:0/517332629 shutdown_connections 2024-09-13T15:51:06.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.732+0000 7f6f62ff1640 1 -- 172.21.15.40:0/517332629 wait complete. 2024-09-13T15:51:06.750 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T15:51:06.751 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:51:06.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.864+0000 7fb4f926d640 1 Processor -- start 2024-09-13T15:51:06.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.864+0000 7fb4f926d640 1 -- start start 2024-09-13T15:51:06.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.864+0000 7fb4f926d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4f40bebb0 0x7fb4f40a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.864+0000 7fb4f926d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f41515b0 con 0x7fb4f40b4010 2024-09-13T15:51:06.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.864+0000 7fb4f926d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f414e2c0 con 0x7fb4f40bebb0 2024-09-13T15:51:06.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.864+0000 7fb4f2ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4f40bebb0 0x7fb4f40a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.864+0000 7fb4f2ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4f40bebb0 0x7fb4f40a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35912/0 (socket says 172.21.15.40:35912) 2024-09-13T15:51:06.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.864+0000 7fb4f2ffd640 1 -- 172.21.15.40:0/1040255891 learned_addr learned my addr 172.21.15.40:0/1040255891 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:06.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.864+0000 7fb4f2ffd640 1 -- 172.21.15.40:0/1040255891 >> v1:172.21.15.40:6789/0 conn(0x7fb4f40b4010 legacy=0x7fb4f406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.864+0000 7fb4f2ffd640 1 -- 172.21.15.40:0/1040255891 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f406f830 con 0x7fb4f40bebb0 2024-09-13T15:51:06.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f2ffd640 1 --2- 172.21.15.40:0/1040255891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f40bebb0 0x7fb4f40a4d70 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40097f0 tx=0x7fb4e401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146091c24e810047 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f27fc640 1 -- 172.21.15.40:0/1040255891 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4f40b6bc0 con 0x7fb4f40bebb0 2024-09-13T15:51:06.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f27fc640 1 -- 172.21.15.40:0/1040255891 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e40a7050 con 0x7fb4f40bebb0 2024-09-13T15:51:06.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f27fc640 1 -- 172.21.15.40:0/1040255891 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4e40ab680 con 0x7fb4f40bebb0 2024-09-13T15:51:06.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f926d640 1 -- 172.21.15.40:0/1040255891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f40bebb0 msgr2=0x7fb4f40a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f926d640 1 --2- 172.21.15.40:0/1040255891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f40bebb0 0x7fb4f40a4d70 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40097f0 tx=0x7fb4e401c4e0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f926d640 1 -- 172.21.15.40:0/1040255891 shutdown_connections 2024-09-13T15:51:06.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f926d640 1 --2- 172.21.15.40:0/1040255891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f40bebb0 0x7fb4f40a4d70 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f926d640 1 -- 172.21.15.40:0/1040255891 >> 172.21.15.40:0/1040255891 conn(0x7fb4f406a540 msgr2=0x7fb4f40a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f926d640 1 -- 172.21.15.40:0/1040255891 shutdown_connections 2024-09-13T15:51:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f926d640 1 -- 172.21.15.40:0/1040255891 wait complete. 2024-09-13T15:51:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f926d640 1 Processor -- start 2024-09-13T15:51:06.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.868+0000 7fb4f926d640 1 -- start start 2024-09-13T15:51:06.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4f926d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f40b4010 0x7fb4f40b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4f926d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f4142090 con 0x7fb4f40b4010 2024-09-13T15:51:06.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4f2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f40b4010 0x7fb4f40b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4f2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f40b4010 0x7fb4f40b81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35928/0 (socket says 172.21.15.40:35928) 2024-09-13T15:51:06.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4f2ffd640 1 -- 172.21.15.40:0/695420803 learned_addr learned my addr 172.21.15.40:0/695420803 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:06.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4f2ffd640 1 -- 172.21.15.40:0/695420803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40094d0 con 0x7fb4f40b4010 2024-09-13T15:51:06.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4f2ffd640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f40b4010 0x7fb4f40b81b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb4e401a110 tx=0x7fb4e4019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4ebfff640 1 -- 172.21.15.40:0/695420803 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4e40b4570 con 0x7fb4f40b4010 2024-09-13T15:51:06.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4ebfff640 1 -- 172.21.15.40:0/695420803 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e40b46d0 con 0x7fb4f40b4010 2024-09-13T15:51:06.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4ebfff640 1 -- 172.21.15.40:0/695420803 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4e40b49b0 con 0x7fb4f40b4010 2024-09-13T15:51:06.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4f926d640 1 -- 172.21.15.40:0/695420803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f40bc1b0 con 0x7fb4f40b4010 2024-09-13T15:51:06.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4f926d640 1 -- 172.21.15.40:0/695420803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f41e9630 con 0x7fb4f40b4010 2024-09-13T15:51:06.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4f926d640 1 -- 172.21.15.40:0/695420803 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4f40a4d70 con 0x7fb4f40b4010 2024-09-13T15:51:06.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4ebfff640 1 -- 172.21.15.40:0/695420803 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7fb4e40b2070 con 0x7fb4f40b4010 2024-09-13T15:51:06.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4ebfff640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb4d8035530 0x7fb4d80379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4ebfff640 1 -- 172.21.15.40:0/695420803 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7fb4e40e1fb0 con 0x7fb4f40b4010 2024-09-13T15:51:06.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4ebfff640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] conn(0x7fb4d803d430 0x7fb4d803f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:06.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4ea7fc640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb4d8035530 0x7fb4d80379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4ebfff640 1 -- 172.21.15.40:0/695420803 --> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb4d803ffa0 con 0x7fb4d803d430 2024-09-13T15:51:06.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4ebfff640 1 -- 172.21.15.40:0/695420803 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4e40e7580 con 0x7fb4f40b4010 2024-09-13T15:51:06.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4f37fe640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] conn(0x7fb4d803d430 0x7fb4d803f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:06.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4ea7fc640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb4d8035530 0x7fb4d80379f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc000f70 tx=0x7fb4dc007a40 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4f37fe640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] conn(0x7fb4d803d430 0x7fb4d803f8d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:06.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.872+0000 7fb4ebfff640 1 -- 172.21.15.40:0/695420803 <== osd.2 v2:172.21.15.40:6816/1072951307 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb4d803ffa0 con 0x7fb4d803d430 2024-09-13T15:51:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 -- 172.21.15.40:0/695420803 --> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb4f41e9dc0 con 0x7fb4d803d430 2024-09-13T15:51:06.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4ebfff640 1 -- 172.21.15.40:0/695420803 <== osd.2 v2:172.21.15.40:6816/1072951307 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb4ec011040 con 0x7fb4d803d430 2024-09-13T15:51:06.890 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-09-13T15:51:06.890 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:51:06.890 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-09-13T15:51:06.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 -- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] conn(0x7fb4d803d430 msgr2=0x7fb4d803f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] conn(0x7fb4d803d430 0x7fb4d803f8d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 -- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb4d8035530 msgr2=0x7fb4d80379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb4d8035530 0x7fb4d80379f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc000f70 tx=0x7fb4dc007a40 comp rx=0 tx=0).stop 2024-09-13T15:51:06.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 -- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f40b4010 msgr2=0x7fb4f40b81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:06.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f40b4010 0x7fb4f40b81b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb4e401a110 tx=0x7fb4e4019280 comp rx=0 tx=0).stop 2024-09-13T15:51:06.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 -- 172.21.15.40:0/695420803 shutdown_connections 2024-09-13T15:51:06.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:6816/1072951307,v1:172.21.15.40:6817/1072951307] conn(0x7fb4d803d430 0x7fb4d803f8d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fb4d8035530 0x7fb4d80379f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 --2- 172.21.15.40:0/695420803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb4f40b4010 0x7fb4f40b81b0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:06.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 -- 172.21.15.40:0/695420803 >> 172.21.15.40:0/695420803 conn(0x7fb4f406a540 msgr2=0x7fb4f406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:06.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 -- 172.21.15.40:0/695420803 shutdown_connections 2024-09-13T15:51:06.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:06.888+0000 7fb4f926d640 1 -- 172.21.15.40:0/695420803 wait complete. 2024-09-13T15:51:06.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T15:51:07.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.016+0000 7f590902f640 1 Processor -- start 2024-09-13T15:51:07.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.016+0000 7f590902f640 1 -- start start 2024-09-13T15:51:07.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.016+0000 7f590902f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59040b7bd0 0x7f59040c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:07.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.016+0000 7f590902f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59040a7850 con 0x7f5904153f60 2024-09-13T15:51:07.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.016+0000 7f590902f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590408c4f0 con 0x7f59040b7bd0 2024-09-13T15:51:07.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.016+0000 7f58fbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59040b7bd0 0x7f59040c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:07.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.016+0000 7f58fbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59040b7bd0 0x7f59040c06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35938/0 (socket says 172.21.15.40:35938) 2024-09-13T15:51:07.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.016+0000 7f58fbfff640 1 -- 172.21.15.40:0/2346305026 learned_addr learned my addr 172.21.15.40:0/2346305026 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:07.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.016+0000 7f5902d9d640 1 --1- 172.21.15.40:0/2346305026 >> v1:172.21.15.40:6789/0 conn(0x7f5904153f60 0x7f59040c4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:59520/0 (socket says 172.21.15.40:59520) 2024-09-13T15:51:07.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.016+0000 7f58fbfff640 1 -- 172.21.15.40:0/2346305026 >> v1:172.21.15.40:6789/0 conn(0x7f5904153f60 legacy=0x7f59040c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:07.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.016+0000 7f58fbfff640 1 -- 172.21.15.40:0/2346305026 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590408bdb0 con 0x7f59040b7bd0 2024-09-13T15:51:07.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f58fbfff640 1 --2- 172.21.15.40:0/2346305026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59040b7bd0 0x7f59040c06e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009820 tx=0x7f58ec01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149a529dece31275 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:07.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f590259c640 1 -- 172.21.15.40:0/2346305026 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58ec0ac560 con 0x7f59040b7bd0 2024-09-13T15:51:07.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f590259c640 1 -- 172.21.15.40:0/2346305026 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec0ac6c0 con 0x7f59040b7bd0 2024-09-13T15:51:07.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f590259c640 1 -- 172.21.15.40:0/2346305026 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58ec0ac980 con 0x7f59040b7bd0 2024-09-13T15:51:07.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f590902f640 1 -- 172.21.15.40:0/2346305026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59040b7bd0 msgr2=0x7f59040c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:07.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f590902f640 1 --2- 172.21.15.40:0/2346305026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59040b7bd0 0x7f59040c06e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009820 tx=0x7f58ec01c4c0 comp rx=0 tx=0).stop 2024-09-13T15:51:07.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f590902f640 1 -- 172.21.15.40:0/2346305026 shutdown_connections 2024-09-13T15:51:07.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f590902f640 1 --2- 172.21.15.40:0/2346305026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59040b7bd0 0x7f59040c06e0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:07.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f590902f640 1 -- 172.21.15.40:0/2346305026 >> 172.21.15.40:0/2346305026 conn(0x7f59040a8640 msgr2=0x7f5904065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:07.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f590902f640 1 -- 172.21.15.40:0/2346305026 shutdown_connections 2024-09-13T15:51:07.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f590902f640 1 -- 172.21.15.40:0/2346305026 wait complete. 2024-09-13T15:51:07.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f590902f640 1 Processor -- start 2024-09-13T15:51:07.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.020+0000 7f590902f640 1 -- start start 2024-09-13T15:51:07.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f590902f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59040b7bd0 0x7f5904143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:07.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f590902f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5904154720 con 0x7f59040b7bd0 2024-09-13T15:51:07.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f5902d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59040b7bd0 0x7f5904143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:07.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f5902d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59040b7bd0 0x7f5904143ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35942/0 (socket says 172.21.15.40:35942) 2024-09-13T15:51:07.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f5902d9d640 1 -- 172.21.15.40:0/4225964921 learned_addr learned my addr 172.21.15.40:0/4225964921 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:07.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f5902d9d640 1 -- 172.21.15.40:0/4225964921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec0094d0 con 0x7f59040b7bd0 2024-09-13T15:51:07.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f5902d9d640 1 --2- 172.21.15.40:0/4225964921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59040b7bd0 0x7f5904143ab0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c410 tx=0x7f58f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:07.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f58fb7fe640 1 -- 172.21.15.40:0/4225964921 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58f4007410 con 0x7f59040b7bd0 2024-09-13T15:51:07.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f58fb7fe640 1 -- 172.21.15.40:0/4225964921 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f4007570 con 0x7f59040b7bd0 2024-09-13T15:51:07.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f58fb7fe640 1 -- 172.21.15.40:0/4225964921 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58f40047f0 con 0x7f59040b7bd0 2024-09-13T15:51:07.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f590902f640 1 -- 172.21.15.40:0/4225964921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59041567f0 con 0x7f59040b7bd0 2024-09-13T15:51:07.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f590902f640 1 -- 172.21.15.40:0/4225964921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5904156cd0 con 0x7f59040b7bd0 2024-09-13T15:51:07.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f590902f640 1 -- 172.21.15.40:0/4225964921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5904067510 con 0x7f59040b7bd0 2024-09-13T15:51:07.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f58fb7fe640 1 -- 172.21.15.40:0/4225964921 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f58f4004950 con 0x7f59040b7bd0 2024-09-13T15:51:07.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f58fb7fe640 1 --2- 172.21.15.40:0/4225964921 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f58e4035530 0x7f58e40379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:07.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f58fb7fe640 1 -- 172.21.15.40:0/4225964921 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f58f4047840 con 0x7f59040b7bd0 2024-09-13T15:51:07.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f58fbfff640 1 --2- 172.21.15.40:0/4225964921 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f58e4035530 0x7f58e40379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:07.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.024+0000 7f58fbfff640 1 --2- 172.21.15.40:0/4225964921 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f58e4035530 0x7f58e40379f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009820 tx=0x7f58ec0a7000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:07.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.028+0000 7f58fb7fe640 1 -- 172.21.15.40:0/4225964921 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f58f40196d0 con 0x7f59040b7bd0 2024-09-13T15:51:07.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.184+0000 7f590902f640 1 -- 172.21.15.40:0/4225964921 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5904156980 con 0x7f58e4035530 2024-09-13T15:51:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.184+0000 7f58fb7fe640 1 -- 172.21.15.40:0/4225964921 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f58ec0ac8b0 con 0x7f58e4035530 2024-09-13T15:51:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T15:51:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.188+0000 7f590902f640 1 -- 172.21.15.40:0/4225964921 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f58e4035530 msgr2=0x7f58e40379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.188+0000 7f590902f640 1 --2- 172.21.15.40:0/4225964921 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f58e4035530 0x7f58e40379f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009820 tx=0x7f58ec0a7000 comp rx=0 tx=0).stop 2024-09-13T15:51:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.188+0000 7f590902f640 1 -- 172.21.15.40:0/4225964921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59040b7bd0 msgr2=0x7f5904143ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.188+0000 7f590902f640 1 --2- 172.21.15.40:0/4225964921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59040b7bd0 0x7f5904143ab0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f58f400c410 tx=0x7f58f400c8d0 comp rx=0 tx=0).stop 2024-09-13T15:51:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.188+0000 7f590902f640 1 -- 172.21.15.40:0/4225964921 shutdown_connections 2024-09-13T15:51:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.188+0000 7f590902f640 1 --2- 172.21.15.40:0/4225964921 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f58e4035530 0x7f58e40379f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.188+0000 7f590902f640 1 --2- 172.21.15.40:0/4225964921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59040b7bd0 0x7f5904143ab0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:07.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.188+0000 7f590902f640 1 -- 172.21.15.40:0/4225964921 >> 172.21.15.40:0/4225964921 conn(0x7f59040a8640 msgr2=0x7f59040c4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:07.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.188+0000 7f590902f640 1 -- 172.21.15.40:0/4225964921 shutdown_connections 2024-09-13T15:51:07.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.188+0000 7f590902f640 1 -- 172.21.15.40:0/4225964921 wait complete. 2024-09-13T15:51:07.208 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:51:07.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.316+0000 7f400f822640 1 Processor -- start 2024-09-13T15:51:07.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.316+0000 7f400f822640 1 -- start start 2024-09-13T15:51:07.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.316+0000 7f400f822640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40080b4010 0x7f40080a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:07.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.316+0000 7f400f822640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40081515b0 con 0x7f40080bebb0 2024-09-13T15:51:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.316+0000 7f400f822640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400814e2c0 con 0x7f40080b4010 2024-09-13T15:51:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.316+0000 7f400cdbd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40080b4010 0x7f40080a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.316+0000 7f400cdbd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40080b4010 0x7f40080a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35956/0 (socket says 172.21.15.40:35956) 2024-09-13T15:51:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.316+0000 7f400cdbd640 1 -- 172.21.15.40:0/3683653985 learned_addr learned my addr 172.21.15.40:0/3683653985 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.316+0000 7f400cdbd640 1 -- 172.21.15.40:0/3683653985 >> v1:172.21.15.40:6789/0 conn(0x7f40080bebb0 legacy=0x7f400806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:07.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.316+0000 7f400cdbd640 1 -- 172.21.15.40:0/3683653985 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400806f830 con 0x7f40080b4010 2024-09-13T15:51:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f400cdbd640 1 --2- 172.21.15.40:0/3683653985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40080b4010 0x7f40080a4d70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80097f0 tx=0x7f3ff801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6669510f7f23653 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f3ffffff640 1 -- 172.21.15.40:0/3683653985 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40080b6bc0 con 0x7f40080b4010 2024-09-13T15:51:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f3ffffff640 1 -- 172.21.15.40:0/3683653985 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff80a7050 con 0x7f40080b4010 2024-09-13T15:51:07.324 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f3ffffff640 1 -- 172.21.15.40:0/3683653985 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ff80ab680 con 0x7f40080b4010 2024-09-13T15:51:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f400f822640 1 -- 172.21.15.40:0/3683653985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40080b4010 msgr2=0x7f40080a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f400f822640 1 --2- 172.21.15.40:0/3683653985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40080b4010 0x7f40080a4d70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80097f0 tx=0x7f3ff801c4e0 comp rx=0 tx=0).stop 2024-09-13T15:51:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f400f822640 1 -- 172.21.15.40:0/3683653985 shutdown_connections 2024-09-13T15:51:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f400f822640 1 --2- 172.21.15.40:0/3683653985 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40080b4010 0x7f40080a4d70 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f400f822640 1 -- 172.21.15.40:0/3683653985 >> 172.21.15.40:0/3683653985 conn(0x7f400806a540 msgr2=0x7f40080a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f400f822640 1 -- 172.21.15.40:0/3683653985 shutdown_connections 2024-09-13T15:51:07.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f400f822640 1 -- 172.21.15.40:0/3683653985 wait complete. 2024-09-13T15:51:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f400f822640 1 Processor -- start 2024-09-13T15:51:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.320+0000 7f400f822640 1 -- start start 2024-09-13T15:51:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f400f822640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40080b4010 0x7f400814be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f400f822640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40081466c0 con 0x7f40080b4010 2024-09-13T15:51:07.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f400d5be640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40080b4010 0x7f400814be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f400d5be640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40080b4010 0x7f400814be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35968/0 (socket says 172.21.15.40:35968) 2024-09-13T15:51:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f400d5be640 1 -- 172.21.15.40:0/217449784 learned_addr learned my addr 172.21.15.40:0/217449784 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:07.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f400d5be640 1 -- 172.21.15.40:0/217449784 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80094d0 con 0x7f40080b4010 2024-09-13T15:51:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f400d5be640 1 --2- 172.21.15.40:0/217449784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40080b4010 0x7f400814be10 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f400400c480 tx=0x7f400400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f3ffdffb640 1 -- 172.21.15.40:0/217449784 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4004005150 con 0x7f40080b4010 2024-09-13T15:51:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f3ffdffb640 1 -- 172.21.15.40:0/217449784 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40040052b0 con 0x7f40080b4010 2024-09-13T15:51:07.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f400f822640 1 -- 172.21.15.40:0/217449784 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40080bb080 con 0x7f40080b4010 2024-09-13T15:51:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f3ffdffb640 1 -- 172.21.15.40:0/217449784 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4004007030 con 0x7f40080b4010 2024-09-13T15:51:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f400f822640 1 -- 172.21.15.40:0/217449784 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400815f330 con 0x7f40080b4010 2024-09-13T15:51:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f3ffdffb640 1 -- 172.21.15.40:0/217449784 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f40040072a0 con 0x7f40080b4010 2024-09-13T15:51:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f3ffdffb640 1 --2- 172.21.15.40:0/217449784 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3fec0354e0 0x7f3fec0379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f3ffdffb640 1 -- 172.21.15.40:0/217449784 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f4004047340 con 0x7f40080b4010 2024-09-13T15:51:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f400f822640 1 -- 172.21.15.40:0/217449784 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40080baed0 con 0x7f40080b4010 2024-09-13T15:51:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f400cdbd640 1 --2- 172.21.15.40:0/217449784 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3fec0354e0 0x7f3fec0379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:07.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.324+0000 7f400cdbd640 1 --2- 172.21.15.40:0/217449784 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3fec0354e0 0x7f3fec0379a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80ad000 tx=0x7f3ff80a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:07.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.328+0000 7f3ffdffb640 1 -- 172.21.15.40:0/217449784 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f40040075f0 con 0x7f40080b4010 2024-09-13T15:51:07.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.488+0000 7f400f822640 1 -- 172.21.15.40:0/217449784 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f400815f580 con 0x7f3fec0354e0 2024-09-13T15:51:07.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.496+0000 7f3ffdffb640 1 -- 172.21.15.40:0/217449784 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249952 (secure 0 0 0) 0x7f400815f580 con 0x7f3fec0354e0 2024-09-13T15:51:07.501 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:51:07.503 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:51:07.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.500+0000 7f400f822640 1 -- 172.21.15.40:0/217449784 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3fec0354e0 msgr2=0x7f3fec0379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:07.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.500+0000 7f400f822640 1 --2- 172.21.15.40:0/217449784 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3fec0354e0 0x7f3fec0379a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80ad000 tx=0x7f3ff80a6000 comp rx=0 tx=0).stop 2024-09-13T15:51:07.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.500+0000 7f400f822640 1 -- 172.21.15.40:0/217449784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40080b4010 msgr2=0x7f400814be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:07.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.500+0000 7f400f822640 1 --2- 172.21.15.40:0/217449784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40080b4010 0x7f400814be10 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f400400c480 tx=0x7f400400c940 comp rx=0 tx=0).stop 2024-09-13T15:51:07.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.500+0000 7f400f822640 1 -- 172.21.15.40:0/217449784 shutdown_connections 2024-09-13T15:51:07.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.500+0000 7f400f822640 1 --2- 172.21.15.40:0/217449784 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3fec0354e0 0x7f3fec0379a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:07.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.500+0000 7f400f822640 1 --2- 172.21.15.40:0/217449784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40080b4010 0x7f400814be10 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:07.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.500+0000 7f400f822640 1 -- 172.21.15.40:0/217449784 >> 172.21.15.40:0/217449784 conn(0x7f400806a540 msgr2=0x7f4008071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:07.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.500+0000 7f400f822640 1 -- 172.21.15.40:0/217449784 shutdown_connections 2024-09-13T15:51:07.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:07.500+0000 7f400f822640 1 -- 172.21.15.40:0/217449784 wait complete. 2024-09-13T15:51:07.521 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2024-09-13T15:51:05.847675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593804,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":208,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":368,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":671712,"kb_used_data":267444,"kb_used_omap":4,"kb_used_meta":404219,"kb_avail":282443808,"statfs":{"total":289910292480,"available":289222459392,"internally_reserved":0,"allocated":273862656,"data_stored":238184199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":413920594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-261536172,"num_objects":-4670,"num_object_clones":-60,"num_object_copies":-9340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4670,"num_whiteouts":0,"num_read":-18696,"num_read_kb":-170253,"num_write":-15658,"num_write_kb":-264556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001257"},"pg_stats":[{"pgid":"2.1f","version":"15'4","reported_seq":63,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339591+0000","last_change":"2024-09-13T15:34:34.960705+0000","last_active":"2024-09-13T15:51:00.339591+0000","last_peered":"2024-09-13T15:51:00.339591+0000","last_clean":"2024-09-13T15:51:00.339591+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:51:00.339591+0000","last_undegraded":"2024-09-13T15:51:00.339591+0000","last_fullsized":"2024-09-13T15:51:00.339591+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099521+0000","last_change":"2024-09-13T15:34:35.338454+0000","last_active":"2024-09-13T15:51:00.099521+0000","last_peered":"2024-09-13T15:51:00.099521+0000","last_clean":"2024-09-13T15:51:00.099521+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:51:00.099521+0000","last_undegraded":"2024-09-13T15:51:00.099521+0000","last_fullsized":"2024-09-13T15:51:00.099521+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:49.904225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099261+0000","last_change":"2024-09-13T15:34:34.955842+0000","last_active":"2024-09-13T15:51:00.099261+0000","last_peered":"2024-09-13T15:51:00.099261+0000","last_clean":"2024-09-13T15:51:00.099261+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:51:00.099261+0000","last_undegraded":"2024-09-13T15:51:00.099261+0000","last_fullsized":"2024-09-13T15:51:00.099261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.340160+0000","last_change":"2024-09-13T15:34:35.350474+0000","last_active":"2024-09-13T15:51:00.340160+0000","last_peered":"2024-09-13T15:51:00.340160+0000","last_clean":"2024-09-13T15:51:00.340160+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:51:00.340160+0000","last_undegraded":"2024-09-13T15:51:00.340160+0000","last_fullsized":"2024-09-13T15:51:00.340160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:08:45.573183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":60,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.335889+0000","last_change":"2024-09-13T15:34:34.950125+0000","last_active":"2024-09-13T15:51:00.335889+0000","last_peered":"2024-09-13T15:51:00.335889+0000","last_clean":"2024-09-13T15:51:00.335889+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:51:00.335889+0000","last_undegraded":"2024-09-13T15:51:00.335889+0000","last_fullsized":"2024-09-13T15:51:00.335889+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051068+0000","last_change":"2024-09-13T15:34:35.333710+0000","last_active":"2024-09-13T15:51:00.051068+0000","last_peered":"2024-09-13T15:51:00.051068+0000","last_clean":"2024-09-13T15:51:00.051068+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:51:00.051068+0000","last_undegraded":"2024-09-13T15:51:00.051068+0000","last_fullsized":"2024-09-13T15:51:00.051068+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":51,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095970+0000","last_change":"2024-09-13T15:35:20.173539+0000","last_active":"2024-09-13T15:51:00.095970+0000","last_peered":"2024-09-13T15:51:00.095970+0000","last_clean":"2024-09-13T15:51:00.095970+0000","last_became_active":"2024-09-13T15:35:20.165658+0000","last_became_peered":"2024-09-13T15:35:20.165658+0000","last_unstale":"2024-09-13T15:51:00.095970+0000","last_undegraded":"2024-09-13T15:51:00.095970+0000","last_fullsized":"2024-09-13T15:51:00.095970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:35.807536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.097424+0000","last_change":"2024-09-13T15:34:35.329220+0000","last_active":"2024-09-13T15:51:00.097424+0000","last_peered":"2024-09-13T15:51:00.097424+0000","last_clean":"2024-09-13T15:51:00.097424+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:51:00.097424+0000","last_undegraded":"2024-09-13T15:51:00.097424+0000","last_fullsized":"2024-09-13T15:51:00.097424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334413+0000","last_change":"2024-09-13T15:34:35.334308+0000","last_active":"2024-09-13T15:51:00.334413+0000","last_peered":"2024-09-13T15:51:00.334413+0000","last_clean":"2024-09-13T15:51:00.334413+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:51:00.334413+0000","last_undegraded":"2024-09-13T15:51:00.334413+0000","last_fullsized":"2024-09-13T15:51:00.334413+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:50.918862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334863+0000","last_change":"2024-09-13T15:34:34.943033+0000","last_active":"2024-09-13T15:51:00.334863+0000","last_peered":"2024-09-13T15:51:00.334863+0000","last_clean":"2024-09-13T15:51:00.334863+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:51:00.334863+0000","last_undegraded":"2024-09-13T15:51:00.334863+0000","last_fullsized":"2024-09-13T15:51:00.334863+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.052739+0000","last_change":"2024-09-13T15:34:35.339704+0000","last_active":"2024-09-13T15:51:00.052739+0000","last_peered":"2024-09-13T15:51:00.052739+0000","last_clean":"2024-09-13T15:51:00.052739+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:51:00.052739+0000","last_undegraded":"2024-09-13T15:51:00.052739+0000","last_fullsized":"2024-09-13T15:51:00.052739+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044596+0000","last_change":"2024-09-13T15:34:34.943732+0000","last_active":"2024-09-13T15:51:00.044596+0000","last_peered":"2024-09-13T15:51:00.044596+0000","last_clean":"2024-09-13T15:51:00.044596+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:51:00.044596+0000","last_undegraded":"2024-09-13T15:51:00.044596+0000","last_fullsized":"2024-09-13T15:51:00.044596+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:56:50.920903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094473+0000","last_change":"2024-09-13T15:34:35.340037+0000","last_active":"2024-09-13T15:51:00.094473+0000","last_peered":"2024-09-13T15:51:00.094473+0000","last_clean":"2024-09-13T15:51:00.094473+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:51:00.094473+0000","last_undegraded":"2024-09-13T15:51:00.094473+0000","last_fullsized":"2024-09-13T15:51:00.094473+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.048410+0000","last_change":"2024-09-13T15:34:34.943197+0000","last_active":"2024-09-13T15:51:00.048410+0000","last_peered":"2024-09-13T15:51:00.048410+0000","last_clean":"2024-09-13T15:51:00.048410+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:51:00.048410+0000","last_undegraded":"2024-09-13T15:51:00.048410+0000","last_fullsized":"2024-09-13T15:51:00.048410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333855+0000","last_change":"2024-09-13T15:34:35.327260+0000","last_active":"2024-09-13T15:51:00.333855+0000","last_peered":"2024-09-13T15:51:00.333855+0000","last_clean":"2024-09-13T15:51:00.333855+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:51:00.333855+0000","last_undegraded":"2024-09-13T15:51:00.333855+0000","last_fullsized":"2024-09-13T15:51:00.333855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.332568+0000","last_change":"2024-09-13T15:34:34.941308+0000","last_active":"2024-09-13T15:51:00.332568+0000","last_peered":"2024-09-13T15:51:00.332568+0000","last_clean":"2024-09-13T15:51:00.332568+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:51:00.332568+0000","last_undegraded":"2024-09-13T15:51:00.332568+0000","last_fullsized":"2024-09-13T15:51:00.332568+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.337585+0000","last_change":"2024-09-13T15:34:35.334433+0000","last_active":"2024-09-13T15:51:00.337585+0000","last_peered":"2024-09-13T15:51:00.337585+0000","last_clean":"2024-09-13T15:51:00.337585+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:51:00.337585+0000","last_undegraded":"2024-09-13T15:51:00.337585+0000","last_fullsized":"2024-09-13T15:51:00.337585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:34.847820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.058322+0000","last_change":"2024-09-13T15:34:34.946540+0000","last_active":"2024-09-13T15:51:00.058322+0000","last_peered":"2024-09-13T15:51:00.058322+0000","last_clean":"2024-09-13T15:51:00.058322+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:51:00.058322+0000","last_undegraded":"2024-09-13T15:51:00.058322+0000","last_fullsized":"2024-09-13T15:51:00.058322+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:06:03.368512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099890+0000","last_change":"2024-09-13T15:34:35.337361+0000","last_active":"2024-09-13T15:51:00.099890+0000","last_peered":"2024-09-13T15:51:00.099890+0000","last_clean":"2024-09-13T15:51:00.099890+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:51:00.099890+0000","last_undegraded":"2024-09-13T15:51:00.099890+0000","last_fullsized":"2024-09-13T15:51:00.099890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:55:27.081960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":59,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.057520+0000","last_change":"2024-09-13T15:34:34.942452+0000","last_active":"2024-09-13T15:51:00.057520+0000","last_peered":"2024-09-13T15:51:00.057520+0000","last_clean":"2024-09-13T15:51:00.057520+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:51:00.057520+0000","last_undegraded":"2024-09-13T15:51:00.057520+0000","last_fullsized":"2024-09-13T15:51:00.057520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.050628+0000","last_change":"2024-09-13T15:34:35.339676+0000","last_active":"2024-09-13T15:51:00.050628+0000","last_peered":"2024-09-13T15:51:00.050628+0000","last_clean":"2024-09-13T15:51:00.050628+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:51:00.050628+0000","last_undegraded":"2024-09-13T15:51:00.050628+0000","last_fullsized":"2024-09-13T15:51:00.050628+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062116+0000","last_change":"2024-09-13T15:34:34.949805+0000","last_active":"2024-09-13T15:51:00.062116+0000","last_peered":"2024-09-13T15:51:00.062116+0000","last_clean":"2024-09-13T15:51:00.062116+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:51:00.062116+0000","last_undegraded":"2024-09-13T15:51:00.062116+0000","last_fullsized":"2024-09-13T15:51:00.062116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.097690+0000","last_change":"2024-09-13T15:34:35.335431+0000","last_active":"2024-09-13T15:51:00.097690+0000","last_peered":"2024-09-13T15:51:00.097690+0000","last_clean":"2024-09-13T15:51:00.097690+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:51:00.097690+0000","last_undegraded":"2024-09-13T15:51:00.097690+0000","last_fullsized":"2024-09-13T15:51:00.097690+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:24.940353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.050410+0000","last_change":"2024-09-13T15:34:34.946174+0000","last_active":"2024-09-13T15:51:00.050410+0000","last_peered":"2024-09-13T15:51:00.050410+0000","last_clean":"2024-09-13T15:51:00.050410+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:51:00.050410+0000","last_undegraded":"2024-09-13T15:51:00.050410+0000","last_fullsized":"2024-09-13T15:51:00.050410+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336516+0000","last_change":"2024-09-13T15:34:35.327755+0000","last_active":"2024-09-13T15:51:00.336516+0000","last_peered":"2024-09-13T15:51:00.336516+0000","last_clean":"2024-09-13T15:51:00.336516+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:51:00.336516+0000","last_undegraded":"2024-09-13T15:51:00.336516+0000","last_fullsized":"2024-09-13T15:51:00.336516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333413+0000","last_change":"2024-09-13T15:34:34.953984+0000","last_active":"2024-09-13T15:51:00.333413+0000","last_peered":"2024-09-13T15:51:00.333413+0000","last_clean":"2024-09-13T15:51:00.333413+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:51:00.333413+0000","last_undegraded":"2024-09-13T15:51:00.333413+0000","last_fullsized":"2024-09-13T15:51:00.333413+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:48.860103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051639+0000","last_change":"2024-09-13T15:34:35.336428+0000","last_active":"2024-09-13T15:51:00.051639+0000","last_peered":"2024-09-13T15:51:00.051639+0000","last_clean":"2024-09-13T15:51:00.051639+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:51:00.051639+0000","last_undegraded":"2024-09-13T15:51:00.051639+0000","last_fullsized":"2024-09-13T15:51:00.051639+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094577+0000","last_change":"2024-09-13T15:34:34.955761+0000","last_active":"2024-09-13T15:51:00.094577+0000","last_peered":"2024-09-13T15:51:00.094577+0000","last_clean":"2024-09-13T15:51:00.094577+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:51:00.094577+0000","last_undegraded":"2024-09-13T15:51:00.094577+0000","last_fullsized":"2024-09-13T15:51:00.094577+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:37.814369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333727+0000","last_change":"2024-09-13T15:34:35.324328+0000","last_active":"2024-09-13T15:51:00.333727+0000","last_peered":"2024-09-13T15:51:00.333727+0000","last_clean":"2024-09-13T15:51:00.333727+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:51:00.333727+0000","last_undegraded":"2024-09-13T15:51:00.333727+0000","last_fullsized":"2024-09-13T15:51:00.333727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094121+0000","last_change":"2024-09-13T15:34:34.960919+0000","last_active":"2024-09-13T15:51:00.094121+0000","last_peered":"2024-09-13T15:51:00.094121+0000","last_clean":"2024-09-13T15:51:00.094121+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:51:00.094121+0000","last_undegraded":"2024-09-13T15:51:00.094121+0000","last_fullsized":"2024-09-13T15:51:00.094121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:47.211308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044732+0000","last_change":"2024-09-13T15:34:35.339727+0000","last_active":"2024-09-13T15:51:00.044732+0000","last_peered":"2024-09-13T15:51:00.044732+0000","last_clean":"2024-09-13T15:51:00.044732+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:51:00.044732+0000","last_undegraded":"2024-09-13T15:51:00.044732+0000","last_fullsized":"2024-09-13T15:51:00.044732+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:06:58.092190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051805+0000","last_change":"2024-09-13T15:34:34.939804+0000","last_active":"2024-09-13T15:51:00.051805+0000","last_peered":"2024-09-13T15:51:00.051805+0000","last_clean":"2024-09-13T15:51:00.051805+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:51:00.051805+0000","last_undegraded":"2024-09-13T15:51:00.051805+0000","last_fullsized":"2024-09-13T15:51:00.051805+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'108","reported_seq":228,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.047957+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:51:00.047957+0000","last_peered":"2024-09-13T15:51:00.047957+0000","last_clean":"2024-09-13T15:51:00.047957+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:51:00.047957+0000","last_undegraded":"2024-09-13T15:51:00.047957+0000","last_fullsized":"2024-09-13T15:51:00.047957+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:09:42.585082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062369+0000","last_change":"2024-09-13T15:34:35.333828+0000","last_active":"2024-09-13T15:51:00.062369+0000","last_peered":"2024-09-13T15:51:00.062369+0000","last_clean":"2024-09-13T15:51:00.062369+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:51:00.062369+0000","last_undegraded":"2024-09-13T15:51:00.062369+0000","last_fullsized":"2024-09-13T15:51:00.062369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095286+0000","last_change":"2024-09-13T15:34:34.956621+0000","last_active":"2024-09-13T15:51:00.095286+0000","last_peered":"2024-09-13T15:51:00.095286+0000","last_clean":"2024-09-13T15:51:00.095286+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:51:00.095286+0000","last_undegraded":"2024-09-13T15:51:00.095286+0000","last_fullsized":"2024-09-13T15:51:00.095286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336964+0000","last_change":"2024-09-13T15:34:35.330850+0000","last_active":"2024-09-13T15:51:00.336964+0000","last_peered":"2024-09-13T15:51:00.336964+0000","last_clean":"2024-09-13T15:51:00.336964+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:51:00.336964+0000","last_undegraded":"2024-09-13T15:51:00.336964+0000","last_fullsized":"2024-09-13T15:51:00.336964+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:53.423967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":59,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062130+0000","last_change":"2024-09-13T15:34:34.936361+0000","last_active":"2024-09-13T15:51:00.062130+0000","last_peered":"2024-09-13T15:51:00.062130+0000","last_clean":"2024-09-13T15:51:00.062130+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:51:00.062130+0000","last_undegraded":"2024-09-13T15:51:00.062130+0000","last_fullsized":"2024-09-13T15:51:00.062130+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339823+0000","last_change":"2024-09-13T15:34:35.347478+0000","last_active":"2024-09-13T15:51:00.339823+0000","last_peered":"2024-09-13T15:51:00.339823+0000","last_clean":"2024-09-13T15:51:00.339823+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:51:00.339823+0000","last_undegraded":"2024-09-13T15:51:00.339823+0000","last_fullsized":"2024-09-13T15:51:00.339823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:45.481157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099045+0000","last_change":"2024-09-13T15:34:34.956480+0000","last_active":"2024-09-13T15:51:00.099045+0000","last_peered":"2024-09-13T15:51:00.099045+0000","last_clean":"2024-09-13T15:51:00.099045+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:51:00.099045+0000","last_undegraded":"2024-09-13T15:51:00.099045+0000","last_fullsized":"2024-09-13T15:51:00.099045+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099265+0000","last_change":"2024-09-13T15:34:35.338609+0000","last_active":"2024-09-13T15:51:00.099265+0000","last_peered":"2024-09-13T15:51:00.099265+0000","last_clean":"2024-09-13T15:51:00.099265+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:51:00.099265+0000","last_undegraded":"2024-09-13T15:51:00.099265+0000","last_fullsized":"2024-09-13T15:51:00.099265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:34:41.712645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":60,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339396+0000","last_change":"2024-09-13T15:34:34.959935+0000","last_active":"2024-09-13T15:51:00.339396+0000","last_peered":"2024-09-13T15:51:00.339396+0000","last_clean":"2024-09-13T15:51:00.339396+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:51:00.339396+0000","last_undegraded":"2024-09-13T15:51:00.339396+0000","last_fullsized":"2024-09-13T15:51:00.339396+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:53:20.224590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.342411+0000","last_change":"2024-09-13T15:34:35.335319+0000","last_active":"2024-09-13T15:51:02.342411+0000","last_peered":"2024-09-13T15:51:02.342411+0000","last_clean":"2024-09-13T15:51:02.342411+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:51:02.342411+0000","last_undegraded":"2024-09-13T15:51:02.342411+0000","last_fullsized":"2024-09-13T15:51:02.342411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:28.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":67,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094302+0000","last_change":"2024-09-13T15:34:34.959407+0000","last_active":"2024-09-13T15:51:00.094302+0000","last_peered":"2024-09-13T15:51:00.094302+0000","last_clean":"2024-09-13T15:51:00.094302+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:51:00.094302+0000","last_undegraded":"2024-09-13T15:51:00.094302+0000","last_fullsized":"2024-09-13T15:51:00.094302+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:31.743728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.835106+0000","last_change":"2024-09-13T15:34:35.329165+0000","last_active":"2024-09-13T15:51:00.835106+0000","last_peered":"2024-09-13T15:51:00.835106+0000","last_clean":"2024-09-13T15:51:00.835106+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:51:00.835106+0000","last_undegraded":"2024-09-13T15:51:00.835106+0000","last_fullsized":"2024-09-13T15:51:00.835106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333066+0000","last_change":"2024-09-13T15:34:34.954181+0000","last_active":"2024-09-13T15:51:00.333066+0000","last_peered":"2024-09-13T15:51:00.333066+0000","last_clean":"2024-09-13T15:51:00.333066+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:51:00.333066+0000","last_undegraded":"2024-09-13T15:51:00.333066+0000","last_fullsized":"2024-09-13T15:51:00.333066+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:40.615132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.835603+0000","last_change":"2024-09-13T15:34:35.342732+0000","last_active":"2024-09-13T15:51:00.835603+0000","last_peered":"2024-09-13T15:51:00.835603+0000","last_clean":"2024-09-13T15:51:00.835603+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:51:00.835603+0000","last_undegraded":"2024-09-13T15:51:00.835603+0000","last_fullsized":"2024-09-13T15:51:00.835603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:47.190930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095713+0000","last_change":"2024-09-13T15:34:34.957763+0000","last_active":"2024-09-13T15:51:00.095713+0000","last_peered":"2024-09-13T15:51:00.095713+0000","last_clean":"2024-09-13T15:51:00.095713+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:51:00.095713+0000","last_undegraded":"2024-09-13T15:51:00.095713+0000","last_fullsized":"2024-09-13T15:51:00.095713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:05.209551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.105151+0000","last_change":"2024-09-13T15:34:35.334637+0000","last_active":"2024-09-13T15:51:02.105151+0000","last_peered":"2024-09-13T15:51:02.105151+0000","last_clean":"2024-09-13T15:51:02.105151+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:51:02.105151+0000","last_undegraded":"2024-09-13T15:51:02.105151+0000","last_fullsized":"2024-09-13T15:51:02.105151+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:43.466895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":61,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.335970+0000","last_change":"2024-09-13T15:34:34.942058+0000","last_active":"2024-09-13T15:51:00.335970+0000","last_peered":"2024-09-13T15:51:00.335970+0000","last_clean":"2024-09-13T15:51:00.335970+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:51:00.335970+0000","last_undegraded":"2024-09-13T15:51:00.335970+0000","last_fullsized":"2024-09-13T15:51:00.335970+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336293+0000","last_change":"2024-09-13T15:34:35.345452+0000","last_active":"2024-09-13T15:51:00.336293+0000","last_peered":"2024-09-13T15:51:00.336293+0000","last_clean":"2024-09-13T15:51:00.336293+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:51:00.336293+0000","last_undegraded":"2024-09-13T15:51:00.336293+0000","last_fullsized":"2024-09-13T15:51:00.336293+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:08:25.983299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":71,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095566+0000","last_change":"2024-09-13T15:34:34.955883+0000","last_active":"2024-09-13T15:51:00.095566+0000","last_peered":"2024-09-13T15:51:00.095566+0000","last_clean":"2024-09-13T15:51:00.095566+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:51:00.095566+0000","last_undegraded":"2024-09-13T15:51:00.095566+0000","last_fullsized":"2024-09-13T15:51:00.095566+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.350629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2638,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.837843+0000","last_change":"2024-09-13T15:34:35.341547+0000","last_active":"2024-09-13T15:51:00.837843+0000","last_peered":"2024-09-13T15:51:00.837843+0000","last_clean":"2024-09-13T15:51:00.837843+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:51:00.837843+0000","last_undegraded":"2024-09-13T15:51:00.837843+0000","last_fullsized":"2024-09-13T15:51:00.837843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":60,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062328+0000","last_change":"2024-09-13T15:34:34.949988+0000","last_active":"2024-09-13T15:51:00.062328+0000","last_peered":"2024-09-13T15:51:00.062328+0000","last_clean":"2024-09-13T15:51:00.062328+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:51:00.062328+0000","last_undegraded":"2024-09-13T15:51:00.062328+0000","last_fullsized":"2024-09-13T15:51:00.062328+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.339867+0000","last_change":"2024-09-13T15:34:35.347690+0000","last_active":"2024-09-13T15:51:00.339867+0000","last_peered":"2024-09-13T15:51:00.339867+0000","last_clean":"2024-09-13T15:51:00.339867+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:51:00.339867+0000","last_undegraded":"2024-09-13T15:51:00.339867+0000","last_fullsized":"2024-09-13T15:51:00.339867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:58:53.778485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336789+0000","last_change":"2024-09-13T15:34:34.953625+0000","last_active":"2024-09-13T15:51:00.336789+0000","last_peered":"2024-09-13T15:51:00.336789+0000","last_clean":"2024-09-13T15:51:00.336789+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:51:00.336789+0000","last_undegraded":"2024-09-13T15:51:00.336789+0000","last_fullsized":"2024-09-13T15:51:00.336789+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:21.884844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099410+0000","last_change":"2024-09-13T15:34:35.338289+0000","last_active":"2024-09-13T15:51:00.099410+0000","last_peered":"2024-09-13T15:51:00.099410+0000","last_clean":"2024-09-13T15:51:00.099410+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:51:00.099410+0000","last_undegraded":"2024-09-13T15:51:00.099410+0000","last_fullsized":"2024-09-13T15:51:00.099410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:34.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.063208+0000","last_change":"2024-09-13T15:34:34.939305+0000","last_active":"2024-09-13T15:51:00.063208+0000","last_peered":"2024-09-13T15:51:00.063208+0000","last_clean":"2024-09-13T15:51:00.063208+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:51:00.063208+0000","last_undegraded":"2024-09-13T15:51:00.063208+0000","last_fullsized":"2024-09-13T15:51:00.063208+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.050401+0000","last_change":"2024-09-13T15:34:35.335773+0000","last_active":"2024-09-13T15:51:00.050401+0000","last_peered":"2024-09-13T15:51:00.050401+0000","last_clean":"2024-09-13T15:51:00.050401+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:51:00.050401+0000","last_undegraded":"2024-09-13T15:51:00.050401+0000","last_fullsized":"2024-09-13T15:51:00.050401+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.332732+0000","last_change":"2024-09-13T15:34:34.950709+0000","last_active":"2024-09-13T15:51:00.332732+0000","last_peered":"2024-09-13T15:51:00.332732+0000","last_clean":"2024-09-13T15:51:00.332732+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:51:00.332732+0000","last_undegraded":"2024-09-13T15:51:00.332732+0000","last_fullsized":"2024-09-13T15:51:00.332732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:27.252405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094585+0000","last_change":"2024-09-13T15:34:35.340304+0000","last_active":"2024-09-13T15:51:00.094585+0000","last_peered":"2024-09-13T15:51:00.094585+0000","last_clean":"2024-09-13T15:51:00.094585+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:51:00.094585+0000","last_undegraded":"2024-09-13T15:51:00.094585+0000","last_fullsized":"2024-09-13T15:51:00.094585+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:45:36.236876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.333255+0000","last_change":"2024-09-13T15:34:34.954475+0000","last_active":"2024-09-13T15:51:00.333255+0000","last_peered":"2024-09-13T15:51:00.333255+0000","last_clean":"2024-09-13T15:51:00.333255+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:51:00.333255+0000","last_undegraded":"2024-09-13T15:51:00.333255+0000","last_fullsized":"2024-09-13T15:51:00.333255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:28:26.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095814+0000","last_change":"2024-09-13T15:34:34.957379+0000","last_active":"2024-09-13T15:51:00.095814+0000","last_peered":"2024-09-13T15:51:00.095814+0000","last_clean":"2024-09-13T15:51:00.095814+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:51:00.095814+0000","last_undegraded":"2024-09-13T15:51:00.095814+0000","last_fullsized":"2024-09-13T15:51:00.095814+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:27:54.933361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336793+0000","last_change":"2024-09-13T15:34:35.331843+0000","last_active":"2024-09-13T15:51:00.336793+0000","last_peered":"2024-09-13T15:51:00.336793+0000","last_clean":"2024-09-13T15:51:00.336793+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:51:00.336793+0000","last_undegraded":"2024-09-13T15:51:00.336793+0000","last_fullsized":"2024-09-13T15:51:00.336793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:22:43.103418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":58,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051973+0000","last_change":"2024-09-13T15:34:34.944458+0000","last_active":"2024-09-13T15:51:00.051973+0000","last_peered":"2024-09-13T15:51:00.051973+0000","last_clean":"2024-09-13T15:51:00.051973+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:51:00.051973+0000","last_undegraded":"2024-09-13T15:51:00.051973+0000","last_fullsized":"2024-09-13T15:51:00.051973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:38:55.843175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044815+0000","last_change":"2024-09-13T15:34:35.343571+0000","last_active":"2024-09-13T15:51:00.044815+0000","last_peered":"2024-09-13T15:51:00.044815+0000","last_clean":"2024-09-13T15:51:00.044815+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:51:00.044815+0000","last_undegraded":"2024-09-13T15:51:00.044815+0000","last_fullsized":"2024-09-13T15:51:00.044815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:50.589850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.096135+0000","last_change":"2024-09-13T15:34:35.331904+0000","last_active":"2024-09-13T15:51:00.096135+0000","last_peered":"2024-09-13T15:51:00.096135+0000","last_clean":"2024-09-13T15:51:00.096135+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:51:00.096135+0000","last_undegraded":"2024-09-13T15:51:00.096135+0000","last_fullsized":"2024-09-13T15:51:00.096135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:49:58.188112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.094949+0000","last_change":"2024-09-13T15:34:35.335517+0000","last_active":"2024-09-13T15:51:00.094949+0000","last_peered":"2024-09-13T15:51:00.094949+0000","last_clean":"2024-09-13T15:51:00.094949+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:51:00.094949+0000","last_undegraded":"2024-09-13T15:51:00.094949+0000","last_fullsized":"2024-09-13T15:51:00.094949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:58.399592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334061+0000","last_change":"2024-09-13T15:34:35.324690+0000","last_active":"2024-09-13T15:51:00.334061+0000","last_peered":"2024-09-13T15:51:00.334061+0000","last_clean":"2024-09-13T15:51:00.334061+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:51:00.334061+0000","last_undegraded":"2024-09-13T15:51:00.334061+0000","last_fullsized":"2024-09-13T15:51:00.334061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336765+0000","last_change":"2024-09-13T15:34:35.331611+0000","last_active":"2024-09-13T15:51:00.336765+0000","last_peered":"2024-09-13T15:51:00.336765+0000","last_clean":"2024-09-13T15:51:00.336765+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:51:00.336765+0000","last_undegraded":"2024-09-13T15:51:00.336765+0000","last_fullsized":"2024-09-13T15:51:00.336765+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:08.881292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.048264+0000","last_change":"2024-09-13T15:35:20.157986+0000","last_active":"2024-09-13T15:51:00.048264+0000","last_peered":"2024-09-13T15:51:00.048264+0000","last_clean":"2024-09-13T15:51:00.048264+0000","last_became_active":"2024-09-13T15:35:20.157317+0000","last_became_peered":"2024-09-13T15:35:20.157317+0000","last_unstale":"2024-09-13T15:51:00.048264+0000","last_undegraded":"2024-09-13T15:51:00.048264+0000","last_fullsized":"2024-09-13T15:51:00.048264+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:26:21.036558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.062666+0000","last_change":"2024-09-13T15:34:35.339305+0000","last_active":"2024-09-13T15:51:00.062666+0000","last_peered":"2024-09-13T15:51:00.062666+0000","last_clean":"2024-09-13T15:51:00.062666+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:51:00.062666+0000","last_undegraded":"2024-09-13T15:51:00.062666+0000","last_fullsized":"2024-09-13T15:51:00.062666+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099626+0000","last_change":"2024-09-13T15:34:35.335209+0000","last_active":"2024-09-13T15:51:00.099626+0000","last_peered":"2024-09-13T15:51:00.099626+0000","last_clean":"2024-09-13T15:51:00.099626+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:51:00.099626+0000","last_undegraded":"2024-09-13T15:51:00.099626+0000","last_fullsized":"2024-09-13T15:51:00.099626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:38.582754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.099756+0000","last_change":"2024-09-13T15:34:35.336949+0000","last_active":"2024-09-13T15:51:00.099756+0000","last_peered":"2024-09-13T15:51:00.099756+0000","last_clean":"2024-09-13T15:51:00.099756+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:51:00.099756+0000","last_undegraded":"2024-09-13T15:51:00.099756+0000","last_fullsized":"2024-09-13T15:51:00.099756+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:45.530761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.332962+0000","last_change":"2024-09-13T15:34:35.327879+0000","last_active":"2024-09-13T15:51:00.332962+0000","last_peered":"2024-09-13T15:51:00.332962+0000","last_clean":"2024-09-13T15:51:00.332962+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:51:00.332962+0000","last_undegraded":"2024-09-13T15:51:00.332962+0000","last_fullsized":"2024-09-13T15:51:00.332962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334238+0000","last_change":"2024-09-13T15:34:35.324523+0000","last_active":"2024-09-13T15:51:00.334238+0000","last_peered":"2024-09-13T15:51:00.334238+0000","last_clean":"2024-09-13T15:51:00.334238+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:51:00.334238+0000","last_undegraded":"2024-09-13T15:51:00.334238+0000","last_fullsized":"2024-09-13T15:51:00.334238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.044962+0000","last_change":"2024-09-13T15:34:35.329712+0000","last_active":"2024-09-13T15:51:00.044962+0000","last_peered":"2024-09-13T15:51:00.044962+0000","last_clean":"2024-09-13T15:51:00.044962+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:51:00.044962+0000","last_undegraded":"2024-09-13T15:51:00.044962+0000","last_fullsized":"2024-09-13T15:51:00.044962+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.271849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":46,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.051700+0000","last_change":"2024-09-13T15:35:20.156675+0000","last_active":"2024-09-13T15:51:00.051700+0000","last_peered":"2024-09-13T15:51:00.051700+0000","last_clean":"2024-09-13T15:51:00.051700+0000","last_became_active":"2024-09-13T15:35:20.152889+0000","last_became_peered":"2024-09-13T15:35:20.152889+0000","last_unstale":"2024-09-13T15:51:00.051700+0000","last_undegraded":"2024-09-13T15:51:00.051700+0000","last_fullsized":"2024-09-13T15:51:00.051700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:12.515681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.338254+0000","last_change":"2024-09-13T15:34:35.346893+0000","last_active":"2024-09-13T15:51:00.338254+0000","last_peered":"2024-09-13T15:51:00.338254+0000","last_clean":"2024-09-13T15:51:00.338254+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:51:00.338254+0000","last_undegraded":"2024-09-13T15:51:00.338254+0000","last_fullsized":"2024-09-13T15:51:00.338254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:52.439034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336587+0000","last_change":"2024-09-13T15:34:35.324912+0000","last_active":"2024-09-13T15:51:00.336587+0000","last_peered":"2024-09-13T15:51:00.336587+0000","last_clean":"2024-09-13T15:51:00.336587+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:51:00.336587+0000","last_undegraded":"2024-09-13T15:51:00.336587+0000","last_fullsized":"2024-09-13T15:51:00.336587+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.352332+0000","last_change":"2024-09-13T15:34:35.335384+0000","last_active":"2024-09-13T15:51:02.352332+0000","last_peered":"2024-09-13T15:51:02.352332+0000","last_clean":"2024-09-13T15:51:02.352332+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:51:02.352332+0000","last_undegraded":"2024-09-13T15:51:02.352332+0000","last_fullsized":"2024-09-13T15:51:02.352332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:42.018381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.841051+0000","last_change":"2024-09-13T15:34:35.333522+0000","last_active":"2024-09-13T15:51:00.841051+0000","last_peered":"2024-09-13T15:51:00.841051+0000","last_clean":"2024-09-13T15:51:00.841051+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:51:00.841051+0000","last_undegraded":"2024-09-13T15:51:00.841051+0000","last_fullsized":"2024-09-13T15:51:00.841051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.342895+0000","last_change":"2024-09-13T15:34:35.331848+0000","last_active":"2024-09-13T15:51:02.342895+0000","last_peered":"2024-09-13T15:51:02.342895+0000","last_clean":"2024-09-13T15:51:02.342895+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:51:02.342895+0000","last_undegraded":"2024-09-13T15:51:02.342895+0000","last_fullsized":"2024-09-13T15:51:02.342895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:47:31.943240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.834589+0000","last_change":"2024-09-13T15:34:35.333765+0000","last_active":"2024-09-13T15:51:00.834589+0000","last_peered":"2024-09-13T15:51:00.834589+0000","last_clean":"2024-09-13T15:51:00.834589+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:51:00.834589+0000","last_undegraded":"2024-09-13T15:51:00.834589+0000","last_fullsized":"2024-09-13T15:51:00.834589+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:08.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":58,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-13T15:51:02.108861+0000","last_change":"2024-09-13T15:34:35.335599+0000","last_active":"2024-09-13T15:51:02.108861+0000","last_peered":"2024-09-13T15:51:02.108861+0000","last_clean":"2024-09-13T15:51:02.108861+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:51:02.108861+0000","last_undegraded":"2024-09-13T15:51:02.108861+0000","last_fullsized":"2024-09-13T15:51:02.108861+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:06.605564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.335794+0000","last_change":"2024-09-13T15:34:35.335252+0000","last_active":"2024-09-13T15:51:00.335794+0000","last_peered":"2024-09-13T15:51:00.335794+0000","last_clean":"2024-09-13T15:51:00.335794+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:51:00.335794+0000","last_undegraded":"2024-09-13T15:51:00.335794+0000","last_fullsized":"2024-09-13T15:51:00.335794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:37.432254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.338693+0000","last_change":"2024-09-13T15:34:35.330875+0000","last_active":"2024-09-13T15:51:00.338693+0000","last_peered":"2024-09-13T15:51:00.338693+0000","last_clean":"2024-09-13T15:51:00.338693+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:51:00.338693+0000","last_undegraded":"2024-09-13T15:51:00.338693+0000","last_fullsized":"2024-09-13T15:51:00.338693+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:22.297990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336857+0000","last_change":"2024-09-13T15:34:35.331709+0000","last_active":"2024-09-13T15:51:00.336857+0000","last_peered":"2024-09-13T15:51:00.336857+0000","last_clean":"2024-09-13T15:51:00.336857+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:51:00.336857+0000","last_undegraded":"2024-09-13T15:51:00.336857+0000","last_fullsized":"2024-09-13T15:51:00.336857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:17.069173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.338009+0000","last_change":"2024-09-13T15:34:35.319299+0000","last_active":"2024-09-13T15:51:00.338009+0000","last_peered":"2024-09-13T15:51:00.338009+0000","last_clean":"2024-09-13T15:51:00.338009+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:51:00.338009+0000","last_undegraded":"2024-09-13T15:51:00.338009+0000","last_fullsized":"2024-09-13T15:51:00.338009+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:16.700428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":56,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.069443+0000","last_change":"2024-09-13T15:34:35.345251+0000","last_active":"2024-09-13T15:51:00.069443+0000","last_peered":"2024-09-13T15:51:00.069443+0000","last_clean":"2024-09-13T15:51:00.069443+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:51:00.069443+0000","last_undegraded":"2024-09-13T15:51:00.069443+0000","last_fullsized":"2024-09-13T15:51:00.069443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:16.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095085+0000","last_change":"2024-09-13T15:34:35.335400+0000","last_active":"2024-09-13T15:51:00.095085+0000","last_peered":"2024-09-13T15:51:00.095085+0000","last_clean":"2024-09-13T15:51:00.095085+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:51:00.095085+0000","last_undegraded":"2024-09-13T15:51:00.095085+0000","last_fullsized":"2024-09-13T15:51:00.095085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:44:13.709812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.334006+0000","last_change":"2024-09-13T15:34:35.334719+0000","last_active":"2024-09-13T15:51:00.334006+0000","last_peered":"2024-09-13T15:51:00.334006+0000","last_clean":"2024-09-13T15:51:00.334006+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:51:00.334006+0000","last_undegraded":"2024-09-13T15:51:00.334006+0000","last_fullsized":"2024-09-13T15:51:00.334006+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:14.171807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095974+0000","last_change":"2024-09-13T15:34:35.329319+0000","last_active":"2024-09-13T15:51:00.095974+0000","last_peered":"2024-09-13T15:51:00.095974+0000","last_clean":"2024-09-13T15:51:00.095974+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:51:00.095974+0000","last_undegraded":"2024-09-13T15:51:00.095974+0000","last_fullsized":"2024-09-13T15:51:00.095974+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:21:27.664725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":57,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336154+0000","last_change":"2024-09-13T15:34:35.327922+0000","last_active":"2024-09-13T15:51:00.336154+0000","last_peered":"2024-09-13T15:51:00.336154+0000","last_clean":"2024-09-13T15:51:00.336154+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:51:00.336154+0000","last_undegraded":"2024-09-13T15:51:00.336154+0000","last_fullsized":"2024-09-13T15:51:00.336154+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:22.066293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":59,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.095681+0000","last_change":"2024-09-13T15:34:35.330864+0000","last_active":"2024-09-13T15:51:00.095681+0000","last_peered":"2024-09-13T15:51:00.095681+0000","last_clean":"2024-09-13T15:51:00.095681+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:51:00.095681+0000","last_undegraded":"2024-09-13T15:51:00.095681+0000","last_fullsized":"2024-09-13T15:51:00.095681+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:56.680849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.336165+0000","last_change":"2024-09-13T15:34:35.324580+0000","last_active":"2024-09-13T15:51:00.336165+0000","last_peered":"2024-09-13T15:51:00.336165+0000","last_clean":"2024-09-13T15:51:00.336165+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:51:00.336165+0000","last_undegraded":"2024-09-13T15:51:00.336165+0000","last_fullsized":"2024-09-13T15:51:00.336165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:09:08.082085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":57,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.058052+0000","last_change":"2024-09-13T15:34:35.329279+0000","last_active":"2024-09-13T15:51:00.058052+0000","last_peered":"2024-09-13T15:51:00.058052+0000","last_clean":"2024-09-13T15:51:00.058052+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:51:00.058052+0000","last_undegraded":"2024-09-13T15:51:00.058052+0000","last_fullsized":"2024-09-13T15:51:00.058052+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:05.640351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":58,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-13T15:51:00.340148+0000","last_change":"2024-09-13T15:34:35.347293+0000","last_active":"2024-09-13T15:51:00.340148+0000","last_peered":"2024-09-13T15:51:00.340148+0000","last_clean":"2024-09-13T15:51:00.340148+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:51:00.340148+0000","last_undegraded":"2024-09-13T15:51:00.340148+0000","last_fullsized":"2024-09-13T15:51:00.340148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:52.388403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3436,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738571,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148124,"kb_used_data":48912,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94223716,"statfs":{"total":96636764160,"available":96485085184,"internally_reserved":0,"allocated":50085888,"data_stored":38240820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.42999999999999999},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.152},"max":{"1min":0.65600000000000003,"5min":0.83899999999999997,"15min":3.4550000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.46300000000000002},"min":{"1min":0.32300000000000001,"5min":0.248,"15min":0.18099999999999999},"max":{"1min":0.76900000000000002,"5min":0.97499999999999998,"15min":6.1989999999999998},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53600000000000003,"15min":0.46300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.185},"max":{"1min":0.82699999999999996,"5min":1.006,"15min":1.4790000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.495},"min":{"1min":0.31,"5min":0.30299999999999999,"15min":0.17799999999999999},"max":{"1min":0.73199999999999998,"5min":1.0589999999999999,"15min":1.399},"last":0.58399999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738570,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":335876,"kb_used_data":188272,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":94035964,"statfs":{"total":96636764160,"available":96292827136,"internally_reserved":0,"allocated":192790528,"data_stored":179551003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45600000000000002,"15min":0.41599999999999998},"min":{"1min":0.26900000000000002,"5min":0.214,"15min":0.159},"max":{"1min":0.64700000000000002,"5min":0.69599999999999995,"15min":4.2400000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.432},"min":{"1min":0.33900000000000002,"5min":0.20399999999999999,"15min":0.17100000000000001},"max":{"1min":0.70399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.443},"min":{"1min":0.42099999999999999,"5min":0.26400000000000001,"15min":0.17199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.82999999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57299999999999995,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.253,"15min":0.189},"max":{"1min":0.86099999999999999,"5min":0.93000000000000005,"15min":1.2789999999999999},"last":0.86099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738572,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":187712,"kb_used_data":30260,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94184128,"statfs":{"total":96636764160,"available":96444547072,"internally_reserved":0,"allocated":30986240,"data_stored":20392376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":161216966},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47899999999999998,"15min":0.40799999999999997},"min":{"1min":0.28399999999999997,"5min":0.20399999999999999,"15min":0.158},"max":{"1min":0.755,"5min":0.80900000000000005,"15min":0.873},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.42699999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.186},"max":{"1min":0.68200000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53700000000000003,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.17899999999999999},"max":{"1min":0.77400000000000002,"5min":0.82099999999999995,"15min":9.4610000000000003},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.48599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.20300000000000001},"max":{"1min":0.67700000000000005,"5min":0.84899999999999998,"15min":0.90700000000000003},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:51:07.527 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.528 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.528 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.528 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.528 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.528 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.528 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.528 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.528 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.529 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.529 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.529 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.529 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.529 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.529 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.529 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.529 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.530 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.530 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.530 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.530 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.530 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.530 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.530 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.530 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.530 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.531 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.531 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.531 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.531 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.531 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.531 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.531 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T15:34:25.870427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.531 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.531 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.532 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.532 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.532 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.532 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.532 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.532 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.532 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.532 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.532 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.533 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.533 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.533 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.533 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.533 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.533 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.533 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.533 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.533 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.534 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.534 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.534 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.534 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.534 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.534 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.534 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.534 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.535 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.535 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.535 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.535 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.535 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.535 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.535 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.535 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.535 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.536 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.536 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.536 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.536 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.536 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.536 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.536 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.536 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.536 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.537 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.537 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.537 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.537 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.537 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.537 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.537 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.537 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.537 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.538 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.538 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.538 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.538 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.538 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.538 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.538 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.538 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.539 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:07.539 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T15:51:27.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:51:27.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.672+0000 7ff9cb39e640 1 Processor -- start 2024-09-13T15:51:27.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.672+0000 7ff9cb39e640 1 -- start start 2024-09-13T15:51:27.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.672+0000 7ff9cb39e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff9c40be340 0x7ff9c415a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:27.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.672+0000 7ff9cb39e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c40c1130 con 0x7ff9c40b4600 2024-09-13T15:51:27.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.672+0000 7ff9cb39e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c414e780 con 0x7ff9c40be340 2024-09-13T15:51:27.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.672+0000 7ff9c8939640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff9c40be340 0x7ff9c415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:27.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.672+0000 7ff9c913a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff9c40b4600 0x7ff9c414dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56514/0 (socket says 172.21.15.40:56514) 2024-09-13T15:51:27.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.672+0000 7ff9c913a640 1 -- 172.21.15.40:0/3638063726 learned_addr learned my addr 172.21.15.40:0/3638063726 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:51:27.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.672+0000 7ff9c8939640 1 -- 172.21.15.40:0/3638063726 >> v1:172.21.15.40:6789/0 conn(0x7ff9c40b4600 legacy=0x7ff9c414dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:27.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.672+0000 7ff9c8939640 1 -- 172.21.15.40:0/3638063726 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c414e450 con 0x7ff9c40be340 2024-09-13T15:51:27.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.672+0000 7ff9bbfff640 1 -- 172.21.15.40:0/3638063726 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3430262481 0 0) 0x7ff9c40c1130 con 0x7ff9c40b4600 2024-09-13T15:51:27.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9c8939640 1 --2- 172.21.15.40:0/3638063726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9c40be340 0x7ff9c415a750 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009740 tx=0x7ff9b401c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbc4a8f06976b60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:27.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9bbfff640 1 -- 172.21.15.40:0/3638063726 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9b40ab530 con 0x7ff9c40be340 2024-09-13T15:51:27.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9bbfff640 1 -- 172.21.15.40:0/3638063726 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b40a7050 con 0x7ff9c40be340 2024-09-13T15:51:27.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9bbfff640 1 -- 172.21.15.40:0/3638063726 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9b40ab7e0 con 0x7ff9c40be340 2024-09-13T15:51:27.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9cb39e640 1 -- 172.21.15.40:0/3638063726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9c40be340 msgr2=0x7ff9c415a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:27.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9cb39e640 1 --2- 172.21.15.40:0/3638063726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9c40be340 0x7ff9c415a750 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4009740 tx=0x7ff9b401c0d0 comp rx=0 tx=0).stop 2024-09-13T15:51:27.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9cb39e640 1 -- 172.21.15.40:0/3638063726 shutdown_connections 2024-09-13T15:51:27.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9cb39e640 1 --2- 172.21.15.40:0/3638063726 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9c40be340 0x7ff9c415a750 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:27.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9cb39e640 1 -- 172.21.15.40:0/3638063726 >> 172.21.15.40:0/3638063726 conn(0x7ff9c406a540 msgr2=0x7ff9c40a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:27.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9cb39e640 1 -- 172.21.15.40:0/3638063726 shutdown_connections 2024-09-13T15:51:27.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9cb39e640 1 -- 172.21.15.40:0/3638063726 wait complete. 2024-09-13T15:51:27.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9cb39e640 1 Processor -- start 2024-09-13T15:51:27.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9cb39e640 1 -- start start 2024-09-13T15:51:27.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9cb39e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9c40b4600 0x7ff9c413cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:27.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9cb39e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c415cd60 con 0x7ff9c40b4600 2024-09-13T15:51:27.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9c913a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9c40b4600 0x7ff9c413cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:27.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9c913a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9c40b4600 0x7ff9c413cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49482/0 (socket says 172.21.15.40:49482) 2024-09-13T15:51:27.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.676+0000 7ff9c913a640 1 -- 172.21.15.40:0/1108559514 learned_addr learned my addr 172.21.15.40:0/1108559514 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:27.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9c913a640 1 -- 172.21.15.40:0/1108559514 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b4009420 con 0x7ff9c40b4600 2024-09-13T15:51:27.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9c913a640 1 --2- 172.21.15.40:0/1108559514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9c40b4600 0x7ff9c413cbe0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000c420 tx=0x7ff9c000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:27.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9b9ffb640 1 -- 172.21.15.40:0/1108559514 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9c00074d0 con 0x7ff9c40b4600 2024-09-13T15:51:27.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9b9ffb640 1 -- 172.21.15.40:0/1108559514 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c0007630 con 0x7ff9c40b4600 2024-09-13T15:51:27.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9cb39e640 1 -- 172.21.15.40:0/1108559514 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c414f960 con 0x7ff9c40b4600 2024-09-13T15:51:27.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9b9ffb640 1 -- 172.21.15.40:0/1108559514 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9c0004960 con 0x7ff9c40b4600 2024-09-13T15:51:27.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9cb39e640 1 -- 172.21.15.40:0/1108559514 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c40b5360 con 0x7ff9c40b4600 2024-09-13T15:51:27.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9b9ffb640 1 -- 172.21.15.40:0/1108559514 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7ff9c0004ac0 con 0x7ff9c40b4600 2024-09-13T15:51:27.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9cb39e640 1 -- 172.21.15.40:0/1108559514 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c415a750 con 0x7ff9c40b4600 2024-09-13T15:51:27.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9b9ffb640 1 --2- 172.21.15.40:0/1108559514 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff9a8035530 0x7ff9a80379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:27.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9b9ffb640 1 -- 172.21.15.40:0/1108559514 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7ff9c00474c0 con 0x7ff9c40b4600 2024-09-13T15:51:27.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9c8939640 1 --2- 172.21.15.40:0/1108559514 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff9a8035530 0x7ff9a80379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:27.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.680+0000 7ff9c8939640 1 --2- 172.21.15.40:0/1108559514 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff9a8035530 0x7ff9a80379f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40ad000 tx=0x7ff9b40a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:27.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.684+0000 7ff9b9ffb640 1 -- 172.21.15.40:0/1108559514 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff9c001acd0 con 0x7ff9c40b4600 2024-09-13T15:51:27.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.844+0000 7ff9cb39e640 1 -- 172.21.15.40:0/1108559514 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9c40a3b40 con 0x7ff9a8035530 2024-09-13T15:51:27.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.848+0000 7ff9b9ffb640 1 -- 172.21.15.40:0/1108559514 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+247003 (secure 0 0 0) 0x7ff9c40a3b40 con 0x7ff9a8035530 2024-09-13T15:51:27.860 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:51:27.862 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:51:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.856+0000 7ff9cb39e640 1 -- 172.21.15.40:0/1108559514 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff9a8035530 msgr2=0x7ff9a80379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.856+0000 7ff9cb39e640 1 --2- 172.21.15.40:0/1108559514 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff9a8035530 0x7ff9a80379f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40ad000 tx=0x7ff9b40a6000 comp rx=0 tx=0).stop 2024-09-13T15:51:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.856+0000 7ff9cb39e640 1 -- 172.21.15.40:0/1108559514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9c40b4600 msgr2=0x7ff9c413cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.856+0000 7ff9cb39e640 1 --2- 172.21.15.40:0/1108559514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9c40b4600 0x7ff9c413cbe0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff9c000c420 tx=0x7ff9c000c8e0 comp rx=0 tx=0).stop 2024-09-13T15:51:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.856+0000 7ff9cb39e640 1 -- 172.21.15.40:0/1108559514 shutdown_connections 2024-09-13T15:51:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.856+0000 7ff9cb39e640 1 --2- 172.21.15.40:0/1108559514 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff9a8035530 0x7ff9a80379f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.856+0000 7ff9cb39e640 1 --2- 172.21.15.40:0/1108559514 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9c40b4600 0x7ff9c413cbe0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.856+0000 7ff9cb39e640 1 -- 172.21.15.40:0/1108559514 >> 172.21.15.40:0/1108559514 conn(0x7ff9c406a540 msgr2=0x7ff9c414d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.856+0000 7ff9cb39e640 1 -- 172.21.15.40:0/1108559514 shutdown_connections 2024-09-13T15:51:27.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:27.856+0000 7ff9cb39e640 1 -- 172.21.15.40:0/1108559514 wait complete. 2024-09-13T15:51:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":466,"stamp":"2024-09-13T15:51:25.855075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593804,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":208,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":407428,"kb_used_data":3180,"kb_used_omap":4,"kb_used_meta":404219,"kb_avail":282708092,"statfs":{"total":289910292480,"available":289493086208,"internally_reserved":0,"allocated":3256320,"data_stored":2080045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":413920594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004650"},"pg_stats":[{"pgid":"2.1f","version":"15'4","reported_seq":66,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279329+0000","last_change":"2024-09-13T15:34:34.960705+0000","last_active":"2024-09-13T15:51:06.279329+0000","last_peered":"2024-09-13T15:51:06.279329+0000","last_clean":"2024-09-13T15:51:06.279329+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:51:06.279329+0000","last_undegraded":"2024-09-13T15:51:06.279329+0000","last_fullsized":"2024-09-13T15:51:06.279329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:22.675129+0000","last_change":"2024-09-13T15:51:22.675350+0000","last_active":"2024-09-13T15:51:22.675129+0000","last_peered":"2024-09-13T15:51:22.675129+0000","last_clean":"2024-09-13T15:51:22.675129+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:51:22.675129+0000","last_undegraded":"2024-09-13T15:51:22.675129+0000","last_fullsized":"2024-09-13T15:51:22.675129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:22.675078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:22.675078+0000","last_clean_scrub_stamp":"2024-09-13T15:51:22.675078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:11.304477+0000","scrub_duration":0.002879932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107473+0000","last_change":"2024-09-13T15:34:34.955842+0000","last_active":"2024-09-13T15:51:03.107473+0000","last_peered":"2024-09-13T15:51:03.107473+0000","last_clean":"2024-09-13T15:51:03.107473+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:51:03.107473+0000","last_undegraded":"2024-09-13T15:51:03.107473+0000","last_fullsized":"2024-09-13T15:51:03.107473+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279719+0000","last_change":"2024-09-13T15:34:35.350474+0000","last_active":"2024-09-13T15:51:06.279719+0000","last_peered":"2024-09-13T15:51:06.279719+0000","last_clean":"2024-09-13T15:51:06.279719+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:51:06.279719+0000","last_undegraded":"2024-09-13T15:51:06.279719+0000","last_fullsized":"2024-09-13T15:51:06.279719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746776+0000","last_change":"2024-09-13T15:34:34.950125+0000","last_active":"2024-09-13T15:51:03.746776+0000","last_peered":"2024-09-13T15:51:03.746776+0000","last_clean":"2024-09-13T15:51:03.746776+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:51:03.746776+0000","last_undegraded":"2024-09-13T15:51:03.746776+0000","last_fullsized":"2024-09-13T15:51:03.746776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.267603+0000","last_change":"2024-09-13T15:34:35.333710+0000","last_active":"2024-09-13T15:51:03.267603+0000","last_peered":"2024-09-13T15:51:03.267603+0000","last_clean":"2024-09-13T15:51:03.267603+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:51:03.267603+0000","last_undegraded":"2024-09-13T15:51:03.267603+0000","last_fullsized":"2024-09-13T15:51:03.267603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":53,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.114859+0000","last_change":"2024-09-13T15:35:20.173539+0000","last_active":"2024-09-13T15:51:03.114859+0000","last_peered":"2024-09-13T15:51:03.114859+0000","last_clean":"2024-09-13T15:51:03.114859+0000","last_became_active":"2024-09-13T15:35:20.165658+0000","last_became_peered":"2024-09-13T15:35:20.165658+0000","last_unstale":"2024-09-13T15:51:03.114859+0000","last_undegraded":"2024-09-13T15:51:03.114859+0000","last_fullsized":"2024-09-13T15:51:03.114859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.112758+0000","last_change":"2024-09-13T15:34:35.329220+0000","last_active":"2024-09-13T15:51:03.112758+0000","last_peered":"2024-09-13T15:51:03.112758+0000","last_clean":"2024-09-13T15:51:03.112758+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:51:03.112758+0000","last_undegraded":"2024-09-13T15:51:03.112758+0000","last_fullsized":"2024-09-13T15:51:03.112758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.745504+0000","last_change":"2024-09-13T15:34:35.334308+0000","last_active":"2024-09-13T15:51:03.745504+0000","last_peered":"2024-09-13T15:51:03.745504+0000","last_clean":"2024-09-13T15:51:03.745504+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:51:03.745504+0000","last_undegraded":"2024-09-13T15:51:03.745504+0000","last_fullsized":"2024-09-13T15:51:03.745504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747277+0000","last_change":"2024-09-13T15:34:34.943033+0000","last_active":"2024-09-13T15:51:03.747277+0000","last_peered":"2024-09-13T15:51:03.747277+0000","last_clean":"2024-09-13T15:51:03.747277+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:51:03.747277+0000","last_undegraded":"2024-09-13T15:51:03.747277+0000","last_fullsized":"2024-09-13T15:51:03.747277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.268928+0000","last_change":"2024-09-13T15:34:35.339704+0000","last_active":"2024-09-13T15:51:03.268928+0000","last_peered":"2024-09-13T15:51:03.268928+0000","last_clean":"2024-09-13T15:51:03.268928+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:51:03.268928+0000","last_undegraded":"2024-09-13T15:51:03.268928+0000","last_fullsized":"2024-09-13T15:51:03.268928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.264122+0000","last_change":"2024-09-13T15:34:34.943732+0000","last_active":"2024-09-13T15:51:03.264122+0000","last_peered":"2024-09-13T15:51:03.264122+0000","last_clean":"2024-09-13T15:51:03.264122+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:51:03.264122+0000","last_undegraded":"2024-09-13T15:51:03.264122+0000","last_fullsized":"2024-09-13T15:51:03.264122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.109002+0000","last_change":"2024-09-13T15:34:35.340037+0000","last_active":"2024-09-13T15:51:03.109002+0000","last_peered":"2024-09-13T15:51:03.109002+0000","last_clean":"2024-09-13T15:51:03.109002+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:51:03.109002+0000","last_undegraded":"2024-09-13T15:51:03.109002+0000","last_fullsized":"2024-09-13T15:51:03.109002+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.262321+0000","last_change":"2024-09-13T15:34:34.943197+0000","last_active":"2024-09-13T15:51:03.262321+0000","last_peered":"2024-09-13T15:51:03.262321+0000","last_clean":"2024-09-13T15:51:03.262321+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:51:03.262321+0000","last_undegraded":"2024-09-13T15:51:03.262321+0000","last_fullsized":"2024-09-13T15:51:03.262321+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.745960+0000","last_change":"2024-09-13T15:34:35.327260+0000","last_active":"2024-09-13T15:51:03.745960+0000","last_peered":"2024-09-13T15:51:03.745960+0000","last_clean":"2024-09-13T15:51:03.745960+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:51:03.745960+0000","last_undegraded":"2024-09-13T15:51:03.745960+0000","last_fullsized":"2024-09-13T15:51:03.745960+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.744627+0000","last_change":"2024-09-13T15:34:34.941308+0000","last_active":"2024-09-13T15:51:03.744627+0000","last_peered":"2024-09-13T15:51:03.744627+0000","last_clean":"2024-09-13T15:51:03.744627+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:51:03.744627+0000","last_undegraded":"2024-09-13T15:51:03.744627+0000","last_fullsized":"2024-09-13T15:51:03.744627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747672+0000","last_change":"2024-09-13T15:34:35.334433+0000","last_active":"2024-09-13T15:51:03.747672+0000","last_peered":"2024-09-13T15:51:03.747672+0000","last_clean":"2024-09-13T15:51:03.747672+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:51:03.747672+0000","last_undegraded":"2024-09-13T15:51:03.747672+0000","last_fullsized":"2024-09-13T15:51:03.747672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.267711+0000","last_change":"2024-09-13T15:34:34.946540+0000","last_active":"2024-09-13T15:51:03.267711+0000","last_peered":"2024-09-13T15:51:03.267711+0000","last_clean":"2024-09-13T15:51:03.267711+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:51:03.267711+0000","last_undegraded":"2024-09-13T15:51:03.267711+0000","last_fullsized":"2024-09-13T15:51:03.267711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:11.573036+0000","last_change":"2024-09-13T15:51:11.573279+0000","last_active":"2024-09-13T15:51:11.573036+0000","last_peered":"2024-09-13T15:51:11.573036+0000","last_clean":"2024-09-13T15:51:11.573036+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:51:11.573036+0000","last_undegraded":"2024-09-13T15:51:11.573036+0000","last_fullsized":"2024-09-13T15:51:11.573036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:11.572987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:11.572987+0000","last_clean_scrub_stamp":"2024-09-13T15:51:11.572987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:21.045297+0000","scrub_duration":0.0030285730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.275840+0000","last_change":"2024-09-13T15:34:34.942452+0000","last_active":"2024-09-13T15:51:03.275840+0000","last_peered":"2024-09-13T15:51:03.275840+0000","last_clean":"2024-09-13T15:51:03.275840+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:51:03.275840+0000","last_undegraded":"2024-09-13T15:51:03.275840+0000","last_fullsized":"2024-09-13T15:51:03.275840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:10.000654+0000","last_change":"2024-09-13T15:51:10.000654+0000","last_active":"2024-09-13T15:51:10.000654+0000","last_peered":"2024-09-13T15:51:10.000654+0000","last_clean":"2024-09-13T15:51:10.000654+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:51:10.000654+0000","last_undegraded":"2024-09-13T15:51:10.000654+0000","last_fullsized":"2024-09-13T15:51:10.000654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:10.000340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:10.000340+0000","last_clean_scrub_stamp":"2024-09-13T15:51:10.000340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.854008+0000","scrub_duration":0.0030965559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734506+0000","last_change":"2024-09-13T15:34:34.949805+0000","last_active":"2024-09-13T15:51:06.734506+0000","last_peered":"2024-09-13T15:51:06.734506+0000","last_clean":"2024-09-13T15:51:06.734506+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:51:06.734506+0000","last_undegraded":"2024-09-13T15:51:06.734506+0000","last_fullsized":"2024-09-13T15:51:06.734506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:08.634807+0000","last_change":"2024-09-13T15:51:08.634807+0000","last_active":"2024-09-13T15:51:08.634807+0000","last_peered":"2024-09-13T15:51:08.634807+0000","last_clean":"2024-09-13T15:51:08.634807+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:51:08.634807+0000","last_undegraded":"2024-09-13T15:51:08.634807+0000","last_fullsized":"2024-09-13T15:51:08.634807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:08.634488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:08.634488+0000","last_clean_scrub_stamp":"2024-09-13T15:51:08.634488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:29.659635+0000","scrub_duration":0.0033577189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734286+0000","last_change":"2024-09-13T15:34:34.946174+0000","last_active":"2024-09-13T15:51:06.734286+0000","last_peered":"2024-09-13T15:51:06.734286+0000","last_clean":"2024-09-13T15:51:06.734286+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:51:06.734286+0000","last_undegraded":"2024-09-13T15:51:06.734286+0000","last_fullsized":"2024-09-13T15:51:06.734286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279453+0000","last_change":"2024-09-13T15:34:35.327755+0000","last_active":"2024-09-13T15:51:06.279453+0000","last_peered":"2024-09-13T15:51:06.279453+0000","last_clean":"2024-09-13T15:51:06.279453+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:51:06.279453+0000","last_undegraded":"2024-09-13T15:51:06.279453+0000","last_fullsized":"2024-09-13T15:51:06.279453+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279121+0000","last_change":"2024-09-13T15:34:34.953984+0000","last_active":"2024-09-13T15:51:06.279121+0000","last_peered":"2024-09-13T15:51:06.279121+0000","last_clean":"2024-09-13T15:51:06.279121+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:51:06.279121+0000","last_undegraded":"2024-09-13T15:51:06.279121+0000","last_fullsized":"2024-09-13T15:51:06.279121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.275524+0000","last_change":"2024-09-13T15:34:35.336428+0000","last_active":"2024-09-13T15:51:03.275524+0000","last_peered":"2024-09-13T15:51:03.275524+0000","last_clean":"2024-09-13T15:51:03.275524+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:51:03.275524+0000","last_undegraded":"2024-09-13T15:51:03.275524+0000","last_fullsized":"2024-09-13T15:51:03.275524+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.192147+0000","last_change":"2024-09-13T15:34:34.955761+0000","last_active":"2024-09-13T15:51:07.192147+0000","last_peered":"2024-09-13T15:51:07.192147+0000","last_clean":"2024-09-13T15:51:07.192147+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:51:07.192147+0000","last_undegraded":"2024-09-13T15:51:07.192147+0000","last_fullsized":"2024-09-13T15:51:07.192147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279478+0000","last_change":"2024-09-13T15:34:35.324328+0000","last_active":"2024-09-13T15:51:06.279478+0000","last_peered":"2024-09-13T15:51:06.279478+0000","last_clean":"2024-09-13T15:51:06.279478+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:51:06.279478+0000","last_undegraded":"2024-09-13T15:51:06.279478+0000","last_fullsized":"2024-09-13T15:51:06.279478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107850+0000","last_change":"2024-09-13T15:34:34.960919+0000","last_active":"2024-09-13T15:51:03.107850+0000","last_peered":"2024-09-13T15:51:03.107850+0000","last_clean":"2024-09-13T15:51:03.107850+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:51:03.107850+0000","last_undegraded":"2024-09-13T15:51:03.107850+0000","last_fullsized":"2024-09-13T15:51:03.107850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734689+0000","last_change":"2024-09-13T15:34:35.339727+0000","last_active":"2024-09-13T15:51:06.734689+0000","last_peered":"2024-09-13T15:51:06.734689+0000","last_clean":"2024-09-13T15:51:06.734689+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:51:06.734689+0000","last_undegraded":"2024-09-13T15:51:06.734689+0000","last_fullsized":"2024-09-13T15:51:06.734689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734325+0000","last_change":"2024-09-13T15:34:34.939804+0000","last_active":"2024-09-13T15:51:06.734325+0000","last_peered":"2024-09-13T15:51:06.734325+0000","last_clean":"2024-09-13T15:51:06.734325+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:51:06.734325+0000","last_undegraded":"2024-09-13T15:51:06.734325+0000","last_fullsized":"2024-09-13T15:51:06.734325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'108","reported_seq":231,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.275499+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:51:03.275499+0000","last_peered":"2024-09-13T15:51:03.275499+0000","last_clean":"2024-09-13T15:51:03.275499+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:51:03.275499+0000","last_undegraded":"2024-09-13T15:51:03.275499+0000","last_fullsized":"2024-09-13T15:51:03.275499+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":70,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:09.022828+0000","last_change":"2024-09-13T15:51:09.023040+0000","last_active":"2024-09-13T15:51:09.022828+0000","last_peered":"2024-09-13T15:51:09.022828+0000","last_clean":"2024-09-13T15:51:09.022828+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:51:09.022828+0000","last_undegraded":"2024-09-13T15:51:09.022828+0000","last_fullsized":"2024-09-13T15:51:09.022828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:09.022780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:09.022780+0000","last_clean_scrub_stamp":"2024-09-13T15:51:09.022780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:57.652179+0000","scrub_duration":0.0027795350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.114749+0000","last_change":"2024-09-13T15:34:34.956621+0000","last_active":"2024-09-13T15:51:03.114749+0000","last_peered":"2024-09-13T15:51:03.114749+0000","last_clean":"2024-09-13T15:51:03.114749+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:51:03.114749+0000","last_undegraded":"2024-09-13T15:51:03.114749+0000","last_fullsized":"2024-09-13T15:51:03.114749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746072+0000","last_change":"2024-09-13T15:34:35.330850+0000","last_active":"2024-09-13T15:51:03.746072+0000","last_peered":"2024-09-13T15:51:03.746072+0000","last_clean":"2024-09-13T15:51:03.746072+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:51:03.746072+0000","last_undegraded":"2024-09-13T15:51:03.746072+0000","last_fullsized":"2024-09-13T15:51:03.746072+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.271281+0000","last_change":"2024-09-13T15:34:34.936361+0000","last_active":"2024-09-13T15:51:03.271281+0000","last_peered":"2024-09-13T15:51:03.271281+0000","last_clean":"2024-09-13T15:51:03.271281+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:51:03.271281+0000","last_undegraded":"2024-09-13T15:51:03.271281+0000","last_fullsized":"2024-09-13T15:51:03.271281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.749160+0000","last_change":"2024-09-13T15:34:35.347478+0000","last_active":"2024-09-13T15:51:03.749160+0000","last_peered":"2024-09-13T15:51:03.749160+0000","last_clean":"2024-09-13T15:51:03.749160+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:51:03.749160+0000","last_undegraded":"2024-09-13T15:51:03.749160+0000","last_fullsized":"2024-09-13T15:51:03.749160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107213+0000","last_change":"2024-09-13T15:34:34.956480+0000","last_active":"2024-09-13T15:51:03.107213+0000","last_peered":"2024-09-13T15:51:03.107213+0000","last_clean":"2024-09-13T15:51:03.107213+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:51:03.107213+0000","last_undegraded":"2024-09-13T15:51:03.107213+0000","last_fullsized":"2024-09-13T15:51:03.107213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:20.704723+0000","last_change":"2024-09-13T15:51:20.704937+0000","last_active":"2024-09-13T15:51:20.704723+0000","last_peered":"2024-09-13T15:51:20.704723+0000","last_clean":"2024-09-13T15:51:20.704723+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:51:20.704723+0000","last_undegraded":"2024-09-13T15:51:20.704723+0000","last_fullsized":"2024-09-13T15:51:20.704723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:20.704675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:20.704675+0000","last_clean_scrub_stamp":"2024-09-13T15:51:20.704675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:41.029516+0000","scrub_duration":0.0028536220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.748213+0000","last_change":"2024-09-13T15:34:34.959935+0000","last_active":"2024-09-13T15:51:03.748213+0000","last_peered":"2024-09-13T15:51:03.748213+0000","last_clean":"2024-09-13T15:51:03.748213+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:51:03.748213+0000","last_undegraded":"2024-09-13T15:51:03.748213+0000","last_fullsized":"2024-09-13T15:51:03.748213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107060+0000","last_change":"2024-09-13T15:34:35.335319+0000","last_active":"2024-09-13T15:51:03.107060+0000","last_peered":"2024-09-13T15:51:03.107060+0000","last_clean":"2024-09-13T15:51:03.107060+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:51:03.107060+0000","last_undegraded":"2024-09-13T15:51:03.107060+0000","last_fullsized":"2024-09-13T15:51:03.107060+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":69,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.108683+0000","last_change":"2024-09-13T15:34:34.959407+0000","last_active":"2024-09-13T15:51:03.108683+0000","last_peered":"2024-09-13T15:51:03.108683+0000","last_clean":"2024-09-13T15:51:03.108683+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:51:03.108683+0000","last_undegraded":"2024-09-13T15:51:03.108683+0000","last_fullsized":"2024-09-13T15:51:03.108683+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.275652+0000","last_change":"2024-09-13T15:34:35.329165+0000","last_active":"2024-09-13T15:51:03.275652+0000","last_peered":"2024-09-13T15:51:03.275652+0000","last_clean":"2024-09-13T15:51:03.275652+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:51:03.275652+0000","last_undegraded":"2024-09-13T15:51:03.275652+0000","last_fullsized":"2024-09-13T15:51:03.275652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.745615+0000","last_change":"2024-09-13T15:34:34.954181+0000","last_active":"2024-09-13T15:51:03.745615+0000","last_peered":"2024-09-13T15:51:03.745615+0000","last_clean":"2024-09-13T15:51:03.745615+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:51:03.745615+0000","last_undegraded":"2024-09-13T15:51:03.745615+0000","last_fullsized":"2024-09-13T15:51:03.745615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.269085+0000","last_change":"2024-09-13T15:34:35.342732+0000","last_active":"2024-09-13T15:51:03.269085+0000","last_peered":"2024-09-13T15:51:03.269085+0000","last_clean":"2024-09-13T15:51:03.269085+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:51:03.269085+0000","last_undegraded":"2024-09-13T15:51:03.269085+0000","last_fullsized":"2024-09-13T15:51:03.269085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107354+0000","last_change":"2024-09-13T15:34:34.957763+0000","last_active":"2024-09-13T15:51:03.107354+0000","last_peered":"2024-09-13T15:51:03.107354+0000","last_clean":"2024-09-13T15:51:03.107354+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:51:03.107354+0000","last_undegraded":"2024-09-13T15:51:03.107354+0000","last_fullsized":"2024-09-13T15:51:03.107354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.745581+0000","last_change":"2024-09-13T15:34:35.334637+0000","last_active":"2024-09-13T15:51:03.745581+0000","last_peered":"2024-09-13T15:51:03.745581+0000","last_clean":"2024-09-13T15:51:03.745581+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:51:03.745581+0000","last_undegraded":"2024-09-13T15:51:03.745581+0000","last_fullsized":"2024-09-13T15:51:03.745581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747472+0000","last_change":"2024-09-13T15:34:34.942058+0000","last_active":"2024-09-13T15:51:03.747472+0000","last_peered":"2024-09-13T15:51:03.747472+0000","last_clean":"2024-09-13T15:51:03.747472+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:51:03.747472+0000","last_undegraded":"2024-09-13T15:51:03.747472+0000","last_fullsized":"2024-09-13T15:51:03.747472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747482+0000","last_change":"2024-09-13T15:34:35.345452+0000","last_active":"2024-09-13T15:51:03.747482+0000","last_peered":"2024-09-13T15:51:03.747482+0000","last_clean":"2024-09-13T15:51:03.747482+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:51:03.747482+0000","last_undegraded":"2024-09-13T15:51:03.747482+0000","last_fullsized":"2024-09-13T15:51:03.747482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.114976+0000","last_change":"2024-09-13T15:34:34.955883+0000","last_active":"2024-09-13T15:51:03.114976+0000","last_peered":"2024-09-13T15:51:03.114976+0000","last_clean":"2024-09-13T15:51:03.114976+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:51:03.114976+0000","last_undegraded":"2024-09-13T15:51:03.114976+0000","last_fullsized":"2024-09-13T15:51:03.114976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2638,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.015505+0000","last_change":"2024-09-13T15:51:07.015632+0000","last_active":"2024-09-13T15:51:07.015505+0000","last_peered":"2024-09-13T15:51:07.015505+0000","last_clean":"2024-09-13T15:51:07.015505+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:51:07.015505+0000","last_undegraded":"2024-09-13T15:51:07.015505+0000","last_fullsized":"2024-09-13T15:51:07.015505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:07.015482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:07.015482+0000","last_clean_scrub_stamp":"2024-09-13T15:51:07.015482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:27.340322+0000","scrub_duration":0.001887321,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"15'3","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.257416+0000","last_change":"2024-09-13T15:34:34.949988+0000","last_active":"2024-09-13T15:51:03.257416+0000","last_peered":"2024-09-13T15:51:03.257416+0000","last_clean":"2024-09-13T15:51:03.257416+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:51:03.257416+0000","last_undegraded":"2024-09-13T15:51:03.257416+0000","last_fullsized":"2024-09-13T15:51:03.257416+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.749207+0000","last_change":"2024-09-13T15:34:35.347690+0000","last_active":"2024-09-13T15:51:03.749207+0000","last_peered":"2024-09-13T15:51:03.749207+0000","last_clean":"2024-09-13T15:51:03.749207+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:51:03.749207+0000","last_undegraded":"2024-09-13T15:51:03.749207+0000","last_fullsized":"2024-09-13T15:51:03.749207+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747379+0000","last_change":"2024-09-13T15:34:34.953625+0000","last_active":"2024-09-13T15:51:03.747379+0000","last_peered":"2024-09-13T15:51:03.747379+0000","last_clean":"2024-09-13T15:51:03.747379+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:51:03.747379+0000","last_undegraded":"2024-09-13T15:51:03.747379+0000","last_fullsized":"2024-09-13T15:51:03.747379+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":70,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:19.658493+0000","last_change":"2024-09-13T15:51:19.658733+0000","last_active":"2024-09-13T15:51:19.658493+0000","last_peered":"2024-09-13T15:51:19.658493+0000","last_clean":"2024-09-13T15:51:19.658493+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:51:19.658493+0000","last_undegraded":"2024-09-13T15:51:19.658493+0000","last_fullsized":"2024-09-13T15:51:19.658493+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:19.658442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:19.658442+0000","last_clean_scrub_stamp":"2024-09-13T15:51:19.658442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:52.886746+0000","scrub_duration":0.0031503270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.267909+0000","last_change":"2024-09-13T15:34:34.939305+0000","last_active":"2024-09-13T15:51:03.267909+0000","last_peered":"2024-09-13T15:51:03.267909+0000","last_clean":"2024-09-13T15:51:03.267909+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:51:03.267909+0000","last_undegraded":"2024-09-13T15:51:03.267909+0000","last_fullsized":"2024-09-13T15:51:03.267909+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.262536+0000","last_change":"2024-09-13T15:34:35.335773+0000","last_active":"2024-09-13T15:51:03.262536+0000","last_peered":"2024-09-13T15:51:03.262536+0000","last_clean":"2024-09-13T15:51:03.262536+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:51:03.262536+0000","last_undegraded":"2024-09-13T15:51:03.262536+0000","last_fullsized":"2024-09-13T15:51:03.262536+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.744724+0000","last_change":"2024-09-13T15:34:34.950709+0000","last_active":"2024-09-13T15:51:03.744724+0000","last_peered":"2024-09-13T15:51:03.744724+0000","last_clean":"2024-09-13T15:51:03.744724+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:51:03.744724+0000","last_undegraded":"2024-09-13T15:51:03.744724+0000","last_fullsized":"2024-09-13T15:51:03.744724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.109268+0000","last_change":"2024-09-13T15:34:35.340304+0000","last_active":"2024-09-13T15:51:03.109268+0000","last_peered":"2024-09-13T15:51:03.109268+0000","last_clean":"2024-09-13T15:51:03.109268+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:51:03.109268+0000","last_undegraded":"2024-09-13T15:51:03.109268+0000","last_fullsized":"2024-09-13T15:51:03.109268+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.745717+0000","last_change":"2024-09-13T15:34:34.954475+0000","last_active":"2024-09-13T15:51:03.745717+0000","last_peered":"2024-09-13T15:51:03.745717+0000","last_clean":"2024-09-13T15:51:03.745717+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:51:03.745717+0000","last_undegraded":"2024-09-13T15:51:03.745717+0000","last_fullsized":"2024-09-13T15:51:03.745717+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107565+0000","last_change":"2024-09-13T15:34:34.957379+0000","last_active":"2024-09-13T15:51:03.107565+0000","last_peered":"2024-09-13T15:51:03.107565+0000","last_clean":"2024-09-13T15:51:03.107565+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:51:03.107565+0000","last_undegraded":"2024-09-13T15:51:03.107565+0000","last_fullsized":"2024-09-13T15:51:03.107565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747893+0000","last_change":"2024-09-13T15:34:35.331843+0000","last_active":"2024-09-13T15:51:03.747893+0000","last_peered":"2024-09-13T15:51:03.747893+0000","last_clean":"2024-09-13T15:51:03.747893+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:51:03.747893+0000","last_undegraded":"2024-09-13T15:51:03.747893+0000","last_fullsized":"2024-09-13T15:51:03.747893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.268748+0000","last_change":"2024-09-13T15:34:34.944458+0000","last_active":"2024-09-13T15:51:03.268748+0000","last_peered":"2024-09-13T15:51:03.268748+0000","last_clean":"2024-09-13T15:51:03.268748+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:51:03.268748+0000","last_undegraded":"2024-09-13T15:51:03.268748+0000","last_fullsized":"2024-09-13T15:51:03.268748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.266256+0000","last_change":"2024-09-13T15:34:35.343571+0000","last_active":"2024-09-13T15:51:03.266256+0000","last_peered":"2024-09-13T15:51:03.266256+0000","last_clean":"2024-09-13T15:51:03.266256+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:51:03.266256+0000","last_undegraded":"2024-09-13T15:51:03.266256+0000","last_fullsized":"2024-09-13T15:51:03.266256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.192602+0000","last_change":"2024-09-13T15:34:35.331904+0000","last_active":"2024-09-13T15:51:07.192602+0000","last_peered":"2024-09-13T15:51:07.192602+0000","last_clean":"2024-09-13T15:51:07.192602+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:51:07.192602+0000","last_undegraded":"2024-09-13T15:51:07.192602+0000","last_fullsized":"2024-09-13T15:51:07.192602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:15.611315+0000","last_change":"2024-09-13T15:51:15.611315+0000","last_active":"2024-09-13T15:51:15.611315+0000","last_peered":"2024-09-13T15:51:15.611315+0000","last_clean":"2024-09-13T15:51:15.611315+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:51:15.611315+0000","last_undegraded":"2024-09-13T15:51:15.611315+0000","last_fullsized":"2024-09-13T15:51:15.611315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:15.611033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:15.611033+0000","last_clean_scrub_stamp":"2024-09-13T15:51:15.611033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:31.771056+0000","scrub_duration":0.0029690459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279713+0000","last_change":"2024-09-13T15:34:35.324690+0000","last_active":"2024-09-13T15:51:06.279713+0000","last_peered":"2024-09-13T15:51:06.279713+0000","last_clean":"2024-09-13T15:51:06.279713+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:51:06.279713+0000","last_undegraded":"2024-09-13T15:51:06.279713+0000","last_fullsized":"2024-09-13T15:51:06.279713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:10.591481+0000","last_change":"2024-09-13T15:51:10.591481+0000","last_active":"2024-09-13T15:51:10.591481+0000","last_peered":"2024-09-13T15:51:10.591481+0000","last_clean":"2024-09-13T15:51:10.591481+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:51:10.591481+0000","last_undegraded":"2024-09-13T15:51:10.591481+0000","last_fullsized":"2024-09-13T15:51:10.591481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:10.591224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:10.591224+0000","last_clean_scrub_stamp":"2024-09-13T15:51:10.591224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:30.916064+0000","scrub_duration":0.0029806559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":50,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.267016+0000","last_change":"2024-09-13T15:35:20.157986+0000","last_active":"2024-09-13T15:51:03.267016+0000","last_peered":"2024-09-13T15:51:03.267016+0000","last_clean":"2024-09-13T15:51:03.267016+0000","last_became_active":"2024-09-13T15:35:20.157317+0000","last_became_peered":"2024-09-13T15:35:20.157317+0000","last_unstale":"2024-09-13T15:51:03.267016+0000","last_undegraded":"2024-09-13T15:51:03.267016+0000","last_fullsized":"2024-09-13T15:51:03.267016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.259698+0000","last_change":"2024-09-13T15:34:35.339305+0000","last_active":"2024-09-13T15:51:03.259698+0000","last_peered":"2024-09-13T15:51:03.259698+0000","last_clean":"2024-09-13T15:51:03.259698+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:51:03.259698+0000","last_undegraded":"2024-09-13T15:51:03.259698+0000","last_fullsized":"2024-09-13T15:51:03.259698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.109119+0000","last_change":"2024-09-13T15:34:35.335209+0000","last_active":"2024-09-13T15:51:03.109119+0000","last_peered":"2024-09-13T15:51:03.109119+0000","last_clean":"2024-09-13T15:51:03.109119+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:51:03.109119+0000","last_undegraded":"2024-09-13T15:51:03.109119+0000","last_fullsized":"2024-09-13T15:51:03.109119+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:14.575558+0000","last_change":"2024-09-13T15:51:14.575770+0000","last_active":"2024-09-13T15:51:14.575558+0000","last_peered":"2024-09-13T15:51:14.575558+0000","last_clean":"2024-09-13T15:51:14.575558+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:51:14.575558+0000","last_undegraded":"2024-09-13T15:51:14.575558+0000","last_fullsized":"2024-09-13T15:51:14.575558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:14.575511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:14.575511+0000","last_clean_scrub_stamp":"2024-09-13T15:51:14.575511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:22.946343+0000","scrub_duration":0.0031682049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.744815+0000","last_change":"2024-09-13T15:34:35.327879+0000","last_active":"2024-09-13T15:51:03.744815+0000","last_peered":"2024-09-13T15:51:03.744815+0000","last_clean":"2024-09-13T15:51:03.744815+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:51:03.744815+0000","last_undegraded":"2024-09-13T15:51:03.744815+0000","last_fullsized":"2024-09-13T15:51:03.744815+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746175+0000","last_change":"2024-09-13T15:34:35.324523+0000","last_active":"2024-09-13T15:51:03.746175+0000","last_peered":"2024-09-13T15:51:03.746175+0000","last_clean":"2024-09-13T15:51:03.746175+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:51:03.746175+0000","last_undegraded":"2024-09-13T15:51:03.746175+0000","last_fullsized":"2024-09-13T15:51:03.746175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.266717+0000","last_change":"2024-09-13T15:34:35.329712+0000","last_active":"2024-09-13T15:51:03.266717+0000","last_peered":"2024-09-13T15:51:03.266717+0000","last_clean":"2024-09-13T15:51:03.266717+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:51:03.266717+0000","last_undegraded":"2024-09-13T15:51:03.266717+0000","last_fullsized":"2024-09-13T15:51:03.266717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":50,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734854+0000","last_change":"2024-09-13T15:35:20.156675+0000","last_active":"2024-09-13T15:51:06.734854+0000","last_peered":"2024-09-13T15:51:06.734854+0000","last_clean":"2024-09-13T15:51:06.734854+0000","last_became_active":"2024-09-13T15:35:20.152889+0000","last_became_peered":"2024-09-13T15:35:20.152889+0000","last_unstale":"2024-09-13T15:51:06.734854+0000","last_undegraded":"2024-09-13T15:51:06.734854+0000","last_fullsized":"2024-09-13T15:51:06.734854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746153+0000","last_change":"2024-09-13T15:34:35.346893+0000","last_active":"2024-09-13T15:51:03.746153+0000","last_peered":"2024-09-13T15:51:03.746153+0000","last_clean":"2024-09-13T15:51:03.746153+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:51:03.746153+0000","last_undegraded":"2024-09-13T15:51:03.746153+0000","last_fullsized":"2024-09-13T15:51:03.746153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:14.607793+0000","last_change":"2024-09-13T15:51:14.608116+0000","last_active":"2024-09-13T15:51:14.607793+0000","last_peered":"2024-09-13T15:51:14.607793+0000","last_clean":"2024-09-13T15:51:14.607793+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:51:14.607793+0000","last_undegraded":"2024-09-13T15:51:14.607793+0000","last_fullsized":"2024-09-13T15:51:14.607793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:14.607733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:14.607733+0000","last_clean_scrub_stamp":"2024-09-13T15:51:14.607733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:57.098851+0000","scrub_duration":0.0030409230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.109337+0000","last_change":"2024-09-13T15:34:35.335384+0000","last_active":"2024-09-13T15:51:03.109337+0000","last_peered":"2024-09-13T15:51:03.109337+0000","last_clean":"2024-09-13T15:51:03.109337+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:51:03.109337+0000","last_undegraded":"2024-09-13T15:51:03.109337+0000","last_fullsized":"2024-09-13T15:51:03.109337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.267819+0000","last_change":"2024-09-13T15:34:35.333522+0000","last_active":"2024-09-13T15:51:03.267819+0000","last_peered":"2024-09-13T15:51:03.267819+0000","last_clean":"2024-09-13T15:51:03.267819+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:51:03.267819+0000","last_undegraded":"2024-09-13T15:51:03.267819+0000","last_fullsized":"2024-09-13T15:51:03.267819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.113408+0000","last_change":"2024-09-13T15:34:35.331848+0000","last_active":"2024-09-13T15:51:03.113408+0000","last_peered":"2024-09-13T15:51:03.113408+0000","last_clean":"2024-09-13T15:51:03.113408+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:51:03.113408+0000","last_undegraded":"2024-09-13T15:51:03.113408+0000","last_fullsized":"2024-09-13T15:51:03.113408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.262421+0000","last_change":"2024-09-13T15:34:35.333765+0000","last_active":"2024-09-13T15:51:03.262421+0000","last_peered":"2024-09-13T15:51:03.262421+0000","last_clean":"2024-09-13T15:51:03.262421+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:51:03.262421+0000","last_undegraded":"2024-09-13T15:51:03.262421+0000","last_fullsized":"2024-09-13T15:51:03.262421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:12.628563+0000","last_change":"2024-09-13T15:51:12.628806+0000","last_active":"2024-09-13T15:51:12.628563+0000","last_peered":"2024-09-13T15:51:12.628563+0000","last_clean":"2024-09-13T15:51:12.628563+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:51:12.628563+0000","last_undegraded":"2024-09-13T15:51:12.628563+0000","last_fullsized":"2024-09-13T15:51:12.628563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:12.628512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:12.628512+0000","last_clean_scrub_stamp":"2024-09-13T15:51:12.628512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:01.257911+0000","scrub_duration":0.0030549050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747373+0000","last_change":"2024-09-13T15:34:35.335252+0000","last_active":"2024-09-13T15:51:03.747373+0000","last_peered":"2024-09-13T15:51:03.747373+0000","last_clean":"2024-09-13T15:51:03.747373+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:51:03.747373+0000","last_undegraded":"2024-09-13T15:51:03.747373+0000","last_fullsized":"2024-09-13T15:51:03.747373+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746236+0000","last_change":"2024-09-13T15:34:35.330875+0000","last_active":"2024-09-13T15:51:03.746236+0000","last_peered":"2024-09-13T15:51:03.746236+0000","last_clean":"2024-09-13T15:51:03.746236+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:51:03.746236+0000","last_undegraded":"2024-09-13T15:51:03.746236+0000","last_fullsized":"2024-09-13T15:51:03.746236+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747638+0000","last_change":"2024-09-13T15:34:35.331709+0000","last_active":"2024-09-13T15:51:03.747638+0000","last_peered":"2024-09-13T15:51:03.747638+0000","last_clean":"2024-09-13T15:51:03.747638+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:51:03.747638+0000","last_undegraded":"2024-09-13T15:51:03.747638+0000","last_fullsized":"2024-09-13T15:51:03.747638+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":70,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:09.586936+0000","last_change":"2024-09-13T15:51:09.587225+0000","last_active":"2024-09-13T15:51:09.586936+0000","last_peered":"2024-09-13T15:51:09.586936+0000","last_clean":"2024-09-13T15:51:09.586936+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:51:09.586936+0000","last_undegraded":"2024-09-13T15:51:09.586936+0000","last_fullsized":"2024-09-13T15:51:09.586936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:09.586889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:09.586889+0000","last_clean_scrub_stamp":"2024-09-13T15:51:09.586889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:42.815192+0000","scrub_duration":0.0032138610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.268226+0000","last_change":"2024-09-13T15:34:35.345251+0000","last_active":"2024-09-13T15:51:03.268226+0000","last_peered":"2024-09-13T15:51:03.268226+0000","last_clean":"2024-09-13T15:51:03.268226+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:51:03.268226+0000","last_undegraded":"2024-09-13T15:51:03.268226+0000","last_fullsized":"2024-09-13T15:51:03.268226+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.109967+0000","last_change":"2024-09-13T15:34:35.335400+0000","last_active":"2024-09-13T15:51:03.109967+0000","last_peered":"2024-09-13T15:51:03.109967+0000","last_clean":"2024-09-13T15:51:03.109967+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:51:03.109967+0000","last_undegraded":"2024-09-13T15:51:03.109967+0000","last_fullsized":"2024-09-13T15:51:03.109967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746045+0000","last_change":"2024-09-13T15:34:35.334719+0000","last_active":"2024-09-13T15:51:03.746045+0000","last_peered":"2024-09-13T15:51:03.746045+0000","last_clean":"2024-09-13T15:51:03.746045+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:51:03.746045+0000","last_undegraded":"2024-09-13T15:51:03.746045+0000","last_fullsized":"2024-09-13T15:51:03.746045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107737+0000","last_change":"2024-09-13T15:34:35.329319+0000","last_active":"2024-09-13T15:51:03.107737+0000","last_peered":"2024-09-13T15:51:03.107737+0000","last_clean":"2024-09-13T15:51:03.107737+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:51:03.107737+0000","last_undegraded":"2024-09-13T15:51:03.107737+0000","last_fullsized":"2024-09-13T15:51:03.107737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747697+0000","last_change":"2024-09-13T15:34:35.327922+0000","last_active":"2024-09-13T15:51:03.747697+0000","last_peered":"2024-09-13T15:51:03.747697+0000","last_clean":"2024-09-13T15:51:03.747697+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:51:03.747697+0000","last_undegraded":"2024-09-13T15:51:03.747697+0000","last_fullsized":"2024-09-13T15:51:03.747697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.115070+0000","last_change":"2024-09-13T15:34:35.330864+0000","last_active":"2024-09-13T15:51:03.115070+0000","last_peered":"2024-09-13T15:51:03.115070+0000","last_clean":"2024-09-13T15:51:03.115070+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:51:03.115070+0000","last_undegraded":"2024-09-13T15:51:03.115070+0000","last_fullsized":"2024-09-13T15:51:03.115070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.280073+0000","last_change":"2024-09-13T15:34:35.324580+0000","last_active":"2024-09-13T15:51:06.280073+0000","last_peered":"2024-09-13T15:51:06.280073+0000","last_clean":"2024-09-13T15:51:06.280073+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:51:06.280073+0000","last_undegraded":"2024-09-13T15:51:06.280073+0000","last_fullsized":"2024-09-13T15:51:06.280073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.735041+0000","last_change":"2024-09-13T15:34:35.329279+0000","last_active":"2024-09-13T15:51:06.735041+0000","last_peered":"2024-09-13T15:51:06.735041+0000","last_clean":"2024-09-13T15:51:06.735041+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:51:06.735041+0000","last_undegraded":"2024-09-13T15:51:06.735041+0000","last_fullsized":"2024-09-13T15:51:06.735041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.280137+0000","last_change":"2024-09-13T15:34:35.347293+0000","last_active":"2024-09-13T15:51:06.280137+0000","last_peered":"2024-09-13T15:51:06.280137+0000","last_clean":"2024-09-13T15:51:06.280137+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:51:06.280137+0000","last_undegraded":"2024-09-13T15:51:06.280137+0000","last_fullsized":"2024-09-13T15:51:06.280137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3436,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738575,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99880,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94271960,"statfs":{"total":96636764160,"available":96534487040,"internally_reserved":0,"allocated":688128,"data_stored":300221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.42999999999999999},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.152},"max":{"1min":0.65600000000000003,"5min":0.83899999999999997,"15min":3.4550000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.46300000000000002},"min":{"1min":0.32300000000000001,"5min":0.248,"15min":0.18099999999999999},"max":{"1min":0.76900000000000002,"5min":0.97499999999999998,"15min":6.1989999999999998},"last":0.69799999999999995}]},{"osd":1,"last update":"Fri Sep 13 15:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53600000000000003,"15min":0.46300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.185},"max":{"1min":0.82699999999999996,"5min":1.006,"15min":1.4790000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.495},"min":{"1min":0.31,"5min":0.30299999999999999,"15min":0.17799999999999999},"max":{"1min":0.73199999999999998,"5min":1.0589999999999999,"15min":1.399},"last":0.622}]}]},{"osd":1,"up_from":8,"seq":34359738574,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148852,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":94222988,"statfs":{"total":96636764160,"available":96484339712,"internally_reserved":0,"allocated":1290240,"data_stored":891249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45600000000000002,"15min":0.41599999999999998},"min":{"1min":0.26900000000000002,"5min":0.214,"15min":0.159},"max":{"1min":0.64700000000000002,"5min":0.69599999999999995,"15min":4.2400000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.432},"min":{"1min":0.33900000000000002,"5min":0.20399999999999999,"15min":0.17100000000000001},"max":{"1min":0.70399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60299999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.443},"min":{"1min":0.42099999999999999,"5min":0.26400000000000001,"15min":0.17199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.82999999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57299999999999995,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.253,"15min":0.189},"max":{"1min":0.86099999999999999,"5min":0.93000000000000005,"15min":1.2789999999999999},"last":0.63600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738576,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":158696,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94213144,"statfs":{"total":96636764160,"available":96474259456,"internally_reserved":0,"allocated":1277952,"data_stored":888575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":161216966},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47899999999999998,"15min":0.40799999999999997},"min":{"1min":0.28399999999999997,"5min":0.20399999999999999,"15min":0.158},"max":{"1min":0.755,"5min":0.80900000000000005,"15min":0.873},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.42699999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.186},"max":{"1min":0.68200000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53700000000000003,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.17899999999999999},"max":{"1min":0.77400000000000002,"5min":0.82099999999999995,"15min":9.4610000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.48599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.20300000000000001},"max":{"1min":0.67700000000000005,"5min":0.84899999999999998,"15min":0.90700000000000003},"last":0.64300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:51:27.881 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.881 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.882 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.882 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.882 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.882 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.882 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.882 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.882 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.882 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.883 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.883 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.883 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.883 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.883 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.883 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.883 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.884 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.884 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.884 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.884 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.884 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.884 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.885 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.885 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.885 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.885 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.885 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.885 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T15:34:25.870427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.885 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.885 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.885 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.886 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.886 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.886 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.886 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.886 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.886 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.886 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.886 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.887 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.887 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.887 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.887 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.887 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.887 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.887 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.887 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.887 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.888 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.888 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.888 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.888 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.888 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.888 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.888 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.888 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.889 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.889 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.889 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.889 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.889 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.889 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.889 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.889 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.890 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.890 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.890 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.890 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.890 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.890 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.890 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.890 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.890 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.891 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.891 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.891 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.891 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.891 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.891 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.891 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.891 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.891 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:27.892 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T15:51:31.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:51:47.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:51:48.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.031+0000 7ff7e8033640 1 Processor -- start 2024-09-13T15:51:48.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.031+0000 7ff7e8033640 1 -- start start 2024-09-13T15:51:48.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.031+0000 7ff7e8033640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff7e00b4600 0x7ff7e014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:48.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.031+0000 7ff7e8033640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e00c1130 con 0x7ff7e014e280 2024-09-13T15:51:48.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.031+0000 7ff7e8033640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e014e780 con 0x7ff7e00b4600 2024-09-13T15:51:48.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.031+0000 7ff7e5dcf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff7e00b4600 0x7ff7e014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:48.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.031+0000 7ff7e55ce640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff7e014e280 0x7ff7e00bf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:49714/0 (socket says 172.21.15.40:49714) 2024-09-13T15:51:48.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.031+0000 7ff7e55ce640 1 -- 172.21.15.40:0/1011289229 learned_addr learned my addr 172.21.15.40:0/1011289229 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:51:48.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.031+0000 7ff7e5dcf640 1 -- 172.21.15.40:0/1011289229 >> v1:172.21.15.40:6789/0 conn(0x7ff7e014e280 legacy=0x7ff7e00bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:48.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.031+0000 7ff7e4dcd640 1 -- 172.21.15.40:0/1011289229 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117210062 0 0) 0x7ff7e00c1130 con 0x7ff7e014e280 2024-09-13T15:51:48.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.031+0000 7ff7e5dcf640 1 -- 172.21.15.40:0/1011289229 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e00b59f0 con 0x7ff7e00b4600 2024-09-13T15:51:48.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e5dcf640 1 --2- 172.21.15.40:0/1011289229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e00b4600 0x7ff7e014dd40 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009740 tx=0x7ff7dc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821b41470e4a8486 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:48.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e4dcd640 1 -- 172.21.15.40:0/1011289229 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7dc0ab530 con 0x7ff7e00b4600 2024-09-13T15:51:48.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e4dcd640 1 -- 172.21.15.40:0/1011289229 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc0a7050 con 0x7ff7e00b4600 2024-09-13T15:51:48.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e4dcd640 1 -- 172.21.15.40:0/1011289229 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7dc0ab7e0 con 0x7ff7e00b4600 2024-09-13T15:51:48.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e8033640 1 -- 172.21.15.40:0/1011289229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e00b4600 msgr2=0x7ff7e014dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:48.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e8033640 1 --2- 172.21.15.40:0/1011289229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e00b4600 0x7ff7e014dd40 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009740 tx=0x7ff7dc01c390 comp rx=0 tx=0).stop 2024-09-13T15:51:48.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e8033640 1 -- 172.21.15.40:0/1011289229 shutdown_connections 2024-09-13T15:51:48.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e8033640 1 --2- 172.21.15.40:0/1011289229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e00b4600 0x7ff7e014dd40 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:48.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e8033640 1 -- 172.21.15.40:0/1011289229 >> 172.21.15.40:0/1011289229 conn(0x7ff7e006a540 msgr2=0x7ff7e00a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:48.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e8033640 1 -- 172.21.15.40:0/1011289229 shutdown_connections 2024-09-13T15:51:48.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e8033640 1 -- 172.21.15.40:0/1011289229 wait complete. 2024-09-13T15:51:48.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e8033640 1 Processor -- start 2024-09-13T15:51:48.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e8033640 1 -- start start 2024-09-13T15:51:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e8033640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e00b4600 0x7ff7e009a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e8033640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e0161810 con 0x7ff7e00b4600 2024-09-13T15:51:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e5dcf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e00b4600 0x7ff7e009a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e5dcf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e00b4600 0x7ff7e009a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39134/0 (socket says 172.21.15.40:39134) 2024-09-13T15:51:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e5dcf640 1 -- 172.21.15.40:0/2351873380 learned_addr learned my addr 172.21.15.40:0/2351873380 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:51:48.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e5dcf640 1 -- 172.21.15.40:0/2351873380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc009420 con 0x7ff7e00b4600 2024-09-13T15:51:48.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7e5dcf640 1 --2- 172.21.15.40:0/2351873380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e00b4600 0x7ff7e009a500 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc019fc0 tx=0x7ff7dc01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:48.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7d27fc640 1 -- 172.21.15.40:0/2351873380 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7dc0abea0 con 0x7ff7e00b4600 2024-09-13T15:51:48.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7d27fc640 1 -- 172.21.15.40:0/2351873380 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc004020 con 0x7ff7e00b4600 2024-09-13T15:51:48.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.035+0000 7ff7d27fc640 1 -- 172.21.15.40:0/2351873380 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7dc0042c0 con 0x7ff7e00b4600 2024-09-13T15:51:48.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.039+0000 7ff7e8033640 1 -- 172.21.15.40:0/2351873380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e009cd20 con 0x7ff7e00b4600 2024-09-13T15:51:48.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.039+0000 7ff7e8033640 1 -- 172.21.15.40:0/2351873380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e00bf5e0 con 0x7ff7e00b4600 2024-09-13T15:51:48.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.039+0000 7ff7e8033640 1 -- 172.21.15.40:0/2351873380 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e014dd40 con 0x7ff7e00b4600 2024-09-13T15:51:48.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.039+0000 7ff7d27fc640 1 -- 172.21.15.40:0/2351873380 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7ff7dc0b2050 con 0x7ff7e00b4600 2024-09-13T15:51:48.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.039+0000 7ff7d27fc640 1 --2- 172.21.15.40:0/2351873380 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff7c4035530 0x7ff7c40379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:51:48.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.039+0000 7ff7d27fc640 1 -- 172.21.15.40:0/2351873380 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7ff7dc0e27a0 con 0x7ff7e00b4600 2024-09-13T15:51:48.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.039+0000 7ff7e55ce640 1 --2- 172.21.15.40:0/2351873380 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff7c4035530 0x7ff7c40379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:51:48.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.039+0000 7ff7e55ce640 1 --2- 172.21.15.40:0/2351873380 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff7c4035530 0x7ff7c40379f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4007fd0 tx=0x7ff7d4007920 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:51:48.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.043+0000 7ff7d27fc640 1 -- 172.21.15.40:0/2351873380 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff7dc0beb90 con 0x7ff7e00b4600 2024-09-13T15:51:48.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.199+0000 7ff7e8033640 1 -- 172.21.15.40:0/2351873380 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7e00a3b10 con 0x7ff7c4035530 2024-09-13T15:51:48.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.215+0000 7ff7d27fc640 1 -- 172.21.15.40:0/2351873380 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248125 (secure 0 0 0) 0x7ff7e00a3b10 con 0x7ff7c4035530 2024-09-13T15:51:48.219 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:51:48.221 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:51:48.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.219+0000 7ff7e8033640 1 -- 172.21.15.40:0/2351873380 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff7c4035530 msgr2=0x7ff7c40379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:48.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.219+0000 7ff7e8033640 1 --2- 172.21.15.40:0/2351873380 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff7c4035530 0x7ff7c40379f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4007fd0 tx=0x7ff7d4007920 comp rx=0 tx=0).stop 2024-09-13T15:51:48.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.219+0000 7ff7e8033640 1 -- 172.21.15.40:0/2351873380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e00b4600 msgr2=0x7ff7e009a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:51:48.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.219+0000 7ff7e8033640 1 --2- 172.21.15.40:0/2351873380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e00b4600 0x7ff7e009a500 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc019fc0 tx=0x7ff7dc01abd0 comp rx=0 tx=0).stop 2024-09-13T15:51:48.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.219+0000 7ff7e8033640 1 -- 172.21.15.40:0/2351873380 shutdown_connections 2024-09-13T15:51:48.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.219+0000 7ff7e8033640 1 --2- 172.21.15.40:0/2351873380 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7ff7c4035530 0x7ff7c40379f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:48.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.219+0000 7ff7e8033640 1 --2- 172.21.15.40:0/2351873380 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7e00b4600 0x7ff7e009a500 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:51:48.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.219+0000 7ff7e8033640 1 -- 172.21.15.40:0/2351873380 >> 172.21.15.40:0/2351873380 conn(0x7ff7e006a540 msgr2=0x7ff7e006e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:51:48.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.219+0000 7ff7e8033640 1 -- 172.21.15.40:0/2351873380 shutdown_connections 2024-09-13T15:51:48.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:51:48.219+0000 7ff7e8033640 1 -- 172.21.15.40:0/2351873380 wait complete. 2024-09-13T15:51:48.238 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":477,"stamp":"2024-09-13T15:51:47.862823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593804,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":208,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":407428,"kb_used_data":3180,"kb_used_omap":4,"kb_used_meta":404219,"kb_avail":282708092,"statfs":{"total":289910292480,"available":289493086208,"internally_reserved":0,"allocated":3256320,"data_stored":2080045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":413920594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004015"},"pg_stats":[{"pgid":"2.1f","version":"15'4","reported_seq":66,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279329+0000","last_change":"2024-09-13T15:34:34.960705+0000","last_active":"2024-09-13T15:51:06.279329+0000","last_peered":"2024-09-13T15:51:06.279329+0000","last_clean":"2024-09-13T15:51:06.279329+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:51:06.279329+0000","last_undegraded":"2024-09-13T15:51:06.279329+0000","last_fullsized":"2024-09-13T15:51:06.279329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:22.675129+0000","last_change":"2024-09-13T15:51:22.675350+0000","last_active":"2024-09-13T15:51:22.675129+0000","last_peered":"2024-09-13T15:51:22.675129+0000","last_clean":"2024-09-13T15:51:22.675129+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:51:22.675129+0000","last_undegraded":"2024-09-13T15:51:22.675129+0000","last_fullsized":"2024-09-13T15:51:22.675129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:22.675078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:22.675078+0000","last_clean_scrub_stamp":"2024-09-13T15:51:22.675078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:11.304477+0000","scrub_duration":0.002879932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:47.519274+0000","last_change":"2024-09-13T15:51:47.519523+0000","last_active":"2024-09-13T15:51:47.519274+0000","last_peered":"2024-09-13T15:51:47.519274+0000","last_clean":"2024-09-13T15:51:47.519274+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:51:47.519274+0000","last_undegraded":"2024-09-13T15:51:47.519274+0000","last_fullsized":"2024-09-13T15:51:47.519274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-13T15:51:47.519216+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-09-13T15:51:47.519216+0000","last_clean_scrub_stamp":"2024-09-13T15:51:47.519216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:40.760952+0000","scrub_duration":0.0029653919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279719+0000","last_change":"2024-09-13T15:34:35.350474+0000","last_active":"2024-09-13T15:51:06.279719+0000","last_peered":"2024-09-13T15:51:06.279719+0000","last_clean":"2024-09-13T15:51:06.279719+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:51:06.279719+0000","last_undegraded":"2024-09-13T15:51:06.279719+0000","last_fullsized":"2024-09-13T15:51:06.279719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746776+0000","last_change":"2024-09-13T15:34:34.950125+0000","last_active":"2024-09-13T15:51:03.746776+0000","last_peered":"2024-09-13T15:51:03.746776+0000","last_clean":"2024-09-13T15:51:03.746776+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:51:03.746776+0000","last_undegraded":"2024-09-13T15:51:03.746776+0000","last_fullsized":"2024-09-13T15:51:03.746776+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.267603+0000","last_change":"2024-09-13T15:34:35.333710+0000","last_active":"2024-09-13T15:51:03.267603+0000","last_peered":"2024-09-13T15:51:03.267603+0000","last_clean":"2024-09-13T15:51:03.267603+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:51:03.267603+0000","last_undegraded":"2024-09-13T15:51:03.267603+0000","last_fullsized":"2024-09-13T15:51:03.267603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":53,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.114859+0000","last_change":"2024-09-13T15:35:20.173539+0000","last_active":"2024-09-13T15:51:03.114859+0000","last_peered":"2024-09-13T15:51:03.114859+0000","last_clean":"2024-09-13T15:51:03.114859+0000","last_became_active":"2024-09-13T15:35:20.165658+0000","last_became_peered":"2024-09-13T15:35:20.165658+0000","last_unstale":"2024-09-13T15:51:03.114859+0000","last_undegraded":"2024-09-13T15:51:03.114859+0000","last_fullsized":"2024-09-13T15:51:03.114859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":70,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:39.648014+0000","last_change":"2024-09-13T15:51:39.648291+0000","last_active":"2024-09-13T15:51:39.648014+0000","last_peered":"2024-09-13T15:51:39.648014+0000","last_clean":"2024-09-13T15:51:39.648014+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:51:39.648014+0000","last_undegraded":"2024-09-13T15:51:39.648014+0000","last_fullsized":"2024-09-13T15:51:39.648014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:39.647966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:39.647966+0000","last_clean_scrub_stamp":"2024-09-13T15:51:39.647966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:57.782751+0000","scrub_duration":0.0028655859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:39.860564+0000","last_change":"2024-09-13T15:51:39.860860+0000","last_active":"2024-09-13T15:51:39.860564+0000","last_peered":"2024-09-13T15:51:39.860564+0000","last_clean":"2024-09-13T15:51:39.860564+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:51:39.860564+0000","last_undegraded":"2024-09-13T15:51:39.860564+0000","last_fullsized":"2024-09-13T15:51:39.860564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:39.860518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:39.860518+0000","last_clean_scrub_stamp":"2024-09-13T15:51:39.860518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:23.434457+0000","scrub_duration":0.0030233840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747277+0000","last_change":"2024-09-13T15:34:34.943033+0000","last_active":"2024-09-13T15:51:03.747277+0000","last_peered":"2024-09-13T15:51:03.747277+0000","last_clean":"2024-09-13T15:51:03.747277+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:51:03.747277+0000","last_undegraded":"2024-09-13T15:51:03.747277+0000","last_fullsized":"2024-09-13T15:51:03.747277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:41.947110+0000","last_change":"2024-09-13T15:51:41.947387+0000","last_active":"2024-09-13T15:51:41.947110+0000","last_peered":"2024-09-13T15:51:41.947110+0000","last_clean":"2024-09-13T15:51:41.947110+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:51:41.947110+0000","last_undegraded":"2024-09-13T15:51:41.947110+0000","last_fullsized":"2024-09-13T15:51:41.947110+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:41.947053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:41.947053+0000","last_clean_scrub_stamp":"2024-09-13T15:51:41.947053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:08.395633+0000","scrub_duration":0.0028106099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.264122+0000","last_change":"2024-09-13T15:34:34.943732+0000","last_active":"2024-09-13T15:51:03.264122+0000","last_peered":"2024-09-13T15:51:03.264122+0000","last_clean":"2024-09-13T15:51:03.264122+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:51:03.264122+0000","last_undegraded":"2024-09-13T15:51:03.264122+0000","last_fullsized":"2024-09-13T15:51:03.264122+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.604728+0000","last_change":"2024-09-13T15:51:42.604941+0000","last_active":"2024-09-13T15:51:42.604728+0000","last_peered":"2024-09-13T15:51:42.604728+0000","last_clean":"2024-09-13T15:51:42.604728+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:51:42.604728+0000","last_undegraded":"2024-09-13T15:51:42.604728+0000","last_fullsized":"2024-09-13T15:51:42.604728+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:42.604669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:42.604669+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.604669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:36.719016+0000","scrub_duration":0.0029141129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.262321+0000","last_change":"2024-09-13T15:34:34.943197+0000","last_active":"2024-09-13T15:51:03.262321+0000","last_peered":"2024-09-13T15:51:03.262321+0000","last_clean":"2024-09-13T15:51:03.262321+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:51:03.262321+0000","last_undegraded":"2024-09-13T15:51:03.262321+0000","last_fullsized":"2024-09-13T15:51:03.262321+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:37.835878+0000","last_change":"2024-09-13T15:51:37.836156+0000","last_active":"2024-09-13T15:51:37.835878+0000","last_peered":"2024-09-13T15:51:37.835878+0000","last_clean":"2024-09-13T15:51:37.835878+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:51:37.835878+0000","last_undegraded":"2024-09-13T15:51:37.835878+0000","last_fullsized":"2024-09-13T15:51:37.835878+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:37.835829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:37.835829+0000","last_clean_scrub_stamp":"2024-09-13T15:51:37.835829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.328337+0000","scrub_duration":0.0028480789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.744627+0000","last_change":"2024-09-13T15:34:34.941308+0000","last_active":"2024-09-13T15:51:03.744627+0000","last_peered":"2024-09-13T15:51:03.744627+0000","last_clean":"2024-09-13T15:51:03.744627+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:51:03.744627+0000","last_undegraded":"2024-09-13T15:51:03.744627+0000","last_fullsized":"2024-09-13T15:51:03.744627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747672+0000","last_change":"2024-09-13T15:34:35.334433+0000","last_active":"2024-09-13T15:51:03.747672+0000","last_peered":"2024-09-13T15:51:03.747672+0000","last_clean":"2024-09-13T15:51:03.747672+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:51:03.747672+0000","last_undegraded":"2024-09-13T15:51:03.747672+0000","last_fullsized":"2024-09-13T15:51:03.747672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.267711+0000","last_change":"2024-09-13T15:34:34.946540+0000","last_active":"2024-09-13T15:51:03.267711+0000","last_peered":"2024-09-13T15:51:03.267711+0000","last_clean":"2024-09-13T15:51:03.267711+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:51:03.267711+0000","last_undegraded":"2024-09-13T15:51:03.267711+0000","last_fullsized":"2024-09-13T15:51:03.267711+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:11.573036+0000","last_change":"2024-09-13T15:51:11.573279+0000","last_active":"2024-09-13T15:51:11.573036+0000","last_peered":"2024-09-13T15:51:11.573036+0000","last_clean":"2024-09-13T15:51:11.573036+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:51:11.573036+0000","last_undegraded":"2024-09-13T15:51:11.573036+0000","last_fullsized":"2024-09-13T15:51:11.573036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:11.572987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:11.572987+0000","last_clean_scrub_stamp":"2024-09-13T15:51:11.572987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:21.045297+0000","scrub_duration":0.0030285730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.275840+0000","last_change":"2024-09-13T15:34:34.942452+0000","last_active":"2024-09-13T15:51:03.275840+0000","last_peered":"2024-09-13T15:51:03.275840+0000","last_clean":"2024-09-13T15:51:03.275840+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:51:03.275840+0000","last_undegraded":"2024-09-13T15:51:03.275840+0000","last_fullsized":"2024-09-13T15:51:03.275840+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:10.000654+0000","last_change":"2024-09-13T15:51:10.000654+0000","last_active":"2024-09-13T15:51:10.000654+0000","last_peered":"2024-09-13T15:51:10.000654+0000","last_clean":"2024-09-13T15:51:10.000654+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:51:10.000654+0000","last_undegraded":"2024-09-13T15:51:10.000654+0000","last_fullsized":"2024-09-13T15:51:10.000654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:10.000340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:10.000340+0000","last_clean_scrub_stamp":"2024-09-13T15:51:10.000340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.854008+0000","scrub_duration":0.0030965559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734506+0000","last_change":"2024-09-13T15:34:34.949805+0000","last_active":"2024-09-13T15:51:06.734506+0000","last_peered":"2024-09-13T15:51:06.734506+0000","last_clean":"2024-09-13T15:51:06.734506+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:51:06.734506+0000","last_undegraded":"2024-09-13T15:51:06.734506+0000","last_fullsized":"2024-09-13T15:51:06.734506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:08.634807+0000","last_change":"2024-09-13T15:51:08.634807+0000","last_active":"2024-09-13T15:51:08.634807+0000","last_peered":"2024-09-13T15:51:08.634807+0000","last_clean":"2024-09-13T15:51:08.634807+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:51:08.634807+0000","last_undegraded":"2024-09-13T15:51:08.634807+0000","last_fullsized":"2024-09-13T15:51:08.634807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:08.634488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:08.634488+0000","last_clean_scrub_stamp":"2024-09-13T15:51:08.634488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:29.659635+0000","scrub_duration":0.0033577189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734286+0000","last_change":"2024-09-13T15:34:34.946174+0000","last_active":"2024-09-13T15:51:06.734286+0000","last_peered":"2024-09-13T15:51:06.734286+0000","last_clean":"2024-09-13T15:51:06.734286+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:51:06.734286+0000","last_undegraded":"2024-09-13T15:51:06.734286+0000","last_fullsized":"2024-09-13T15:51:06.734286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:43.932444+0000","last_change":"2024-09-13T15:51:43.932667+0000","last_active":"2024-09-13T15:51:43.932444+0000","last_peered":"2024-09-13T15:51:43.932444+0000","last_clean":"2024-09-13T15:51:43.932444+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:51:43.932444+0000","last_undegraded":"2024-09-13T15:51:43.932444+0000","last_fullsized":"2024-09-13T15:51:43.932444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:43.932395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:43.932395+0000","last_clean_scrub_stamp":"2024-09-13T15:51:43.932395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:50.418406+0000","scrub_duration":0.0030891629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279121+0000","last_change":"2024-09-13T15:34:34.953984+0000","last_active":"2024-09-13T15:51:06.279121+0000","last_peered":"2024-09-13T15:51:06.279121+0000","last_clean":"2024-09-13T15:51:06.279121+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:51:06.279121+0000","last_undegraded":"2024-09-13T15:51:06.279121+0000","last_fullsized":"2024-09-13T15:51:06.279121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:34.984870+0000","last_change":"2024-09-13T15:51:34.985088+0000","last_active":"2024-09-13T15:51:34.984870+0000","last_peered":"2024-09-13T15:51:34.984870+0000","last_clean":"2024-09-13T15:51:34.984870+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:51:34.984870+0000","last_undegraded":"2024-09-13T15:51:34.984870+0000","last_fullsized":"2024-09-13T15:51:34.984870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:34.984821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:34.984821+0000","last_clean_scrub_stamp":"2024-09-13T15:51:34.984821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:43.477329+0000","scrub_duration":0.0030114199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.192147+0000","last_change":"2024-09-13T15:34:34.955761+0000","last_active":"2024-09-13T15:51:07.192147+0000","last_peered":"2024-09-13T15:51:07.192147+0000","last_clean":"2024-09-13T15:51:07.192147+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:51:07.192147+0000","last_undegraded":"2024-09-13T15:51:07.192147+0000","last_fullsized":"2024-09-13T15:51:07.192147+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279478+0000","last_change":"2024-09-13T15:34:35.324328+0000","last_active":"2024-09-13T15:51:06.279478+0000","last_peered":"2024-09-13T15:51:06.279478+0000","last_clean":"2024-09-13T15:51:06.279478+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:51:06.279478+0000","last_undegraded":"2024-09-13T15:51:06.279478+0000","last_fullsized":"2024-09-13T15:51:06.279478+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107850+0000","last_change":"2024-09-13T15:34:34.960919+0000","last_active":"2024-09-13T15:51:03.107850+0000","last_peered":"2024-09-13T15:51:03.107850+0000","last_clean":"2024-09-13T15:51:03.107850+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:51:03.107850+0000","last_undegraded":"2024-09-13T15:51:03.107850+0000","last_fullsized":"2024-09-13T15:51:03.107850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:28.063597+0000","last_change":"2024-09-13T15:51:28.063807+0000","last_active":"2024-09-13T15:51:28.063597+0000","last_peered":"2024-09-13T15:51:28.063597+0000","last_clean":"2024-09-13T15:51:28.063597+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:51:28.063597+0000","last_undegraded":"2024-09-13T15:51:28.063597+0000","last_fullsized":"2024-09-13T15:51:28.063597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:28.063549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:28.063549+0000","last_clean_scrub_stamp":"2024-09-13T15:51:28.063549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:22.177895+0000","scrub_duration":0.0027253830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734325+0000","last_change":"2024-09-13T15:34:34.939804+0000","last_active":"2024-09-13T15:51:06.734325+0000","last_peered":"2024-09-13T15:51:06.734325+0000","last_clean":"2024-09-13T15:51:06.734325+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:51:06.734325+0000","last_undegraded":"2024-09-13T15:51:06.734325+0000","last_fullsized":"2024-09-13T15:51:06.734325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"27'108","reported_seq":231,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.275499+0000","last_change":"2024-09-13T15:34:27.588263+0000","last_active":"2024-09-13T15:51:03.275499+0000","last_peered":"2024-09-13T15:51:03.275499+0000","last_clean":"2024-09-13T15:51:03.275499+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:51:03.275499+0000","last_undegraded":"2024-09-13T15:51:03.275499+0000","last_fullsized":"2024-09-13T15:51:03.275499+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:25.870427+0000","last_clean_scrub_stamp":"2024-09-13T15:34:25.870427+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":70,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:09.022828+0000","last_change":"2024-09-13T15:51:09.023040+0000","last_active":"2024-09-13T15:51:09.022828+0000","last_peered":"2024-09-13T15:51:09.022828+0000","last_clean":"2024-09-13T15:51:09.022828+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:51:09.022828+0000","last_undegraded":"2024-09-13T15:51:09.022828+0000","last_fullsized":"2024-09-13T15:51:09.022828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:09.022780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:09.022780+0000","last_clean_scrub_stamp":"2024-09-13T15:51:09.022780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:57.652179+0000","scrub_duration":0.0027795350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.114749+0000","last_change":"2024-09-13T15:34:34.956621+0000","last_active":"2024-09-13T15:51:03.114749+0000","last_peered":"2024-09-13T15:51:03.114749+0000","last_clean":"2024-09-13T15:51:03.114749+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:51:03.114749+0000","last_undegraded":"2024-09-13T15:51:03.114749+0000","last_fullsized":"2024-09-13T15:51:03.114749+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:36.814688+0000","last_change":"2024-09-13T15:51:36.814917+0000","last_active":"2024-09-13T15:51:36.814688+0000","last_peered":"2024-09-13T15:51:36.814688+0000","last_clean":"2024-09-13T15:51:36.814688+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:51:36.814688+0000","last_undegraded":"2024-09-13T15:51:36.814688+0000","last_fullsized":"2024-09-13T15:51:36.814688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:36.814631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:36.814631+0000","last_clean_scrub_stamp":"2024-09-13T15:51:36.814631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:30.056367+0000","scrub_duration":0.0030192740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"15'1","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.271281+0000","last_change":"2024-09-13T15:34:34.936361+0000","last_active":"2024-09-13T15:51:03.271281+0000","last_peered":"2024-09-13T15:51:03.271281+0000","last_clean":"2024-09-13T15:51:03.271281+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:51:03.271281+0000","last_undegraded":"2024-09-13T15:51:03.271281+0000","last_fullsized":"2024-09-13T15:51:03.271281+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.749160+0000","last_change":"2024-09-13T15:34:35.347478+0000","last_active":"2024-09-13T15:51:03.749160+0000","last_peered":"2024-09-13T15:51:03.749160+0000","last_clean":"2024-09-13T15:51:03.749160+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:51:03.749160+0000","last_undegraded":"2024-09-13T15:51:03.749160+0000","last_fullsized":"2024-09-13T15:51:03.749160+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107213+0000","last_change":"2024-09-13T15:34:34.956480+0000","last_active":"2024-09-13T15:51:03.107213+0000","last_peered":"2024-09-13T15:51:03.107213+0000","last_clean":"2024-09-13T15:51:03.107213+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:51:03.107213+0000","last_undegraded":"2024-09-13T15:51:03.107213+0000","last_fullsized":"2024-09-13T15:51:03.107213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:20.704723+0000","last_change":"2024-09-13T15:51:20.704937+0000","last_active":"2024-09-13T15:51:20.704723+0000","last_peered":"2024-09-13T15:51:20.704723+0000","last_clean":"2024-09-13T15:51:20.704723+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:51:20.704723+0000","last_undegraded":"2024-09-13T15:51:20.704723+0000","last_fullsized":"2024-09-13T15:51:20.704723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:20.704675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:20.704675+0000","last_clean_scrub_stamp":"2024-09-13T15:51:20.704675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:41.029516+0000","scrub_duration":0.0028536220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.748213+0000","last_change":"2024-09-13T15:34:34.959935+0000","last_active":"2024-09-13T15:51:03.748213+0000","last_peered":"2024-09-13T15:51:03.748213+0000","last_clean":"2024-09-13T15:51:03.748213+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:51:03.748213+0000","last_undegraded":"2024-09-13T15:51:03.748213+0000","last_fullsized":"2024-09-13T15:51:03.748213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:23.631969+0000","last_change":"2024-09-13T15:51:23.632249+0000","last_active":"2024-09-13T15:51:23.631969+0000","last_peered":"2024-09-13T15:51:23.631969+0000","last_clean":"2024-09-13T15:51:23.631969+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:51:23.631969+0000","last_undegraded":"2024-09-13T15:51:23.631969+0000","last_fullsized":"2024-09-13T15:51:23.631969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:23.631921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:23.631921+0000","last_clean_scrub_stamp":"2024-09-13T15:51:23.631921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:28.485589+0000","scrub_duration":0.0028528719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"15'8","reported_seq":69,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.108683+0000","last_change":"2024-09-13T15:34:34.959407+0000","last_active":"2024-09-13T15:51:03.108683+0000","last_peered":"2024-09-13T15:51:03.108683+0000","last_clean":"2024-09-13T15:51:03.108683+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:51:03.108683+0000","last_undegraded":"2024-09-13T15:51:03.108683+0000","last_fullsized":"2024-09-13T15:51:03.108683+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:26.093049+0000","last_change":"2024-09-13T15:51:26.093274+0000","last_active":"2024-09-13T15:51:26.093049+0000","last_peered":"2024-09-13T15:51:26.093049+0000","last_clean":"2024-09-13T15:51:26.093049+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:51:26.093049+0000","last_undegraded":"2024-09-13T15:51:26.093049+0000","last_fullsized":"2024-09-13T15:51:26.093049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:26.092993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:26.092993+0000","last_clean_scrub_stamp":"2024-09-13T15:51:26.092993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:44.227778+0000","scrub_duration":0.0029912200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.745615+0000","last_change":"2024-09-13T15:34:34.954181+0000","last_active":"2024-09-13T15:51:03.745615+0000","last_peered":"2024-09-13T15:51:03.745615+0000","last_clean":"2024-09-13T15:51:03.745615+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:51:03.745615+0000","last_undegraded":"2024-09-13T15:51:03.745615+0000","last_fullsized":"2024-09-13T15:51:03.745615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.269085+0000","last_change":"2024-09-13T15:34:35.342732+0000","last_active":"2024-09-13T15:51:03.269085+0000","last_peered":"2024-09-13T15:51:03.269085+0000","last_clean":"2024-09-13T15:51:03.269085+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:51:03.269085+0000","last_undegraded":"2024-09-13T15:51:03.269085+0000","last_fullsized":"2024-09-13T15:51:03.269085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107354+0000","last_change":"2024-09-13T15:34:34.957763+0000","last_active":"2024-09-13T15:51:03.107354+0000","last_peered":"2024-09-13T15:51:03.107354+0000","last_clean":"2024-09-13T15:51:03.107354+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:51:03.107354+0000","last_undegraded":"2024-09-13T15:51:03.107354+0000","last_fullsized":"2024-09-13T15:51:03.107354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:33.819531+0000","last_change":"2024-09-13T15:51:33.819817+0000","last_active":"2024-09-13T15:51:33.819531+0000","last_peered":"2024-09-13T15:51:33.819531+0000","last_clean":"2024-09-13T15:51:33.819531+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:51:33.819531+0000","last_undegraded":"2024-09-13T15:51:33.819531+0000","last_fullsized":"2024-09-13T15:51:33.819531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:33.819477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:33.819477+0000","last_clean_scrub_stamp":"2024-09-13T15:51:33.819477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:21.665891+0000","scrub_duration":0.0030701579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747472+0000","last_change":"2024-09-13T15:34:34.942058+0000","last_active":"2024-09-13T15:51:03.747472+0000","last_peered":"2024-09-13T15:51:03.747472+0000","last_clean":"2024-09-13T15:51:03.747472+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:51:03.747472+0000","last_undegraded":"2024-09-13T15:51:03.747472+0000","last_fullsized":"2024-09-13T15:51:03.747472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.920706+0000","last_change":"2024-09-13T15:51:42.920918+0000","last_active":"2024-09-13T15:51:42.920706+0000","last_peered":"2024-09-13T15:51:42.920706+0000","last_clean":"2024-09-13T15:51:42.920706+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:51:42.920706+0000","last_undegraded":"2024-09-13T15:51:42.920706+0000","last_fullsized":"2024-09-13T15:51:42.920706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:42.920654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:42.920654+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.920654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:09.369234+0000","scrub_duration":0.0027763269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.114976+0000","last_change":"2024-09-13T15:34:34.955883+0000","last_active":"2024-09-13T15:51:03.114976+0000","last_peered":"2024-09-13T15:51:03.114976+0000","last_clean":"2024-09-13T15:51:03.114976+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:51:03.114976+0000","last_undegraded":"2024-09-13T15:51:03.114976+0000","last_fullsized":"2024-09-13T15:51:03.114976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2638,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.015505+0000","last_change":"2024-09-13T15:51:07.015632+0000","last_active":"2024-09-13T15:51:07.015505+0000","last_peered":"2024-09-13T15:51:07.015505+0000","last_clean":"2024-09-13T15:51:07.015505+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:51:07.015505+0000","last_undegraded":"2024-09-13T15:51:07.015505+0000","last_fullsized":"2024-09-13T15:51:07.015505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:07.015482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:07.015482+0000","last_clean_scrub_stamp":"2024-09-13T15:51:07.015482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:27.340322+0000","scrub_duration":0.001887321,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"58'5","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.931081+0000","last_change":"2024-09-13T15:51:42.931297+0000","last_active":"2024-09-13T15:51:42.931081+0000","last_peered":"2024-09-13T15:51:42.931081+0000","last_clean":"2024-09-13T15:51:42.931081+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:51:42.931081+0000","last_undegraded":"2024-09-13T15:51:42.931081+0000","last_fullsized":"2024-09-13T15:51:42.931081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'5","last_scrub_stamp":"2024-09-13T15:51:42.931027+0000","last_deep_scrub":"58'5","last_deep_scrub_stamp":"2024-09-13T15:51:42.931027+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.931027+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:04.378223+0000","scrub_duration":0.0069458810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279658+0000","last_change":"2024-09-13T15:34:35.347690+0000","last_active":"2024-09-13T15:51:06.279658+0000","last_peered":"2024-09-13T15:51:06.279658+0000","last_clean":"2024-09-13T15:51:06.279658+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:51:06.279658+0000","last_undegraded":"2024-09-13T15:51:06.279658+0000","last_fullsized":"2024-09-13T15:51:06.279658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279254+0000","last_change":"2024-09-13T15:34:34.953625+0000","last_active":"2024-09-13T15:51:06.279254+0000","last_peered":"2024-09-13T15:51:06.279254+0000","last_clean":"2024-09-13T15:51:06.279254+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:51:06.279254+0000","last_undegraded":"2024-09-13T15:51:06.279254+0000","last_fullsized":"2024-09-13T15:51:06.279254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:19.658733+0000","last_change":"2024-09-13T15:51:19.658733+0000","last_active":"2024-09-13T15:51:19.658733+0000","last_peered":"2024-09-13T15:51:19.658733+0000","last_clean":"2024-09-13T15:51:19.658733+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:51:19.658733+0000","last_undegraded":"2024-09-13T15:51:19.658733+0000","last_fullsized":"2024-09-13T15:51:19.658733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:19.658442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:19.658442+0000","last_clean_scrub_stamp":"2024-09-13T15:51:19.658442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:52.886746+0000","scrub_duration":0.0031503270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734637+0000","last_change":"2024-09-13T15:34:34.939305+0000","last_active":"2024-09-13T15:51:06.734637+0000","last_peered":"2024-09-13T15:51:06.734637+0000","last_clean":"2024-09-13T15:51:06.734637+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:51:06.734637+0000","last_undegraded":"2024-09-13T15:51:06.734637+0000","last_fullsized":"2024-09-13T15:51:06.734637+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734789+0000","last_change":"2024-09-13T15:34:35.335773+0000","last_active":"2024-09-13T15:51:06.734789+0000","last_peered":"2024-09-13T15:51:06.734789+0000","last_clean":"2024-09-13T15:51:06.734789+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:51:06.734789+0000","last_undegraded":"2024-09-13T15:51:06.734789+0000","last_fullsized":"2024-09-13T15:51:06.734789+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279289+0000","last_change":"2024-09-13T15:34:34.950709+0000","last_active":"2024-09-13T15:51:06.279289+0000","last_peered":"2024-09-13T15:51:06.279289+0000","last_clean":"2024-09-13T15:51:06.279289+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:51:06.279289+0000","last_undegraded":"2024-09-13T15:51:06.279289+0000","last_fullsized":"2024-09-13T15:51:06.279289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:44.659569+0000","last_change":"2024-09-13T15:51:44.659803+0000","last_active":"2024-09-13T15:51:44.659569+0000","last_peered":"2024-09-13T15:51:44.659569+0000","last_clean":"2024-09-13T15:51:44.659569+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:51:44.659569+0000","last_undegraded":"2024-09-13T15:51:44.659569+0000","last_fullsized":"2024-09-13T15:51:44.659569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:44.659519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:44.659519+0000","last_clean_scrub_stamp":"2024-09-13T15:51:44.659519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:32.505933+0000","scrub_duration":0.0028280330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279378+0000","last_change":"2024-09-13T15:34:34.954475+0000","last_active":"2024-09-13T15:51:06.279378+0000","last_peered":"2024-09-13T15:51:06.279378+0000","last_clean":"2024-09-13T15:51:06.279378+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:51:06.279378+0000","last_undegraded":"2024-09-13T15:51:06.279378+0000","last_fullsized":"2024-09-13T15:51:06.279378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107565+0000","last_change":"2024-09-13T15:34:34.957379+0000","last_active":"2024-09-13T15:51:03.107565+0000","last_peered":"2024-09-13T15:51:03.107565+0000","last_clean":"2024-09-13T15:51:03.107565+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:51:03.107565+0000","last_undegraded":"2024-09-13T15:51:03.107565+0000","last_fullsized":"2024-09-13T15:51:03.107565+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747893+0000","last_change":"2024-09-13T15:34:35.331843+0000","last_active":"2024-09-13T15:51:03.747893+0000","last_peered":"2024-09-13T15:51:03.747893+0000","last_clean":"2024-09-13T15:51:03.747893+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:51:03.747893+0000","last_undegraded":"2024-09-13T15:51:03.747893+0000","last_fullsized":"2024-09-13T15:51:03.747893+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.268748+0000","last_change":"2024-09-13T15:34:34.944458+0000","last_active":"2024-09-13T15:51:03.268748+0000","last_peered":"2024-09-13T15:51:03.268748+0000","last_clean":"2024-09-13T15:51:03.268748+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:51:03.268748+0000","last_undegraded":"2024-09-13T15:51:03.268748+0000","last_fullsized":"2024-09-13T15:51:03.268748+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":70,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:30.052201+0000","last_change":"2024-09-13T15:51:30.052443+0000","last_active":"2024-09-13T15:51:30.052201+0000","last_peered":"2024-09-13T15:51:30.052201+0000","last_clean":"2024-09-13T15:51:30.052201+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:51:30.052201+0000","last_undegraded":"2024-09-13T15:51:30.052201+0000","last_fullsized":"2024-09-13T15:51:30.052201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:30.052149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:30.052149+0000","last_clean_scrub_stamp":"2024-09-13T15:51:30.052149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:17.898563+0000","scrub_duration":0.002920181,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.192602+0000","last_change":"2024-09-13T15:34:35.331904+0000","last_active":"2024-09-13T15:51:07.192602+0000","last_peered":"2024-09-13T15:51:07.192602+0000","last_clean":"2024-09-13T15:51:07.192602+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:51:07.192602+0000","last_undegraded":"2024-09-13T15:51:07.192602+0000","last_fullsized":"2024-09-13T15:51:07.192602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:15.611315+0000","last_change":"2024-09-13T15:51:15.611315+0000","last_active":"2024-09-13T15:51:15.611315+0000","last_peered":"2024-09-13T15:51:15.611315+0000","last_clean":"2024-09-13T15:51:15.611315+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:51:15.611315+0000","last_undegraded":"2024-09-13T15:51:15.611315+0000","last_fullsized":"2024-09-13T15:51:15.611315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:15.611033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:15.611033+0000","last_clean_scrub_stamp":"2024-09-13T15:51:15.611033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:31.771056+0000","scrub_duration":0.0029690459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279713+0000","last_change":"2024-09-13T15:34:35.324690+0000","last_active":"2024-09-13T15:51:06.279713+0000","last_peered":"2024-09-13T15:51:06.279713+0000","last_clean":"2024-09-13T15:51:06.279713+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:51:06.279713+0000","last_undegraded":"2024-09-13T15:51:06.279713+0000","last_fullsized":"2024-09-13T15:51:06.279713+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:10.591481+0000","last_change":"2024-09-13T15:51:10.591481+0000","last_active":"2024-09-13T15:51:10.591481+0000","last_peered":"2024-09-13T15:51:10.591481+0000","last_clean":"2024-09-13T15:51:10.591481+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:51:10.591481+0000","last_undegraded":"2024-09-13T15:51:10.591481+0000","last_fullsized":"2024-09-13T15:51:10.591481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:10.591224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:10.591224+0000","last_clean_scrub_stamp":"2024-09-13T15:51:10.591224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:30.916064+0000","scrub_duration":0.0029806559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":50,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.267016+0000","last_change":"2024-09-13T15:35:20.157986+0000","last_active":"2024-09-13T15:51:03.267016+0000","last_peered":"2024-09-13T15:51:03.267016+0000","last_clean":"2024-09-13T15:51:03.267016+0000","last_became_active":"2024-09-13T15:35:20.157317+0000","last_became_peered":"2024-09-13T15:35:20.157317+0000","last_unstale":"2024-09-13T15:51:03.267016+0000","last_undegraded":"2024-09-13T15:51:03.267016+0000","last_fullsized":"2024-09-13T15:51:03.267016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":70,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:44.901059+0000","last_change":"2024-09-13T15:51:44.901282+0000","last_active":"2024-09-13T15:51:44.901059+0000","last_peered":"2024-09-13T15:51:44.901059+0000","last_clean":"2024-09-13T15:51:44.901059+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:51:44.901059+0000","last_undegraded":"2024-09-13T15:51:44.901059+0000","last_fullsized":"2024-09-13T15:51:44.901059+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:44.901011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:44.901011+0000","last_clean_scrub_stamp":"2024-09-13T15:51:44.901011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:47.282721+0000","scrub_duration":0.002805597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.109119+0000","last_change":"2024-09-13T15:34:35.335209+0000","last_active":"2024-09-13T15:51:03.109119+0000","last_peered":"2024-09-13T15:51:03.109119+0000","last_clean":"2024-09-13T15:51:03.109119+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:51:03.109119+0000","last_undegraded":"2024-09-13T15:51:03.109119+0000","last_fullsized":"2024-09-13T15:51:03.109119+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:14.575558+0000","last_change":"2024-09-13T15:51:14.575770+0000","last_active":"2024-09-13T15:51:14.575558+0000","last_peered":"2024-09-13T15:51:14.575558+0000","last_clean":"2024-09-13T15:51:14.575558+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:51:14.575558+0000","last_undegraded":"2024-09-13T15:51:14.575558+0000","last_fullsized":"2024-09-13T15:51:14.575558+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:14.575511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:14.575511+0000","last_clean_scrub_stamp":"2024-09-13T15:51:14.575511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:22.946343+0000","scrub_duration":0.0031682049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:31.763289+0000","last_change":"2024-09-13T15:51:31.763566+0000","last_active":"2024-09-13T15:51:31.763289+0000","last_peered":"2024-09-13T15:51:31.763289+0000","last_clean":"2024-09-13T15:51:31.763289+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:51:31.763289+0000","last_undegraded":"2024-09-13T15:51:31.763289+0000","last_fullsized":"2024-09-13T15:51:31.763289+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:31.763240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:31.763240+0000","last_clean_scrub_stamp":"2024-09-13T15:51:31.763240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:25.877586+0000","scrub_duration":0.0031492009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746175+0000","last_change":"2024-09-13T15:34:35.324523+0000","last_active":"2024-09-13T15:51:03.746175+0000","last_peered":"2024-09-13T15:51:03.746175+0000","last_clean":"2024-09-13T15:51:03.746175+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:51:03.746175+0000","last_undegraded":"2024-09-13T15:51:03.746175+0000","last_fullsized":"2024-09-13T15:51:03.746175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.266717+0000","last_change":"2024-09-13T15:34:35.329712+0000","last_active":"2024-09-13T15:51:03.266717+0000","last_peered":"2024-09-13T15:51:03.266717+0000","last_clean":"2024-09-13T15:51:03.266717+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:51:03.266717+0000","last_undegraded":"2024-09-13T15:51:03.266717+0000","last_fullsized":"2024-09-13T15:51:03.266717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":50,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734854+0000","last_change":"2024-09-13T15:35:20.156675+0000","last_active":"2024-09-13T15:51:06.734854+0000","last_peered":"2024-09-13T15:51:06.734854+0000","last_clean":"2024-09-13T15:51:06.734854+0000","last_became_active":"2024-09-13T15:35:20.152889+0000","last_became_peered":"2024-09-13T15:35:20.152889+0000","last_unstale":"2024-09-13T15:51:06.734854+0000","last_undegraded":"2024-09-13T15:51:06.734854+0000","last_fullsized":"2024-09-13T15:51:06.734854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746153+0000","last_change":"2024-09-13T15:34:35.346893+0000","last_active":"2024-09-13T15:51:03.746153+0000","last_peered":"2024-09-13T15:51:03.746153+0000","last_clean":"2024-09-13T15:51:03.746153+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:51:03.746153+0000","last_undegraded":"2024-09-13T15:51:03.746153+0000","last_fullsized":"2024-09-13T15:51:03.746153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:14.607793+0000","last_change":"2024-09-13T15:51:14.608116+0000","last_active":"2024-09-13T15:51:14.607793+0000","last_peered":"2024-09-13T15:51:14.607793+0000","last_clean":"2024-09-13T15:51:14.607793+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:51:14.607793+0000","last_undegraded":"2024-09-13T15:51:14.607793+0000","last_fullsized":"2024-09-13T15:51:14.607793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:14.607733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:14.607733+0000","last_clean_scrub_stamp":"2024-09-13T15:51:14.607733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:57.098851+0000","scrub_duration":0.0030409230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.109337+0000","last_change":"2024-09-13T15:34:35.335384+0000","last_active":"2024-09-13T15:51:03.109337+0000","last_peered":"2024-09-13T15:51:03.109337+0000","last_clean":"2024-09-13T15:51:03.109337+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:51:03.109337+0000","last_undegraded":"2024-09-13T15:51:03.109337+0000","last_fullsized":"2024-09-13T15:51:03.109337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.267819+0000","last_change":"2024-09-13T15:34:35.333522+0000","last_active":"2024-09-13T15:51:03.267819+0000","last_peered":"2024-09-13T15:51:03.267819+0000","last_clean":"2024-09-13T15:51:03.267819+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:51:03.267819+0000","last_undegraded":"2024-09-13T15:51:03.267819+0000","last_fullsized":"2024-09-13T15:51:03.267819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.113408+0000","last_change":"2024-09-13T15:34:35.331848+0000","last_active":"2024-09-13T15:51:03.113408+0000","last_peered":"2024-09-13T15:51:03.113408+0000","last_clean":"2024-09-13T15:51:03.113408+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:51:03.113408+0000","last_undegraded":"2024-09-13T15:51:03.113408+0000","last_fullsized":"2024-09-13T15:51:03.113408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.262421+0000","last_change":"2024-09-13T15:34:35.333765+0000","last_active":"2024-09-13T15:51:03.262421+0000","last_peered":"2024-09-13T15:51:03.262421+0000","last_clean":"2024-09-13T15:51:03.262421+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:51:03.262421+0000","last_undegraded":"2024-09-13T15:51:03.262421+0000","last_fullsized":"2024-09-13T15:51:03.262421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:12.628563+0000","last_change":"2024-09-13T15:51:12.628806+0000","last_active":"2024-09-13T15:51:12.628563+0000","last_peered":"2024-09-13T15:51:12.628563+0000","last_clean":"2024-09-13T15:51:12.628563+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:51:12.628563+0000","last_undegraded":"2024-09-13T15:51:12.628563+0000","last_fullsized":"2024-09-13T15:51:12.628563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:12.628512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:12.628512+0000","last_clean_scrub_stamp":"2024-09-13T15:51:12.628512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:01.257911+0000","scrub_duration":0.0030549050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279823+0000","last_change":"2024-09-13T15:34:35.335252+0000","last_active":"2024-09-13T15:51:06.279823+0000","last_peered":"2024-09-13T15:51:06.279823+0000","last_clean":"2024-09-13T15:51:06.279823+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:51:06.279823+0000","last_undegraded":"2024-09-13T15:51:06.279823+0000","last_fullsized":"2024-09-13T15:51:06.279823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279866+0000","last_change":"2024-09-13T15:34:35.330875+0000","last_active":"2024-09-13T15:51:06.279866+0000","last_peered":"2024-09-13T15:51:06.279866+0000","last_clean":"2024-09-13T15:51:06.279866+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:51:06.279866+0000","last_undegraded":"2024-09-13T15:51:06.279866+0000","last_fullsized":"2024-09-13T15:51:06.279866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279961+0000","last_change":"2024-09-13T15:34:35.331709+0000","last_active":"2024-09-13T15:51:06.279961+0000","last_peered":"2024-09-13T15:51:06.279961+0000","last_clean":"2024-09-13T15:51:06.279961+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:51:06.279961+0000","last_undegraded":"2024-09-13T15:51:06.279961+0000","last_fullsized":"2024-09-13T15:51:06.279961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:09.587225+0000","last_change":"2024-09-13T15:51:09.587225+0000","last_active":"2024-09-13T15:51:09.587225+0000","last_peered":"2024-09-13T15:51:09.587225+0000","last_clean":"2024-09-13T15:51:09.587225+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:51:09.587225+0000","last_undegraded":"2024-09-13T15:51:09.587225+0000","last_fullsized":"2024-09-13T15:51:09.587225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:09.586889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:09.586889+0000","last_clean_scrub_stamp":"2024-09-13T15:51:09.586889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:42.815192+0000","scrub_duration":0.0032138610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.735088+0000","last_change":"2024-09-13T15:34:35.345251+0000","last_active":"2024-09-13T15:51:06.735088+0000","last_peered":"2024-09-13T15:51:06.735088+0000","last_clean":"2024-09-13T15:51:06.735088+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:51:06.735088+0000","last_undegraded":"2024-09-13T15:51:06.735088+0000","last_fullsized":"2024-09-13T15:51:06.735088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.109967+0000","last_change":"2024-09-13T15:34:35.335400+0000","last_active":"2024-09-13T15:51:03.109967+0000","last_peered":"2024-09-13T15:51:03.109967+0000","last_clean":"2024-09-13T15:51:03.109967+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:51:03.109967+0000","last_undegraded":"2024-09-13T15:51:03.109967+0000","last_fullsized":"2024-09-13T15:51:03.109967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":70,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:28.690428+0000","last_change":"2024-09-13T15:51:28.690653+0000","last_active":"2024-09-13T15:51:28.690428+0000","last_peered":"2024-09-13T15:51:28.690428+0000","last_clean":"2024-09-13T15:51:28.690428+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:51:28.690428+0000","last_undegraded":"2024-09-13T15:51:28.690428+0000","last_fullsized":"2024-09-13T15:51:28.690428+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:28.690380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:28.690380+0000","last_clean_scrub_stamp":"2024-09-13T15:51:28.690380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:46.825165+0000","scrub_duration":0.0029361040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107737+0000","last_change":"2024-09-13T15:34:35.329319+0000","last_active":"2024-09-13T15:51:03.107737+0000","last_peered":"2024-09-13T15:51:03.107737+0000","last_clean":"2024-09-13T15:51:03.107737+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:51:03.107737+0000","last_undegraded":"2024-09-13T15:51:03.107737+0000","last_fullsized":"2024-09-13T15:51:03.107737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747697+0000","last_change":"2024-09-13T15:34:35.327922+0000","last_active":"2024-09-13T15:51:03.747697+0000","last_peered":"2024-09-13T15:51:03.747697+0000","last_clean":"2024-09-13T15:51:03.747697+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:51:03.747697+0000","last_undegraded":"2024-09-13T15:51:03.747697+0000","last_fullsized":"2024-09-13T15:51:03.747697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.115070+0000","last_change":"2024-09-13T15:34:35.330864+0000","last_active":"2024-09-13T15:51:03.115070+0000","last_peered":"2024-09-13T15:51:03.115070+0000","last_clean":"2024-09-13T15:51:03.115070+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:51:03.115070+0000","last_undegraded":"2024-09-13T15:51:03.115070+0000","last_fullsized":"2024-09-13T15:51:03.115070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.280073+0000","last_change":"2024-09-13T15:34:35.324580+0000","last_active":"2024-09-13T15:51:06.280073+0000","last_peered":"2024-09-13T15:51:06.280073+0000","last_clean":"2024-09-13T15:51:06.280073+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:51:06.280073+0000","last_undegraded":"2024-09-13T15:51:06.280073+0000","last_fullsized":"2024-09-13T15:51:06.280073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.735041+0000","last_change":"2024-09-13T15:34:35.329279+0000","last_active":"2024-09-13T15:51:06.735041+0000","last_peered":"2024-09-13T15:51:06.735041+0000","last_clean":"2024-09-13T15:51:06.735041+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:51:06.735041+0000","last_undegraded":"2024-09-13T15:51:06.735041+0000","last_fullsized":"2024-09-13T15:51:06.735041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.280137+0000","last_change":"2024-09-13T15:34:35.347293+0000","last_active":"2024-09-13T15:51:06.280137+0000","last_peered":"2024-09-13T15:51:06.280137+0000","last_clean":"2024-09-13T15:51:06.280137+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:51:06.280137+0000","last_undegraded":"2024-09-13T15:51:06.280137+0000","last_fullsized":"2024-09-13T15:51:06.280137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3436,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47,"ondisk_log_size":47,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738580,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99880,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94271960,"statfs":{"total":96636764160,"available":96534487040,"internally_reserved":0,"allocated":688128,"data_stored":300221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47699999999999998,"15min":0.42999999999999999},"min":{"1min":0.248,"5min":0.20499999999999999,"15min":0.152},"max":{"1min":0.65600000000000003,"5min":0.83899999999999997,"15min":3.4550000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.46300000000000002},"min":{"1min":0.32300000000000001,"5min":0.248,"15min":0.18099999999999999},"max":{"1min":0.76900000000000002,"5min":0.97499999999999998,"15min":6.1989999999999998},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:50:52 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.53600000000000003,"15min":0.46300000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.185},"max":{"1min":0.82699999999999996,"5min":1.006,"15min":1.4790000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.495},"min":{"1min":0.31,"5min":0.30299999999999999,"15min":0.17799999999999999},"max":{"1min":0.73199999999999998,"5min":1.0589999999999999,"15min":1.399},"last":0.61299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738579,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148852,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":94222988,"statfs":{"total":96636764160,"available":96484339712,"internally_reserved":0,"allocated":1290240,"data_stored":891249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45600000000000002,"15min":0.41599999999999998},"min":{"1min":0.26900000000000002,"5min":0.214,"15min":0.159},"max":{"1min":0.64700000000000002,"5min":0.69599999999999995,"15min":4.2400000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.432},"min":{"1min":0.33900000000000002,"5min":0.20399999999999999,"15min":0.17100000000000001},"max":{"1min":0.70399999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:50:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52800000000000002,"15min":0.443},"min":{"1min":0.42099999999999999,"5min":0.26400000000000001,"15min":0.17199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.82999999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57299999999999995,"15min":0.48699999999999999},"min":{"1min":0.317,"5min":0.253,"15min":0.189},"max":{"1min":0.86099999999999999,"5min":0.93000000000000005,"15min":1.2789999999999999},"last":0.64800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738581,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":158696,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94213144,"statfs":{"total":96636764160,"available":96474259456,"internally_reserved":0,"allocated":1277952,"data_stored":888575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":161216966},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47899999999999998,"15min":0.40799999999999997},"min":{"1min":0.28399999999999997,"5min":0.20399999999999999,"15min":0.158},"max":{"1min":0.755,"5min":0.80900000000000005,"15min":0.873},"last":0.5},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.42699999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.186},"max":{"1min":0.68200000000000005,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.57299999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:50:57 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53700000000000003,"15min":0.48499999999999999},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.17899999999999999},"max":{"1min":0.77400000000000002,"5min":0.82099999999999995,"15min":9.4610000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56999999999999995,"15min":0.48599999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.20300000000000001},"max":{"1min":0.67700000000000005,"5min":0.84899999999999998,"15min":0.90700000000000003},"last":0.61299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:51:48.243 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.243 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.243 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.243 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.243 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.243 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.243 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.244 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.244 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.244 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.244 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.244 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.244 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.244 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.244 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.245 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.245 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.245 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.245 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.245 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T15:34:25.870427+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.245 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.245 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.245 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.246 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.246 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.246 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.246 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.246 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.246 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.246 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.246 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.247 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.247 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.247 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.247 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.247 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.247 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.247 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.247 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.247 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.248 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.248 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.248 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.248 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.248 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.248 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.248 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.249 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.249 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.249 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.249 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.249 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.249 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.249 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.249 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.249 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.250 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.250 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.250 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.250 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.250 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.250 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.250 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:51:48.250 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T15:52:01.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:52:08.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:52:08.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.387+0000 7f6e4028c640 1 Processor -- start 2024-09-13T15:52:08.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.387+0000 7f6e4028c640 1 -- start start 2024-09-13T15:52:08.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.387+0000 7f6e4028c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e380bebb0 0x7f6e380a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:08.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.387+0000 7f6e4028c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e381515b0 con 0x7f6e380b4010 2024-09-13T15:52:08.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.387+0000 7f6e4028c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3814e2c0 con 0x7f6e380bebb0 2024-09-13T15:52:08.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.387+0000 7f6e3e028640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e380bebb0 0x7f6e380a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:08.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.387+0000 7f6e3e028640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e380bebb0 0x7f6e380a4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53296/0 (socket says 172.21.15.40:53296) 2024-09-13T15:52:08.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.387+0000 7f6e3d827640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6e380b4010 0x7f6e3806e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43536/0 (socket says 172.21.15.40:43536) 2024-09-13T15:52:08.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.387+0000 7f6e3e028640 1 -- 172.21.15.40:0/1344121953 learned_addr learned my addr 172.21.15.40:0/1344121953 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:52:08.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.387+0000 7f6e3e028640 1 -- 172.21.15.40:0/1344121953 >> v1:172.21.15.40:6789/0 conn(0x7f6e380b4010 legacy=0x7f6e3806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:08.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.387+0000 7f6e3d026640 1 -- 172.21.15.40:0/1344121953 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786415700 0 0) 0x7f6e381515b0 con 0x7f6e380b4010 2024-09-13T15:52:08.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.387+0000 7f6e3e028640 1 -- 172.21.15.40:0/1344121953 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3806f830 con 0x7f6e380bebb0 2024-09-13T15:52:08.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.391+0000 7f6e3e028640 1 --2- 172.21.15.40:0/1344121953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e380bebb0 0x7f6e380a4d70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f6e340097f0 tx=0x7f6e3401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcfbb8e83065dfdf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:08.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.391+0000 7f6e3d026640 1 -- 172.21.15.40:0/1344121953 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e380b6bc0 con 0x7f6e380bebb0 2024-09-13T15:52:08.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.391+0000 7f6e3d026640 1 -- 172.21.15.40:0/1344121953 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e340a7050 con 0x7f6e380bebb0 2024-09-13T15:52:08.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.391+0000 7f6e3d026640 1 -- 172.21.15.40:0/1344121953 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e340ab680 con 0x7f6e380bebb0 2024-09-13T15:52:08.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.391+0000 7f6e4028c640 1 -- 172.21.15.40:0/1344121953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e380bebb0 msgr2=0x7f6e380a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:08.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.391+0000 7f6e4028c640 1 --2- 172.21.15.40:0/1344121953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e380bebb0 0x7f6e380a4d70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f6e340097f0 tx=0x7f6e3401c4e0 comp rx=0 tx=0).stop 2024-09-13T15:52:08.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.391+0000 7f6e4028c640 1 -- 172.21.15.40:0/1344121953 shutdown_connections 2024-09-13T15:52:08.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.391+0000 7f6e4028c640 1 --2- 172.21.15.40:0/1344121953 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e380bebb0 0x7f6e380a4d70 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:08.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.391+0000 7f6e4028c640 1 -- 172.21.15.40:0/1344121953 >> 172.21.15.40:0/1344121953 conn(0x7f6e3806a540 msgr2=0x7f6e380a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:52:08.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.391+0000 7f6e4028c640 1 -- 172.21.15.40:0/1344121953 shutdown_connections 2024-09-13T15:52:08.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.391+0000 7f6e4028c640 1 -- 172.21.15.40:0/1344121953 wait complete. 2024-09-13T15:52:08.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e4028c640 1 Processor -- start 2024-09-13T15:52:08.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e4028c640 1 -- start start 2024-09-13T15:52:08.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e4028c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e380b4010 0x7f6e380bb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:08.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e4028c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3814b960 con 0x7f6e380b4010 2024-09-13T15:52:08.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e3e028640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e380b4010 0x7f6e380bb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:08.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e3e028640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e380b4010 0x7f6e380bb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53312/0 (socket says 172.21.15.40:53312) 2024-09-13T15:52:08.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e3e028640 1 -- 172.21.15.40:0/2360441759 learned_addr learned my addr 172.21.15.40:0/2360441759 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:52:08.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e3e028640 1 -- 172.21.15.40:0/2360441759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e340094d0 con 0x7f6e380b4010 2024-09-13T15:52:08.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e3e028640 1 --2- 172.21.15.40:0/2360441759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e380b4010 0x7f6e380bb900 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f6e3401a110 tx=0x7f6e3401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:08.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e2effd640 1 -- 172.21.15.40:0/2360441759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e340b6550 con 0x7f6e380b4010 2024-09-13T15:52:08.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e2effd640 1 -- 172.21.15.40:0/2360441759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e340b66b0 con 0x7f6e380b4010 2024-09-13T15:52:08.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e4028c640 1 -- 172.21.15.40:0/2360441759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e380b7910 con 0x7f6e380b4010 2024-09-13T15:52:08.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e2effd640 1 -- 172.21.15.40:0/2360441759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e340b6970 con 0x7f6e380b4010 2024-09-13T15:52:08.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e4028c640 1 -- 172.21.15.40:0/2360441759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e38147700 con 0x7f6e380b4010 2024-09-13T15:52:08.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e2effd640 1 -- 172.21.15.40:0/2360441759 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f6e340b2040 con 0x7f6e380b4010 2024-09-13T15:52:08.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e4028c640 1 -- 172.21.15.40:0/2360441759 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e380a4d70 con 0x7f6e380b4010 2024-09-13T15:52:08.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e2effd640 1 --2- 172.21.15.40:0/2360441759 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6e1c035580 0x7f6e1c037a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:08.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e2effd640 1 -- 172.21.15.40:0/2360441759 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f6e340e2990 con 0x7f6e380b4010 2024-09-13T15:52:08.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.395+0000 7f6e3d827640 1 --2- 172.21.15.40:0/2360441759 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6e1c035580 0x7f6e1c037a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:08.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.399+0000 7f6e3d827640 1 --2- 172.21.15.40:0/2360441759 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6e1c035580 0x7f6e1c037a40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6e28007fd0 tx=0x7f6e28007920 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:08.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.403+0000 7f6e2effd640 1 -- 172.21.15.40:0/2360441759 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6e340b6ad0 con 0x7f6e380b4010 2024-09-13T15:52:08.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.559+0000 7f6e4028c640 1 -- 172.21.15.40:0/2360441759 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e380a3d10 con 0x7f6e1c035580 2024-09-13T15:52:08.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.567+0000 7f6e2effd640 1 -- 172.21.15.40:0/2360441759 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249316 (secure 0 0 0) 0x7f6e380a3d10 con 0x7f6e1c035580 2024-09-13T15:52:08.570 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:52:08.571 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:52:08.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.571+0000 7f6e4028c640 1 -- 172.21.15.40:0/2360441759 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6e1c035580 msgr2=0x7f6e1c037a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:08.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.571+0000 7f6e4028c640 1 --2- 172.21.15.40:0/2360441759 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6e1c035580 0x7f6e1c037a40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6e28007fd0 tx=0x7f6e28007920 comp rx=0 tx=0).stop 2024-09-13T15:52:08.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.571+0000 7f6e4028c640 1 -- 172.21.15.40:0/2360441759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e380b4010 msgr2=0x7f6e380bb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:08.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.571+0000 7f6e4028c640 1 --2- 172.21.15.40:0/2360441759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e380b4010 0x7f6e380bb900 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f6e3401a110 tx=0x7f6e3401ad20 comp rx=0 tx=0).stop 2024-09-13T15:52:08.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.571+0000 7f6e4028c640 1 -- 172.21.15.40:0/2360441759 shutdown_connections 2024-09-13T15:52:08.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.571+0000 7f6e4028c640 1 --2- 172.21.15.40:0/2360441759 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f6e1c035580 0x7f6e1c037a40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:08.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.571+0000 7f6e4028c640 1 --2- 172.21.15.40:0/2360441759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e380b4010 0x7f6e380bb900 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:08.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.571+0000 7f6e4028c640 1 -- 172.21.15.40:0/2360441759 >> 172.21.15.40:0/2360441759 conn(0x7f6e3806a540 msgr2=0x7f6e380b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:52:08.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.571+0000 7f6e4028c640 1 -- 172.21.15.40:0/2360441759 shutdown_connections 2024-09-13T15:52:08.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:08.571+0000 7f6e4028c640 1 -- 172.21.15.40:0/2360441759 wait complete. 2024-09-13T15:52:08.589 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-09-13T15:52:07.869720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593804,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":208,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":407428,"kb_used_data":3180,"kb_used_omap":4,"kb_used_meta":404219,"kb_avail":282708092,"statfs":{"total":289910292480,"available":289493086208,"internally_reserved":0,"allocated":3256320,"data_stored":2080045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":413920594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003932"},"pg_stats":[{"pgid":"2.1f","version":"58'6","reported_seq":79,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:00.925214+0000","last_change":"2024-09-13T15:52:00.925433+0000","last_active":"2024-09-13T15:52:00.925214+0000","last_peered":"2024-09-13T15:52:00.925214+0000","last_clean":"2024-09-13T15:52:00.925214+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:52:00.925214+0000","last_undegraded":"2024-09-13T15:52:00.925214+0000","last_fullsized":"2024-09-13T15:52:00.925214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'6","last_scrub_stamp":"2024-09-13T15:52:00.925158+0000","last_deep_scrub":"58'6","last_deep_scrub_stamp":"2024-09-13T15:52:00.925158+0000","last_clean_scrub_stamp":"2024-09-13T15:52:00.925158+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:56.612520+0000","scrub_duration":0.0072895659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:22.675129+0000","last_change":"2024-09-13T15:51:22.675350+0000","last_active":"2024-09-13T15:51:22.675129+0000","last_peered":"2024-09-13T15:51:22.675129+0000","last_clean":"2024-09-13T15:51:22.675129+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:51:22.675129+0000","last_undegraded":"2024-09-13T15:51:22.675129+0000","last_fullsized":"2024-09-13T15:51:22.675129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:22.675078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:22.675078+0000","last_clean_scrub_stamp":"2024-09-13T15:51:22.675078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:11.304477+0000","scrub_duration":0.002879932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:47.519274+0000","last_change":"2024-09-13T15:51:47.519523+0000","last_active":"2024-09-13T15:51:47.519274+0000","last_peered":"2024-09-13T15:51:47.519274+0000","last_clean":"2024-09-13T15:51:47.519274+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:51:47.519274+0000","last_undegraded":"2024-09-13T15:51:47.519274+0000","last_fullsized":"2024-09-13T15:51:47.519274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-13T15:51:47.519216+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-09-13T15:51:47.519216+0000","last_clean_scrub_stamp":"2024-09-13T15:51:47.519216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:40.760952+0000","scrub_duration":0.0029653919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279719+0000","last_change":"2024-09-13T15:34:35.350474+0000","last_active":"2024-09-13T15:51:06.279719+0000","last_peered":"2024-09-13T15:51:06.279719+0000","last_clean":"2024-09-13T15:51:06.279719+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:51:06.279719+0000","last_undegraded":"2024-09-13T15:51:06.279719+0000","last_fullsized":"2024-09-13T15:51:06.279719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"15'2","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279386+0000","last_change":"2024-09-13T15:34:34.950125+0000","last_active":"2024-09-13T15:51:06.279386+0000","last_peered":"2024-09-13T15:51:06.279386+0000","last_clean":"2024-09-13T15:51:06.279386+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:51:06.279386+0000","last_undegraded":"2024-09-13T15:51:06.279386+0000","last_fullsized":"2024-09-13T15:51:06.279386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:58.792615+0000","last_change":"2024-09-13T15:51:58.792615+0000","last_active":"2024-09-13T15:51:58.792615+0000","last_peered":"2024-09-13T15:51:58.792615+0000","last_clean":"2024-09-13T15:51:58.792615+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:51:58.792615+0000","last_undegraded":"2024-09-13T15:51:58.792615+0000","last_fullsized":"2024-09-13T15:51:58.792615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:58.792356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:58.792356+0000","last_clean_scrub_stamp":"2024-09-13T15:51:58.792356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:54.479718+0000","scrub_duration":0.0030650410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":53,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.114859+0000","last_change":"2024-09-13T15:35:20.173539+0000","last_active":"2024-09-13T15:51:03.114859+0000","last_peered":"2024-09-13T15:51:03.114859+0000","last_clean":"2024-09-13T15:51:03.114859+0000","last_became_active":"2024-09-13T15:35:20.165658+0000","last_became_peered":"2024-09-13T15:35:20.165658+0000","last_unstale":"2024-09-13T15:51:03.114859+0000","last_undegraded":"2024-09-13T15:51:03.114859+0000","last_fullsized":"2024-09-13T15:51:03.114859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":70,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:39.648014+0000","last_change":"2024-09-13T15:51:39.648291+0000","last_active":"2024-09-13T15:51:39.648014+0000","last_peered":"2024-09-13T15:51:39.648014+0000","last_clean":"2024-09-13T15:51:39.648014+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:51:39.648014+0000","last_undegraded":"2024-09-13T15:51:39.648014+0000","last_fullsized":"2024-09-13T15:51:39.648014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:39.647966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:39.647966+0000","last_clean_scrub_stamp":"2024-09-13T15:51:39.647966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:57.782751+0000","scrub_duration":0.0028655859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:39.860860+0000","last_change":"2024-09-13T15:51:39.860860+0000","last_active":"2024-09-13T15:51:39.860860+0000","last_peered":"2024-09-13T15:51:39.860860+0000","last_clean":"2024-09-13T15:51:39.860860+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:51:39.860860+0000","last_undegraded":"2024-09-13T15:51:39.860860+0000","last_fullsized":"2024-09-13T15:51:39.860860+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:39.860518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:39.860518+0000","last_clean_scrub_stamp":"2024-09-13T15:51:39.860518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:23.434457+0000","scrub_duration":0.0030233840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.b","version":"15'2","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747277+0000","last_change":"2024-09-13T15:34:34.943033+0000","last_active":"2024-09-13T15:51:03.747277+0000","last_peered":"2024-09-13T15:51:03.747277+0000","last_clean":"2024-09-13T15:51:03.747277+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:51:03.747277+0000","last_undegraded":"2024-09-13T15:51:03.747277+0000","last_fullsized":"2024-09-13T15:51:03.747277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:41.947110+0000","last_change":"2024-09-13T15:51:41.947387+0000","last_active":"2024-09-13T15:51:41.947110+0000","last_peered":"2024-09-13T15:51:41.947110+0000","last_clean":"2024-09-13T15:51:41.947110+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:51:41.947110+0000","last_undegraded":"2024-09-13T15:51:41.947110+0000","last_fullsized":"2024-09-13T15:51:41.947110+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:41.947053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:41.947053+0000","last_clean_scrub_stamp":"2024-09-13T15:51:41.947053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:08.395633+0000","scrub_duration":0.0028106099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734388+0000","last_change":"2024-09-13T15:34:34.943732+0000","last_active":"2024-09-13T15:51:06.734388+0000","last_peered":"2024-09-13T15:51:06.734388+0000","last_clean":"2024-09-13T15:51:06.734388+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:51:06.734388+0000","last_undegraded":"2024-09-13T15:51:06.734388+0000","last_fullsized":"2024-09-13T15:51:06.734388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.604941+0000","last_change":"2024-09-13T15:51:42.604941+0000","last_active":"2024-09-13T15:51:42.604941+0000","last_peered":"2024-09-13T15:51:42.604941+0000","last_clean":"2024-09-13T15:51:42.604941+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:51:42.604941+0000","last_undegraded":"2024-09-13T15:51:42.604941+0000","last_fullsized":"2024-09-13T15:51:42.604941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:42.604669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:42.604669+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.604669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:36.719016+0000","scrub_duration":0.0029141129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:06.735540+0000","last_change":"2024-09-13T15:52:06.735763+0000","last_active":"2024-09-13T15:52:06.735540+0000","last_peered":"2024-09-13T15:52:06.735540+0000","last_clean":"2024-09-13T15:52:06.735540+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:52:06.735540+0000","last_undegraded":"2024-09-13T15:52:06.735540+0000","last_fullsized":"2024-09-13T15:52:06.735540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:06.735489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:06.735489+0000","last_clean_scrub_stamp":"2024-09-13T15:52:06.735489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:06.778123+0000","scrub_duration":0.0029280899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:37.836156+0000","last_change":"2024-09-13T15:51:37.836156+0000","last_active":"2024-09-13T15:51:37.836156+0000","last_peered":"2024-09-13T15:51:37.836156+0000","last_clean":"2024-09-13T15:51:37.836156+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:51:37.836156+0000","last_undegraded":"2024-09-13T15:51:37.836156+0000","last_fullsized":"2024-09-13T15:51:37.836156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:37.835829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:37.835829+0000","last_clean_scrub_stamp":"2024-09-13T15:51:37.835829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.328337+0000","scrub_duration":0.0028480789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279119+0000","last_change":"2024-09-13T15:34:34.941308+0000","last_active":"2024-09-13T15:51:06.279119+0000","last_peered":"2024-09-13T15:51:06.279119+0000","last_clean":"2024-09-13T15:51:06.279119+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:51:06.279119+0000","last_undegraded":"2024-09-13T15:51:06.279119+0000","last_fullsized":"2024-09-13T15:51:06.279119+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:49.022056+0000","last_change":"2024-09-13T15:51:49.022056+0000","last_active":"2024-09-13T15:51:49.022056+0000","last_peered":"2024-09-13T15:51:49.022056+0000","last_clean":"2024-09-13T15:51:49.022056+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:51:49.022056+0000","last_undegraded":"2024-09-13T15:51:49.022056+0000","last_fullsized":"2024-09-13T15:51:49.022056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:49.021803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:49.021803+0000","last_clean_scrub_stamp":"2024-09-13T15:51:49.021803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:25.975161+0000","scrub_duration":0.0028090350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"15'2","reported_seq":64,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734400+0000","last_change":"2024-09-13T15:34:34.946540+0000","last_active":"2024-09-13T15:51:06.734400+0000","last_peered":"2024-09-13T15:51:06.734400+0000","last_clean":"2024-09-13T15:51:06.734400+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:51:06.734400+0000","last_undegraded":"2024-09-13T15:51:06.734400+0000","last_fullsized":"2024-09-13T15:51:06.734400+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:11.573279+0000","last_change":"2024-09-13T15:51:11.573279+0000","last_active":"2024-09-13T15:51:11.573279+0000","last_peered":"2024-09-13T15:51:11.573279+0000","last_clean":"2024-09-13T15:51:11.573279+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:51:11.573279+0000","last_undegraded":"2024-09-13T15:51:11.573279+0000","last_fullsized":"2024-09-13T15:51:11.573279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:11.572987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:11.572987+0000","last_clean_scrub_stamp":"2024-09-13T15:51:11.572987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:21.045297+0000","scrub_duration":0.0030285730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"16'1","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734306+0000","last_change":"2024-09-13T15:34:34.942452+0000","last_active":"2024-09-13T15:51:06.734306+0000","last_peered":"2024-09-13T15:51:06.734306+0000","last_clean":"2024-09-13T15:51:06.734306+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:51:06.734306+0000","last_undegraded":"2024-09-13T15:51:06.734306+0000","last_fullsized":"2024-09-13T15:51:06.734306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:10.000654+0000","last_change":"2024-09-13T15:51:10.000654+0000","last_active":"2024-09-13T15:51:10.000654+0000","last_peered":"2024-09-13T15:51:10.000654+0000","last_clean":"2024-09-13T15:51:10.000654+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:51:10.000654+0000","last_undegraded":"2024-09-13T15:51:10.000654+0000","last_fullsized":"2024-09-13T15:51:10.000654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:10.000340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:10.000340+0000","last_clean_scrub_stamp":"2024-09-13T15:51:10.000340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.854008+0000","scrub_duration":0.0030965559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734506+0000","last_change":"2024-09-13T15:34:34.949805+0000","last_active":"2024-09-13T15:51:06.734506+0000","last_peered":"2024-09-13T15:51:06.734506+0000","last_clean":"2024-09-13T15:51:06.734506+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:51:06.734506+0000","last_undegraded":"2024-09-13T15:51:06.734506+0000","last_fullsized":"2024-09-13T15:51:06.734506+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:08.634807+0000","last_change":"2024-09-13T15:51:08.634807+0000","last_active":"2024-09-13T15:51:08.634807+0000","last_peered":"2024-09-13T15:51:08.634807+0000","last_clean":"2024-09-13T15:51:08.634807+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:51:08.634807+0000","last_undegraded":"2024-09-13T15:51:08.634807+0000","last_fullsized":"2024-09-13T15:51:08.634807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:08.634488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:08.634488+0000","last_clean_scrub_stamp":"2024-09-13T15:51:08.634488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:29.659635+0000","scrub_duration":0.0033577189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734286+0000","last_change":"2024-09-13T15:34:34.946174+0000","last_active":"2024-09-13T15:51:06.734286+0000","last_peered":"2024-09-13T15:51:06.734286+0000","last_clean":"2024-09-13T15:51:06.734286+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:51:06.734286+0000","last_undegraded":"2024-09-13T15:51:06.734286+0000","last_fullsized":"2024-09-13T15:51:06.734286+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:43.932444+0000","last_change":"2024-09-13T15:51:43.932667+0000","last_active":"2024-09-13T15:51:43.932444+0000","last_peered":"2024-09-13T15:51:43.932444+0000","last_clean":"2024-09-13T15:51:43.932444+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:51:43.932444+0000","last_undegraded":"2024-09-13T15:51:43.932444+0000","last_fullsized":"2024-09-13T15:51:43.932444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:43.932395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:43.932395+0000","last_clean_scrub_stamp":"2024-09-13T15:51:43.932395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:50.418406+0000","scrub_duration":0.0030891629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279121+0000","last_change":"2024-09-13T15:34:34.953984+0000","last_active":"2024-09-13T15:51:06.279121+0000","last_peered":"2024-09-13T15:51:06.279121+0000","last_clean":"2024-09-13T15:51:06.279121+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:51:06.279121+0000","last_undegraded":"2024-09-13T15:51:06.279121+0000","last_fullsized":"2024-09-13T15:51:06.279121+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:34.984870+0000","last_change":"2024-09-13T15:51:34.985088+0000","last_active":"2024-09-13T15:51:34.984870+0000","last_peered":"2024-09-13T15:51:34.984870+0000","last_clean":"2024-09-13T15:51:34.984870+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:51:34.984870+0000","last_undegraded":"2024-09-13T15:51:34.984870+0000","last_fullsized":"2024-09-13T15:51:34.984870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:34.984821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:34.984821+0000","last_clean_scrub_stamp":"2024-09-13T15:51:34.984821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:43.477329+0000","scrub_duration":0.0030114199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:59.489759+0000","last_change":"2024-09-13T15:51:59.489969+0000","last_active":"2024-09-13T15:51:59.489759+0000","last_peered":"2024-09-13T15:51:59.489759+0000","last_clean":"2024-09-13T15:51:59.489759+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:51:59.489759+0000","last_undegraded":"2024-09-13T15:51:59.489759+0000","last_fullsized":"2024-09-13T15:51:59.489759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:59.489693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:59.489693+0000","last_clean_scrub_stamp":"2024-09-13T15:51:59.489693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:42.511558+0000","scrub_duration":0.0029566660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:56.928710+0000","last_change":"2024-09-13T15:51:56.928926+0000","last_active":"2024-09-13T15:51:56.928710+0000","last_peered":"2024-09-13T15:51:56.928710+0000","last_clean":"2024-09-13T15:51:56.928710+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:51:56.928710+0000","last_undegraded":"2024-09-13T15:51:56.928710+0000","last_fullsized":"2024-09-13T15:51:56.928710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:56.928661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:56.928661+0000","last_clean_scrub_stamp":"2024-09-13T15:51:56.928661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:27.237108+0000","scrub_duration":0.0029743360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:48.563736+0000","last_change":"2024-09-13T15:51:48.563977+0000","last_active":"2024-09-13T15:51:48.563736+0000","last_peered":"2024-09-13T15:51:48.563736+0000","last_clean":"2024-09-13T15:51:48.563736+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:51:48.563736+0000","last_undegraded":"2024-09-13T15:51:48.563736+0000","last_fullsized":"2024-09-13T15:51:48.563736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:48.563689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:48.563689+0000","last_clean_scrub_stamp":"2024-09-13T15:51:48.563689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:57.056198+0000","scrub_duration":0.0028270109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:28.063597+0000","last_change":"2024-09-13T15:51:28.063807+0000","last_active":"2024-09-13T15:51:28.063597+0000","last_peered":"2024-09-13T15:51:28.063597+0000","last_clean":"2024-09-13T15:51:28.063597+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:51:28.063597+0000","last_undegraded":"2024-09-13T15:51:28.063597+0000","last_fullsized":"2024-09-13T15:51:28.063597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:28.063549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:28.063549+0000","last_clean_scrub_stamp":"2024-09-13T15:51:28.063549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:22.177895+0000","scrub_duration":0.0027253830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734325+0000","last_change":"2024-09-13T15:34:34.939804+0000","last_active":"2024-09-13T15:51:06.734325+0000","last_peered":"2024-09-13T15:51:06.734325+0000","last_clean":"2024-09-13T15:51:06.734325+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:51:06.734325+0000","last_undegraded":"2024-09-13T15:51:06.734325+0000","last_fullsized":"2024-09-13T15:51:06.734325+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"58'110","reported_seq":244,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:01.775924+0000","last_change":"2024-09-13T15:52:01.776195+0000","last_active":"2024-09-13T15:52:01.775924+0000","last_peered":"2024-09-13T15:52:01.775924+0000","last_clean":"2024-09-13T15:52:01.775924+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:52:01.775924+0000","last_undegraded":"2024-09-13T15:52:01.775924+0000","last_fullsized":"2024-09-13T15:52:01.775924+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'110","last_scrub_stamp":"2024-09-13T15:52:01.775864+0000","last_deep_scrub":"58'110","last_deep_scrub_stamp":"2024-09-13T15:52:01.775864+0000","last_clean_scrub_stamp":"2024-09-13T15:52:01.775864+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:06.410483+0000","scrub_duration":0.0095732660000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":70,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:09.022828+0000","last_change":"2024-09-13T15:51:09.023040+0000","last_active":"2024-09-13T15:51:09.022828+0000","last_peered":"2024-09-13T15:51:09.022828+0000","last_clean":"2024-09-13T15:51:09.022828+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:51:09.022828+0000","last_undegraded":"2024-09-13T15:51:09.022828+0000","last_fullsized":"2024-09-13T15:51:09.022828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:09.022780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:09.022780+0000","last_clean_scrub_stamp":"2024-09-13T15:51:09.022780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:57.652179+0000","scrub_duration":0.0027795350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:53.492621+0000","last_change":"2024-09-13T15:51:53.492836+0000","last_active":"2024-09-13T15:51:53.492621+0000","last_peered":"2024-09-13T15:51:53.492621+0000","last_clean":"2024-09-13T15:51:53.492621+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:51:53.492621+0000","last_undegraded":"2024-09-13T15:51:53.492621+0000","last_fullsized":"2024-09-13T15:51:53.492621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:53.492570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:53.492570+0000","last_clean_scrub_stamp":"2024-09-13T15:51:53.492570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:19.941150+0000","scrub_duration":0.0029359529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:36.814688+0000","last_change":"2024-09-13T15:51:36.814917+0000","last_active":"2024-09-13T15:51:36.814688+0000","last_peered":"2024-09-13T15:51:36.814688+0000","last_clean":"2024-09-13T15:51:36.814688+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:51:36.814688+0000","last_undegraded":"2024-09-13T15:51:36.814688+0000","last_fullsized":"2024-09-13T15:51:36.814688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:36.814631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:36.814631+0000","last_clean_scrub_stamp":"2024-09-13T15:51:36.814631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:30.056367+0000","scrub_duration":0.0030192740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"58'2","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:59.782356+0000","last_change":"2024-09-13T15:51:59.782573+0000","last_active":"2024-09-13T15:51:59.782356+0000","last_peered":"2024-09-13T15:51:59.782356+0000","last_clean":"2024-09-13T15:51:59.782356+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:51:59.782356+0000","last_undegraded":"2024-09-13T15:51:59.782356+0000","last_fullsized":"2024-09-13T15:51:59.782356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-13T15:51:59.782304+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-13T15:51:59.782304+0000","last_clean_scrub_stamp":"2024-09-13T15:51:59.782304+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:01.886087+0000","scrub_duration":0.0062355980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:48.041344+0000","last_change":"2024-09-13T15:51:48.041512+0000","last_active":"2024-09-13T15:51:48.041344+0000","last_peered":"2024-09-13T15:51:48.041344+0000","last_clean":"2024-09-13T15:51:48.041344+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:51:48.041344+0000","last_undegraded":"2024-09-13T15:51:48.041344+0000","last_fullsized":"2024-09-13T15:51:48.041344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:48.041303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:48.041303+0000","last_clean_scrub_stamp":"2024-09-13T15:51:48.041303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:50.423013+0000","scrub_duration":0.001557817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"15'2","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.107213+0000","last_change":"2024-09-13T15:34:34.956480+0000","last_active":"2024-09-13T15:51:03.107213+0000","last_peered":"2024-09-13T15:51:03.107213+0000","last_clean":"2024-09-13T15:51:03.107213+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:51:03.107213+0000","last_undegraded":"2024-09-13T15:51:03.107213+0000","last_fullsized":"2024-09-13T15:51:03.107213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:20.704723+0000","last_change":"2024-09-13T15:51:20.704937+0000","last_active":"2024-09-13T15:51:20.704723+0000","last_peered":"2024-09-13T15:51:20.704723+0000","last_clean":"2024-09-13T15:51:20.704723+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:51:20.704723+0000","last_undegraded":"2024-09-13T15:51:20.704723+0000","last_fullsized":"2024-09-13T15:51:20.704723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:20.704675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:20.704675+0000","last_clean_scrub_stamp":"2024-09-13T15:51:20.704675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:41.029516+0000","scrub_duration":0.0028536220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"15'1","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.748213+0000","last_change":"2024-09-13T15:34:34.959935+0000","last_active":"2024-09-13T15:51:03.748213+0000","last_peered":"2024-09-13T15:51:03.748213+0000","last_clean":"2024-09-13T15:51:03.748213+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:51:03.748213+0000","last_undegraded":"2024-09-13T15:51:03.748213+0000","last_fullsized":"2024-09-13T15:51:03.748213+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:23.631969+0000","last_change":"2024-09-13T15:51:23.632249+0000","last_active":"2024-09-13T15:51:23.631969+0000","last_peered":"2024-09-13T15:51:23.631969+0000","last_clean":"2024-09-13T15:51:23.631969+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:51:23.631969+0000","last_undegraded":"2024-09-13T15:51:23.631969+0000","last_fullsized":"2024-09-13T15:51:23.631969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:23.631921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:23.631921+0000","last_clean_scrub_stamp":"2024-09-13T15:51:23.631921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:28.485589+0000","scrub_duration":0.0028528719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"58'12","reported_seq":84,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:54.450870+0000","last_change":"2024-09-13T15:51:54.451094+0000","last_active":"2024-09-13T15:51:54.450870+0000","last_peered":"2024-09-13T15:51:54.450870+0000","last_clean":"2024-09-13T15:51:54.450870+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:51:54.450870+0000","last_undegraded":"2024-09-13T15:51:54.450870+0000","last_fullsized":"2024-09-13T15:51:54.450870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'12","last_scrub_stamp":"2024-09-13T15:51:54.450813+0000","last_deep_scrub":"58'12","last_deep_scrub_stamp":"2024-09-13T15:51:54.450813+0000","last_clean_scrub_stamp":"2024-09-13T15:51:54.450813+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:00.936823+0000","scrub_duration":0.009138218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:26.093049+0000","last_change":"2024-09-13T15:51:26.093274+0000","last_active":"2024-09-13T15:51:26.093049+0000","last_peered":"2024-09-13T15:51:26.093049+0000","last_clean":"2024-09-13T15:51:26.093049+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:51:26.093049+0000","last_undegraded":"2024-09-13T15:51:26.093049+0000","last_fullsized":"2024-09-13T15:51:26.093049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:26.092993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:26.092993+0000","last_clean_scrub_stamp":"2024-09-13T15:51:26.092993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:44.227778+0000","scrub_duration":0.0029912200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.745615+0000","last_change":"2024-09-13T15:34:34.954181+0000","last_active":"2024-09-13T15:51:03.745615+0000","last_peered":"2024-09-13T15:51:03.745615+0000","last_clean":"2024-09-13T15:51:03.745615+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:51:03.745615+0000","last_undegraded":"2024-09-13T15:51:03.745615+0000","last_fullsized":"2024-09-13T15:51:03.745615+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.269085+0000","last_change":"2024-09-13T15:34:35.342732+0000","last_active":"2024-09-13T15:51:03.269085+0000","last_peered":"2024-09-13T15:51:03.269085+0000","last_clean":"2024-09-13T15:51:03.269085+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:51:03.269085+0000","last_undegraded":"2024-09-13T15:51:03.269085+0000","last_fullsized":"2024-09-13T15:51:03.269085+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:50.568853+0000","last_change":"2024-09-13T15:51:50.569089+0000","last_active":"2024-09-13T15:51:50.568853+0000","last_peered":"2024-09-13T15:51:50.568853+0000","last_clean":"2024-09-13T15:51:50.568853+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:51:50.568853+0000","last_undegraded":"2024-09-13T15:51:50.568853+0000","last_fullsized":"2024-09-13T15:51:50.568853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:50.568804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:50.568804+0000","last_clean_scrub_stamp":"2024-09-13T15:51:50.568804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:34.142743+0000","scrub_duration":0.0031469549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:33.819531+0000","last_change":"2024-09-13T15:51:33.819817+0000","last_active":"2024-09-13T15:51:33.819531+0000","last_peered":"2024-09-13T15:51:33.819531+0000","last_clean":"2024-09-13T15:51:33.819531+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:51:33.819531+0000","last_undegraded":"2024-09-13T15:51:33.819531+0000","last_fullsized":"2024-09-13T15:51:33.819531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:33.819477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:33.819477+0000","last_clean_scrub_stamp":"2024-09-13T15:51:33.819477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:21.665891+0000","scrub_duration":0.0030701579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"15'2","reported_seq":63,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747472+0000","last_change":"2024-09-13T15:34:34.942058+0000","last_active":"2024-09-13T15:51:03.747472+0000","last_peered":"2024-09-13T15:51:03.747472+0000","last_clean":"2024-09-13T15:51:03.747472+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:51:03.747472+0000","last_undegraded":"2024-09-13T15:51:03.747472+0000","last_fullsized":"2024-09-13T15:51:03.747472+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.920706+0000","last_change":"2024-09-13T15:51:42.920918+0000","last_active":"2024-09-13T15:51:42.920706+0000","last_peered":"2024-09-13T15:51:42.920706+0000","last_clean":"2024-09-13T15:51:42.920706+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:51:42.920706+0000","last_undegraded":"2024-09-13T15:51:42.920706+0000","last_fullsized":"2024-09-13T15:51:42.920706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:42.920654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:42.920654+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.920654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:09.369234+0000","scrub_duration":0.0027763269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'12","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.114976+0000","last_change":"2024-09-13T15:34:34.955883+0000","last_active":"2024-09-13T15:51:03.114976+0000","last_peered":"2024-09-13T15:51:03.114976+0000","last_clean":"2024-09-13T15:51:03.114976+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:51:03.114976+0000","last_undegraded":"2024-09-13T15:51:03.114976+0000","last_fullsized":"2024-09-13T15:51:03.114976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2638,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.015505+0000","last_change":"2024-09-13T15:51:07.015632+0000","last_active":"2024-09-13T15:51:07.015505+0000","last_peered":"2024-09-13T15:51:07.015505+0000","last_clean":"2024-09-13T15:51:07.015505+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:51:07.015505+0000","last_undegraded":"2024-09-13T15:51:07.015505+0000","last_fullsized":"2024-09-13T15:51:07.015505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:07.015482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:07.015482+0000","last_clean_scrub_stamp":"2024-09-13T15:51:07.015482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:27.340322+0000","scrub_duration":0.001887321,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"58'5","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.931081+0000","last_change":"2024-09-13T15:51:42.931297+0000","last_active":"2024-09-13T15:51:42.931081+0000","last_peered":"2024-09-13T15:51:42.931081+0000","last_clean":"2024-09-13T15:51:42.931081+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:51:42.931081+0000","last_undegraded":"2024-09-13T15:51:42.931081+0000","last_fullsized":"2024-09-13T15:51:42.931081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'5","last_scrub_stamp":"2024-09-13T15:51:42.931027+0000","last_deep_scrub":"58'5","last_deep_scrub_stamp":"2024-09-13T15:51:42.931027+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.931027+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:04.378223+0000","scrub_duration":0.0069458810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:51.933694+0000","last_change":"2024-09-13T15:51:51.933959+0000","last_active":"2024-09-13T15:51:51.933694+0000","last_peered":"2024-09-13T15:51:51.933694+0000","last_clean":"2024-09-13T15:51:51.933694+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:51:51.933694+0000","last_undegraded":"2024-09-13T15:51:51.933694+0000","last_fullsized":"2024-09-13T15:51:51.933694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:51.933640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:51.933640+0000","last_clean_scrub_stamp":"2024-09-13T15:51:51.933640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:23.904863+0000","scrub_duration":0.0029495559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279254+0000","last_change":"2024-09-13T15:34:34.953625+0000","last_active":"2024-09-13T15:51:06.279254+0000","last_peered":"2024-09-13T15:51:06.279254+0000","last_clean":"2024-09-13T15:51:06.279254+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:51:06.279254+0000","last_undegraded":"2024-09-13T15:51:06.279254+0000","last_fullsized":"2024-09-13T15:51:06.279254+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:19.658733+0000","last_change":"2024-09-13T15:51:19.658733+0000","last_active":"2024-09-13T15:51:19.658733+0000","last_peered":"2024-09-13T15:51:19.658733+0000","last_clean":"2024-09-13T15:51:19.658733+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:51:19.658733+0000","last_undegraded":"2024-09-13T15:51:19.658733+0000","last_fullsized":"2024-09-13T15:51:19.658733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:19.658442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:19.658442+0000","last_clean_scrub_stamp":"2024-09-13T15:51:19.658442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:52.886746+0000","scrub_duration":0.0031503270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:56.835944+0000","last_change":"2024-09-13T15:51:56.836271+0000","last_active":"2024-09-13T15:51:56.835944+0000","last_peered":"2024-09-13T15:51:56.835944+0000","last_clean":"2024-09-13T15:51:56.835944+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:51:56.835944+0000","last_undegraded":"2024-09-13T15:51:56.835944+0000","last_fullsized":"2024-09-13T15:51:56.835944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:56.835893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:56.835893+0000","last_clean_scrub_stamp":"2024-09-13T15:51:56.835893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:19.080500+0000","scrub_duration":0.0030846369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:54.842266+0000","last_change":"2024-09-13T15:51:54.842471+0000","last_active":"2024-09-13T15:51:54.842266+0000","last_peered":"2024-09-13T15:51:54.842266+0000","last_clean":"2024-09-13T15:51:54.842266+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:51:54.842266+0000","last_undegraded":"2024-09-13T15:51:54.842266+0000","last_fullsized":"2024-09-13T15:51:54.842266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:54.842213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:54.842213+0000","last_clean_scrub_stamp":"2024-09-13T15:51:54.842213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:25.150660+0000","scrub_duration":0.003082988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279289+0000","last_change":"2024-09-13T15:34:34.950709+0000","last_active":"2024-09-13T15:51:06.279289+0000","last_peered":"2024-09-13T15:51:06.279289+0000","last_clean":"2024-09-13T15:51:06.279289+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:51:06.279289+0000","last_undegraded":"2024-09-13T15:51:06.279289+0000","last_fullsized":"2024-09-13T15:51:06.279289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:44.659569+0000","last_change":"2024-09-13T15:51:44.659803+0000","last_active":"2024-09-13T15:51:44.659569+0000","last_peered":"2024-09-13T15:51:44.659569+0000","last_clean":"2024-09-13T15:51:44.659569+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:51:44.659569+0000","last_undegraded":"2024-09-13T15:51:44.659569+0000","last_fullsized":"2024-09-13T15:51:44.659569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:44.659519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:44.659519+0000","last_clean_scrub_stamp":"2024-09-13T15:51:44.659519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:32.505933+0000","scrub_duration":0.0028280330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:03.993268+0000","last_change":"2024-09-13T15:52:03.993484+0000","last_active":"2024-09-13T15:52:03.993268+0000","last_peered":"2024-09-13T15:52:03.993268+0000","last_clean":"2024-09-13T15:52:03.993268+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:52:03.993268+0000","last_undegraded":"2024-09-13T15:52:03.993268+0000","last_fullsized":"2024-09-13T15:52:03.993268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:03.993217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:03.993217+0000","last_clean_scrub_stamp":"2024-09-13T15:52:03.993217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:08.627836+0000","scrub_duration":0.0029228980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.192116+0000","last_change":"2024-09-13T15:34:34.957379+0000","last_active":"2024-09-13T15:51:07.192116+0000","last_peered":"2024-09-13T15:51:07.192116+0000","last_clean":"2024-09-13T15:51:07.192116+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:51:07.192116+0000","last_undegraded":"2024-09-13T15:51:07.192116+0000","last_fullsized":"2024-09-13T15:51:07.192116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:58.866284+0000","last_change":"2024-09-13T15:51:58.866284+0000","last_active":"2024-09-13T15:51:58.866284+0000","last_peered":"2024-09-13T15:51:58.866284+0000","last_clean":"2024-09-13T15:51:58.866284+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:51:58.866284+0000","last_undegraded":"2024-09-13T15:51:58.866284+0000","last_fullsized":"2024-09-13T15:51:58.866284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:58.866014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:58.866014+0000","last_clean_scrub_stamp":"2024-09-13T15:51:58.866014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:21.110620+0000","scrub_duration":0.002811142,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:49.917138+0000","last_change":"2024-09-13T15:51:49.917138+0000","last_active":"2024-09-13T15:51:49.917138+0000","last_peered":"2024-09-13T15:51:49.917138+0000","last_clean":"2024-09-13T15:51:49.917138+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:51:49.917138+0000","last_undegraded":"2024-09-13T15:51:49.917138+0000","last_fullsized":"2024-09-13T15:51:49.917138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-13T15:51:49.916844+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-09-13T15:51:49.916844+0000","last_clean_scrub_stamp":"2024-09-13T15:51:49.916844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:21.888067+0000","scrub_duration":0.0029938650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:30.052443+0000","last_change":"2024-09-13T15:51:30.052443+0000","last_active":"2024-09-13T15:51:30.052443+0000","last_peered":"2024-09-13T15:51:30.052443+0000","last_clean":"2024-09-13T15:51:30.052443+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:51:30.052443+0000","last_undegraded":"2024-09-13T15:51:30.052443+0000","last_fullsized":"2024-09-13T15:51:30.052443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:30.052149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:30.052149+0000","last_clean_scrub_stamp":"2024-09-13T15:51:30.052149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:17.898563+0000","scrub_duration":0.002920181,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.192602+0000","last_change":"2024-09-13T15:34:35.331904+0000","last_active":"2024-09-13T15:51:07.192602+0000","last_peered":"2024-09-13T15:51:07.192602+0000","last_clean":"2024-09-13T15:51:07.192602+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:51:07.192602+0000","last_undegraded":"2024-09-13T15:51:07.192602+0000","last_fullsized":"2024-09-13T15:51:07.192602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:15.611315+0000","last_change":"2024-09-13T15:51:15.611315+0000","last_active":"2024-09-13T15:51:15.611315+0000","last_peered":"2024-09-13T15:51:15.611315+0000","last_clean":"2024-09-13T15:51:15.611315+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:51:15.611315+0000","last_undegraded":"2024-09-13T15:51:15.611315+0000","last_fullsized":"2024-09-13T15:51:15.611315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:15.611033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:15.611033+0000","last_clean_scrub_stamp":"2024-09-13T15:51:15.611033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:31.771056+0000","scrub_duration":0.0029690459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:01.966177+0000","last_change":"2024-09-13T15:52:01.966436+0000","last_active":"2024-09-13T15:52:01.966177+0000","last_peered":"2024-09-13T15:52:01.966177+0000","last_clean":"2024-09-13T15:52:01.966177+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:52:01.966177+0000","last_undegraded":"2024-09-13T15:52:01.966177+0000","last_fullsized":"2024-09-13T15:52:01.966177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:01.966110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:01.966110+0000","last_clean_scrub_stamp":"2024-09-13T15:52:01.966110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:04.069892+0000","scrub_duration":0.0027739829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:10.591481+0000","last_change":"2024-09-13T15:51:10.591481+0000","last_active":"2024-09-13T15:51:10.591481+0000","last_peered":"2024-09-13T15:51:10.591481+0000","last_clean":"2024-09-13T15:51:10.591481+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:51:10.591481+0000","last_undegraded":"2024-09-13T15:51:10.591481+0000","last_fullsized":"2024-09-13T15:51:10.591481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:10.591224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:10.591224+0000","last_clean_scrub_stamp":"2024-09-13T15:51:10.591224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:30.916064+0000","scrub_duration":0.0029806559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":50,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.267016+0000","last_change":"2024-09-13T15:35:20.157986+0000","last_active":"2024-09-13T15:51:03.267016+0000","last_peered":"2024-09-13T15:51:03.267016+0000","last_clean":"2024-09-13T15:51:03.267016+0000","last_became_active":"2024-09-13T15:35:20.157317+0000","last_became_peered":"2024-09-13T15:35:20.157317+0000","last_unstale":"2024-09-13T15:51:03.267016+0000","last_undegraded":"2024-09-13T15:51:03.267016+0000","last_fullsized":"2024-09-13T15:51:03.267016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:44.901282+0000","last_change":"2024-09-13T15:51:44.901282+0000","last_active":"2024-09-13T15:51:44.901282+0000","last_peered":"2024-09-13T15:51:44.901282+0000","last_clean":"2024-09-13T15:51:44.901282+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:51:44.901282+0000","last_undegraded":"2024-09-13T15:51:44.901282+0000","last_fullsized":"2024-09-13T15:51:44.901282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:44.901011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:44.901011+0000","last_clean_scrub_stamp":"2024-09-13T15:51:44.901011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:47.282721+0000","scrub_duration":0.002805597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.192500+0000","last_change":"2024-09-13T15:34:35.335209+0000","last_active":"2024-09-13T15:51:07.192500+0000","last_peered":"2024-09-13T15:51:07.192500+0000","last_clean":"2024-09-13T15:51:07.192500+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:51:07.192500+0000","last_undegraded":"2024-09-13T15:51:07.192500+0000","last_fullsized":"2024-09-13T15:51:07.192500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:14.575770+0000","last_change":"2024-09-13T15:51:14.575770+0000","last_active":"2024-09-13T15:51:14.575770+0000","last_peered":"2024-09-13T15:51:14.575770+0000","last_clean":"2024-09-13T15:51:14.575770+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:51:14.575770+0000","last_undegraded":"2024-09-13T15:51:14.575770+0000","last_fullsized":"2024-09-13T15:51:14.575770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:14.575511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:14.575511+0000","last_clean_scrub_stamp":"2024-09-13T15:51:14.575511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:22.946343+0000","scrub_duration":0.0031682049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:31.763566+0000","last_change":"2024-09-13T15:51:31.763566+0000","last_active":"2024-09-13T15:51:31.763566+0000","last_peered":"2024-09-13T15:51:31.763566+0000","last_clean":"2024-09-13T15:51:31.763566+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:51:31.763566+0000","last_undegraded":"2024-09-13T15:51:31.763566+0000","last_fullsized":"2024-09-13T15:51:31.763566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:31.763240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:31.763240+0000","last_clean_scrub_stamp":"2024-09-13T15:51:31.763240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:25.877586+0000","scrub_duration":0.0031492009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746175+0000","last_change":"2024-09-13T15:34:35.324523+0000","last_active":"2024-09-13T15:51:03.746175+0000","last_peered":"2024-09-13T15:51:03.746175+0000","last_clean":"2024-09-13T15:51:03.746175+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:51:03.746175+0000","last_undegraded":"2024-09-13T15:51:03.746175+0000","last_fullsized":"2024-09-13T15:51:03.746175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.266717+0000","last_change":"2024-09-13T15:34:35.329712+0000","last_active":"2024-09-13T15:51:03.266717+0000","last_peered":"2024-09-13T15:51:03.266717+0000","last_clean":"2024-09-13T15:51:03.266717+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:51:03.266717+0000","last_undegraded":"2024-09-13T15:51:03.266717+0000","last_fullsized":"2024-09-13T15:51:03.266717+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":50,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734854+0000","last_change":"2024-09-13T15:35:20.156675+0000","last_active":"2024-09-13T15:51:06.734854+0000","last_peered":"2024-09-13T15:51:06.734854+0000","last_clean":"2024-09-13T15:51:06.734854+0000","last_became_active":"2024-09-13T15:35:20.152889+0000","last_became_peered":"2024-09-13T15:35:20.152889+0000","last_unstale":"2024-09-13T15:51:06.734854+0000","last_undegraded":"2024-09-13T15:51:06.734854+0000","last_fullsized":"2024-09-13T15:51:06.734854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746153+0000","last_change":"2024-09-13T15:34:35.346893+0000","last_active":"2024-09-13T15:51:03.746153+0000","last_peered":"2024-09-13T15:51:03.746153+0000","last_clean":"2024-09-13T15:51:03.746153+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:51:03.746153+0000","last_undegraded":"2024-09-13T15:51:03.746153+0000","last_fullsized":"2024-09-13T15:51:03.746153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:14.607793+0000","last_change":"2024-09-13T15:51:14.608116+0000","last_active":"2024-09-13T15:51:14.607793+0000","last_peered":"2024-09-13T15:51:14.607793+0000","last_clean":"2024-09-13T15:51:14.607793+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:51:14.607793+0000","last_undegraded":"2024-09-13T15:51:14.607793+0000","last_fullsized":"2024-09-13T15:51:14.607793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:14.607733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:14.607733+0000","last_clean_scrub_stamp":"2024-09-13T15:51:14.607733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:57.098851+0000","scrub_duration":0.0030409230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.109337+0000","last_change":"2024-09-13T15:34:35.335384+0000","last_active":"2024-09-13T15:51:03.109337+0000","last_peered":"2024-09-13T15:51:03.109337+0000","last_clean":"2024-09-13T15:51:03.109337+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:51:03.109337+0000","last_undegraded":"2024-09-13T15:51:03.109337+0000","last_fullsized":"2024-09-13T15:51:03.109337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.267819+0000","last_change":"2024-09-13T15:34:35.333522+0000","last_active":"2024-09-13T15:51:03.267819+0000","last_peered":"2024-09-13T15:51:03.267819+0000","last_clean":"2024-09-13T15:51:03.267819+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:51:03.267819+0000","last_undegraded":"2024-09-13T15:51:03.267819+0000","last_fullsized":"2024-09-13T15:51:03.267819+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.113408+0000","last_change":"2024-09-13T15:34:35.331848+0000","last_active":"2024-09-13T15:51:03.113408+0000","last_peered":"2024-09-13T15:51:03.113408+0000","last_clean":"2024-09-13T15:51:03.113408+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:51:03.113408+0000","last_undegraded":"2024-09-13T15:51:03.113408+0000","last_fullsized":"2024-09-13T15:51:03.113408+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.262421+0000","last_change":"2024-09-13T15:34:35.333765+0000","last_active":"2024-09-13T15:51:03.262421+0000","last_peered":"2024-09-13T15:51:03.262421+0000","last_clean":"2024-09-13T15:51:03.262421+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:51:03.262421+0000","last_undegraded":"2024-09-13T15:51:03.262421+0000","last_fullsized":"2024-09-13T15:51:03.262421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:12.628563+0000","last_change":"2024-09-13T15:51:12.628806+0000","last_active":"2024-09-13T15:51:12.628563+0000","last_peered":"2024-09-13T15:51:12.628563+0000","last_clean":"2024-09-13T15:51:12.628563+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:51:12.628563+0000","last_undegraded":"2024-09-13T15:51:12.628563+0000","last_fullsized":"2024-09-13T15:51:12.628563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:12.628512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:12.628512+0000","last_clean_scrub_stamp":"2024-09-13T15:51:12.628512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:01.257911+0000","scrub_duration":0.0030549050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279823+0000","last_change":"2024-09-13T15:34:35.335252+0000","last_active":"2024-09-13T15:51:06.279823+0000","last_peered":"2024-09-13T15:51:06.279823+0000","last_clean":"2024-09-13T15:51:06.279823+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:51:06.279823+0000","last_undegraded":"2024-09-13T15:51:06.279823+0000","last_fullsized":"2024-09-13T15:51:06.279823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279866+0000","last_change":"2024-09-13T15:34:35.330875+0000","last_active":"2024-09-13T15:51:06.279866+0000","last_peered":"2024-09-13T15:51:06.279866+0000","last_clean":"2024-09-13T15:51:06.279866+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:51:06.279866+0000","last_undegraded":"2024-09-13T15:51:06.279866+0000","last_fullsized":"2024-09-13T15:51:06.279866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279961+0000","last_change":"2024-09-13T15:34:35.331709+0000","last_active":"2024-09-13T15:51:06.279961+0000","last_peered":"2024-09-13T15:51:06.279961+0000","last_clean":"2024-09-13T15:51:06.279961+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:51:06.279961+0000","last_undegraded":"2024-09-13T15:51:06.279961+0000","last_fullsized":"2024-09-13T15:51:06.279961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:09.587225+0000","last_change":"2024-09-13T15:51:09.587225+0000","last_active":"2024-09-13T15:51:09.587225+0000","last_peered":"2024-09-13T15:51:09.587225+0000","last_clean":"2024-09-13T15:51:09.587225+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:51:09.587225+0000","last_undegraded":"2024-09-13T15:51:09.587225+0000","last_fullsized":"2024-09-13T15:51:09.587225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:09.586889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:09.586889+0000","last_clean_scrub_stamp":"2024-09-13T15:51:09.586889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:42.815192+0000","scrub_duration":0.0032138610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.735088+0000","last_change":"2024-09-13T15:34:35.345251+0000","last_active":"2024-09-13T15:51:06.735088+0000","last_peered":"2024-09-13T15:51:06.735088+0000","last_clean":"2024-09-13T15:51:06.735088+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:51:06.735088+0000","last_undegraded":"2024-09-13T15:51:06.735088+0000","last_fullsized":"2024-09-13T15:51:06.735088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.192716+0000","last_change":"2024-09-13T15:34:35.335400+0000","last_active":"2024-09-13T15:51:07.192716+0000","last_peered":"2024-09-13T15:51:07.192716+0000","last_clean":"2024-09-13T15:51:07.192716+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:51:07.192716+0000","last_undegraded":"2024-09-13T15:51:07.192716+0000","last_fullsized":"2024-09-13T15:51:07.192716+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:28.690653+0000","last_change":"2024-09-13T15:51:28.690653+0000","last_active":"2024-09-13T15:51:28.690653+0000","last_peered":"2024-09-13T15:51:28.690653+0000","last_clean":"2024-09-13T15:51:28.690653+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:51:28.690653+0000","last_undegraded":"2024-09-13T15:51:28.690653+0000","last_fullsized":"2024-09-13T15:51:28.690653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:28.690380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:28.690380+0000","last_clean_scrub_stamp":"2024-09-13T15:51:28.690380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:46.825165+0000","scrub_duration":0.0029361040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.192584+0000","last_change":"2024-09-13T15:34:35.329319+0000","last_active":"2024-09-13T15:51:07.192584+0000","last_peered":"2024-09-13T15:51:07.192584+0000","last_clean":"2024-09-13T15:51:07.192584+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:51:07.192584+0000","last_undegraded":"2024-09-13T15:51:07.192584+0000","last_fullsized":"2024-09-13T15:51:07.192584+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":59,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.747697+0000","last_change":"2024-09-13T15:34:35.327922+0000","last_active":"2024-09-13T15:51:03.747697+0000","last_peered":"2024-09-13T15:51:03.747697+0000","last_clean":"2024-09-13T15:51:03.747697+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:51:03.747697+0000","last_undegraded":"2024-09-13T15:51:03.747697+0000","last_fullsized":"2024-09-13T15:51:03.747697+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.115070+0000","last_change":"2024-09-13T15:34:35.330864+0000","last_active":"2024-09-13T15:51:03.115070+0000","last_peered":"2024-09-13T15:51:03.115070+0000","last_clean":"2024-09-13T15:51:03.115070+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:51:03.115070+0000","last_undegraded":"2024-09-13T15:51:03.115070+0000","last_fullsized":"2024-09-13T15:51:03.115070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.280073+0000","last_change":"2024-09-13T15:34:35.324580+0000","last_active":"2024-09-13T15:51:06.280073+0000","last_peered":"2024-09-13T15:51:06.280073+0000","last_clean":"2024-09-13T15:51:06.280073+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:51:06.280073+0000","last_undegraded":"2024-09-13T15:51:06.280073+0000","last_fullsized":"2024-09-13T15:51:06.280073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.735041+0000","last_change":"2024-09-13T15:34:35.329279+0000","last_active":"2024-09-13T15:51:06.735041+0000","last_peered":"2024-09-13T15:51:06.735041+0000","last_clean":"2024-09-13T15:51:06.735041+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:51:06.735041+0000","last_undegraded":"2024-09-13T15:51:06.735041+0000","last_fullsized":"2024-09-13T15:51:06.735041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.280137+0000","last_change":"2024-09-13T15:34:35.347293+0000","last_active":"2024-09-13T15:51:06.280137+0000","last_peered":"2024-09-13T15:51:06.280137+0000","last_clean":"2024-09-13T15:51:06.280137+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:51:06.280137+0000","last_undegraded":"2024-09-13T15:51:06.280137+0000","last_fullsized":"2024-09-13T15:51:06.280137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3436,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738584,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99880,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94271960,"statfs":{"total":96636764160,"available":96534487040,"internally_reserved":0,"allocated":688128,"data_stored":300221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:51:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.49299999999999999,"15min":0.438},"min":{"1min":0.29999999999999999,"5min":0.20499999999999999,"15min":0.152},"max":{"1min":0.77600000000000002,"5min":0.83899999999999997,"15min":3.4550000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.47199999999999998},"min":{"1min":0.29299999999999998,"5min":0.248,"15min":0.18099999999999999},"max":{"1min":0.69799999999999995,"5min":0.97499999999999998,"15min":6.1989999999999998},"last":0.58599999999999997}]},{"osd":1,"last update":"Fri Sep 13 15:51:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.46899999999999997},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.185},"max":{"1min":0.66000000000000003,"5min":1.006,"15min":1.4790000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56599999999999995,"15min":0.505},"min":{"1min":0.376,"5min":0.30299999999999999,"15min":0.17799999999999999},"max":{"1min":0.74099999999999999,"5min":1.0589999999999999,"15min":1.399},"last":0.69999999999999996}]}]},{"osd":1,"up_from":8,"seq":34359738583,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148852,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":94222988,"statfs":{"total":96636764160,"available":96484339712,"internally_reserved":0,"allocated":1290240,"data_stored":891249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:51:59 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47099999999999997,"15min":0.40899999999999997},"min":{"1min":0.32600000000000001,"5min":0.26700000000000002,"15min":0.159},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.89900000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52500000000000002,"15min":0.44400000000000001},"min":{"1min":0.29099999999999998,"5min":0.20399999999999999,"15min":0.17599999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52500000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:51:59 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53300000000000003,"15min":0.45000000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.17199999999999999},"max":{"1min":0.65100000000000002,"5min":0.748,"15min":0.82999999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.495},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.19400000000000001},"max":{"1min":0.68899999999999995,"5min":0.93000000000000005,"15min":1.2789999999999999},"last":0.56499999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738585,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":158696,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94213144,"statfs":{"total":96636764160,"available":96474259456,"internally_reserved":0,"allocated":1277952,"data_stored":888575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":161216966},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:51:59 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.495,"15min":0.41899999999999998},"min":{"1min":0.39700000000000002,"5min":0.20399999999999999,"15min":0.158},"max":{"1min":0.76000000000000001,"5min":0.80900000000000005,"15min":0.873},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51700000000000002,"15min":0.438},"min":{"1min":0.45800000000000002,"5min":0.215,"15min":0.186},"max":{"1min":0.65000000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Sep 13 15:51:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54700000000000004,"15min":0.496},"min":{"1min":0.47499999999999998,"5min":0.252,"15min":0.17899999999999999},"max":{"1min":0.66300000000000003,"5min":0.82099999999999995,"15min":9.4610000000000003},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.5},"min":{"1min":0.52400000000000002,"5min":0.245,"15min":0.20300000000000001},"max":{"1min":0.755,"5min":0.82099999999999995,"15min":0.90700000000000003},"last":0.57299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:52:08.595 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.595 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.596 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.596 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.596 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.596 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.597 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.597 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.597 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.597 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.597 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.597 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.598 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.598 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.598 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.598 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.598 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.598 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.599 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.599 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.599 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.599 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.599 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.599 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.599 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.600 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.600 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.600 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.600 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.600 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.600 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.600 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.600 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.601 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.601 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.601 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.601 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.601 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.601 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.601 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.601 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.602 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.602 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:08.602 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T15:52:28.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:52:28.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.739+0000 7fd7c29cf640 1 Processor -- start 2024-09-13T15:52:28.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.739+0000 7fd7c29cf640 1 -- start start 2024-09-13T15:52:28.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.739+0000 7fd7c29cf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7bc0b4010 0x7fd7bc0a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:28.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.739+0000 7fd7c29cf640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7bc1515b0 con 0x7fd7bc0bebb0 2024-09-13T15:52:28.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.739+0000 7fd7c29cf640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7bc14e2c0 con 0x7fd7bc0b4010 2024-09-13T15:52:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.739+0000 7fd7bbfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd7bc0bebb0 0x7fd7bc06e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60608/0 (socket says 172.21.15.40:60608) 2024-09-13T15:52:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.739+0000 7fd7bb7fe640 1 --2- 172.21.15.40:0/590741589 >> v2:172.21.15.40:3300/0 conn(0x7fd7bc0b4010 0x7fd7bc0a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.739+0000 7fd7bbfff640 1 -- 172.21.15.40:0/590741589 learned_addr learned my addr 172.21.15.40:0/590741589 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:52:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.739+0000 7fd7baffd640 1 -- 172.21.15.40:0/590741589 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454234251 0 0) 0x7fd7bc1515b0 con 0x7fd7bc0bebb0 2024-09-13T15:52:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.739+0000 7fd7baffd640 1 -- 172.21.15.40:0/590741589 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7a4003530 con 0x7fd7bc0bebb0 2024-09-13T15:52:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.739+0000 7fd7bb7fe640 1 -- 172.21.15.40:0/590741589 >> v1:172.21.15.40:6789/0 conn(0x7fd7bc0bebb0 legacy=0x7fd7bc06e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.739+0000 7fd7bb7fe640 1 -- 172.21.15.40:0/590741589 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc06f830 con 0x7fd7bc0b4010 2024-09-13T15:52:28.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7bb7fe640 1 --2- 172.21.15.40:0/590741589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7bc0b4010 0x7fd7bc0a4d70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009740 tx=0x7fd7b001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddb30484b137bec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:28.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7baffd640 1 -- 172.21.15.40:0/590741589 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7bc0b6bc0 con 0x7fd7bc0b4010 2024-09-13T15:52:28.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7baffd640 1 -- 172.21.15.40:0/590741589 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b00a7050 con 0x7fd7bc0b4010 2024-09-13T15:52:28.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7baffd640 1 -- 172.21.15.40:0/590741589 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7b00ab680 con 0x7fd7bc0b4010 2024-09-13T15:52:28.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7c29cf640 1 -- 172.21.15.40:0/590741589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7bc0b4010 msgr2=0x7fd7bc0a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:28.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7c29cf640 1 --2- 172.21.15.40:0/590741589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7bc0b4010 0x7fd7bc0a4d70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009740 tx=0x7fd7b001c420 comp rx=0 tx=0).stop 2024-09-13T15:52:28.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7c29cf640 1 -- 172.21.15.40:0/590741589 shutdown_connections 2024-09-13T15:52:28.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7c29cf640 1 --2- 172.21.15.40:0/590741589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7bc0b4010 0x7fd7bc0a4d70 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:28.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7c29cf640 1 -- 172.21.15.40:0/590741589 >> 172.21.15.40:0/590741589 conn(0x7fd7bc06a540 msgr2=0x7fd7bc0a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:52:28.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7c29cf640 1 -- 172.21.15.40:0/590741589 shutdown_connections 2024-09-13T15:52:28.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7c29cf640 1 -- 172.21.15.40:0/590741589 wait complete. 2024-09-13T15:52:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7c29cf640 1 Processor -- start 2024-09-13T15:52:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.743+0000 7fd7c29cf640 1 -- start start 2024-09-13T15:52:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7c29cf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7bc0b4010 0x7fd7bc147610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7c29cf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7bc146270 con 0x7fd7bc0b4010 2024-09-13T15:52:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7bc0b4010 0x7fd7bc147610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7bc0b4010 0x7fd7bc147610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45128/0 (socket says 172.21.15.40:45128) 2024-09-13T15:52:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7bbfff640 1 -- 172.21.15.40:0/1572320766 learned_addr learned my addr 172.21.15.40:0/1572320766 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:52:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7bbfff640 1 -- 172.21.15.40:0/1572320766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b0009420 con 0x7fd7bc0b4010 2024-09-13T15:52:28.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7bbfff640 1 --2- 172.21.15.40:0/1572320766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7bc0b4010 0x7fd7bc147610 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c450 tx=0x7fd7ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:28.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7b8ff9640 1 -- 172.21.15.40:0/1572320766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7ac005c20 con 0x7fd7bc0b4010 2024-09-13T15:52:28.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7b8ff9640 1 -- 172.21.15.40:0/1572320766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac005d80 con 0x7fd7bc0b4010 2024-09-13T15:52:28.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7b8ff9640 1 -- 172.21.15.40:0/1572320766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7ac0071a0 con 0x7fd7bc0b4010 2024-09-13T15:52:28.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7c29cf640 1 -- 172.21.15.40:0/1572320766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7bc14b580 con 0x7fd7bc0b4010 2024-09-13T15:52:28.748 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7c29cf640 1 -- 172.21.15.40:0/1572320766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7bc149bf0 con 0x7fd7bc0b4010 2024-09-13T15:52:28.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7b8ff9640 1 -- 172.21.15.40:0/1572320766 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7fd7ac007300 con 0x7fd7bc0b4010 2024-09-13T15:52:28.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7c29cf640 1 -- 172.21.15.40:0/1572320766 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7bc146620 con 0x7fd7bc0b4010 2024-09-13T15:52:28.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7b8ff9640 1 --2- 172.21.15.40:0/1572320766 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fd7a8035530 0x7fd7a80379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:28.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7b8ff9640 1 -- 172.21.15.40:0/1572320766 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7fd7ac0472c0 con 0x7fd7bc0b4010 2024-09-13T15:52:28.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7bb7fe640 1 --2- 172.21.15.40:0/1572320766 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fd7a8035530 0x7fd7a80379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:28.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.747+0000 7fd7bb7fe640 1 --2- 172.21.15.40:0/1572320766 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fd7a8035530 0x7fd7a80379f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00ad000 tx=0x7fd7b00a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:28.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.751+0000 7fd7b8ff9640 1 -- 172.21.15.40:0/1572320766 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd7ac012400 con 0x7fd7bc0b4010 2024-09-13T15:52:28.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.907+0000 7fd7c29cf640 1 -- 172.21.15.40:0/1572320766 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7bc0a4d70 con 0x7fd7a8035530 2024-09-13T15:52:28.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.927+0000 7fd7b8ff9640 1 -- 172.21.15.40:0/1572320766 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250827 (secure 0 0 0) 0x7fd7bc0a4d70 con 0x7fd7a8035530 2024-09-13T15:52:28.930 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:52:28.932 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:52:28.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.931+0000 7fd7c29cf640 1 -- 172.21.15.40:0/1572320766 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fd7a8035530 msgr2=0x7fd7a80379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:28.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.931+0000 7fd7c29cf640 1 --2- 172.21.15.40:0/1572320766 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fd7a8035530 0x7fd7a80379f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd7b00ad000 tx=0x7fd7b00a6000 comp rx=0 tx=0).stop 2024-09-13T15:52:28.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.931+0000 7fd7c29cf640 1 -- 172.21.15.40:0/1572320766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7bc0b4010 msgr2=0x7fd7bc147610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:28.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.931+0000 7fd7c29cf640 1 --2- 172.21.15.40:0/1572320766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7bc0b4010 0x7fd7bc147610 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00c450 tx=0x7fd7ac00c910 comp rx=0 tx=0).stop 2024-09-13T15:52:28.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.931+0000 7fd7c29cf640 1 -- 172.21.15.40:0/1572320766 shutdown_connections 2024-09-13T15:52:28.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.931+0000 7fd7c29cf640 1 --2- 172.21.15.40:0/1572320766 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7fd7a8035530 0x7fd7a80379f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:28.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.931+0000 7fd7c29cf640 1 --2- 172.21.15.40:0/1572320766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7bc0b4010 0x7fd7bc147610 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:28.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.931+0000 7fd7c29cf640 1 -- 172.21.15.40:0/1572320766 >> 172.21.15.40:0/1572320766 conn(0x7fd7bc06a540 msgr2=0x7fd7bc06e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:52:28.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.931+0000 7fd7c29cf640 1 -- 172.21.15.40:0/1572320766 shutdown_connections 2024-09-13T15:52:28.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:28.931+0000 7fd7c29cf640 1 -- 172.21.15.40:0/1572320766 wait complete. 2024-09-13T15:52:28.949 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2024-09-13T15:52:27.876437+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593804,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":208,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":176,"ondisk_log_size":176,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":407428,"kb_used_data":3180,"kb_used_omap":4,"kb_used_meta":404219,"kb_avail":282708092,"statfs":{"total":289910292480,"available":289493086208,"internally_reserved":0,"allocated":3256320,"data_stored":2080045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":413920594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003862"},"pg_stats":[{"pgid":"2.1f","version":"58'6","reported_seq":79,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:00.925214+0000","last_change":"2024-09-13T15:52:00.925433+0000","last_active":"2024-09-13T15:52:00.925214+0000","last_peered":"2024-09-13T15:52:00.925214+0000","last_clean":"2024-09-13T15:52:00.925214+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:52:00.925214+0000","last_undegraded":"2024-09-13T15:52:00.925214+0000","last_fullsized":"2024-09-13T15:52:00.925214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'6","last_scrub_stamp":"2024-09-13T15:52:00.925158+0000","last_deep_scrub":"58'6","last_deep_scrub_stamp":"2024-09-13T15:52:00.925158+0000","last_clean_scrub_stamp":"2024-09-13T15:52:00.925158+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:56.612520+0000","scrub_duration":0.0072895659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:22.675129+0000","last_change":"2024-09-13T15:51:22.675350+0000","last_active":"2024-09-13T15:51:22.675129+0000","last_peered":"2024-09-13T15:51:22.675129+0000","last_clean":"2024-09-13T15:51:22.675129+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:51:22.675129+0000","last_undegraded":"2024-09-13T15:51:22.675129+0000","last_fullsized":"2024-09-13T15:51:22.675129+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:22.675078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:22.675078+0000","last_clean_scrub_stamp":"2024-09-13T15:51:22.675078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:11.304477+0000","scrub_duration":0.002879932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:47.519274+0000","last_change":"2024-09-13T15:51:47.519523+0000","last_active":"2024-09-13T15:51:47.519274+0000","last_peered":"2024-09-13T15:51:47.519274+0000","last_clean":"2024-09-13T15:51:47.519274+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:51:47.519274+0000","last_undegraded":"2024-09-13T15:51:47.519274+0000","last_fullsized":"2024-09-13T15:51:47.519274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-13T15:51:47.519216+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-09-13T15:51:47.519216+0000","last_clean_scrub_stamp":"2024-09-13T15:51:47.519216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:40.760952+0000","scrub_duration":0.0029653919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:08.926430+0000","last_change":"2024-09-13T15:52:08.926656+0000","last_active":"2024-09-13T15:52:08.926430+0000","last_peered":"2024-09-13T15:52:08.926430+0000","last_clean":"2024-09-13T15:52:08.926430+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:52:08.926430+0000","last_undegraded":"2024-09-13T15:52:08.926430+0000","last_fullsized":"2024-09-13T15:52:08.926430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:08.926380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:08.926380+0000","last_clean_scrub_stamp":"2024-09-13T15:52:08.926380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:08.969015+0000","scrub_duration":0.0030086520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"58'3","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:21.975274+0000","last_change":"2024-09-13T15:52:21.975506+0000","last_active":"2024-09-13T15:52:21.975274+0000","last_peered":"2024-09-13T15:52:21.975274+0000","last_clean":"2024-09-13T15:52:21.975274+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:52:21.975274+0000","last_undegraded":"2024-09-13T15:52:21.975274+0000","last_fullsized":"2024-09-13T15:52:21.975274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:21.975219+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:21.975219+0000","last_clean_scrub_stamp":"2024-09-13T15:52:21.975219+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:53.668027+0000","scrub_duration":0.0060361980000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:58.792615+0000","last_change":"2024-09-13T15:51:58.792615+0000","last_active":"2024-09-13T15:51:58.792615+0000","last_peered":"2024-09-13T15:51:58.792615+0000","last_clean":"2024-09-13T15:51:58.792615+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:51:58.792615+0000","last_undegraded":"2024-09-13T15:51:58.792615+0000","last_fullsized":"2024-09-13T15:51:58.792615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:58.792356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:58.792356+0000","last_clean_scrub_stamp":"2024-09-13T15:51:58.792356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:54.479718+0000","scrub_duration":0.0030650410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"15'2","reported_seq":53,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.114859+0000","last_change":"2024-09-13T15:35:20.173539+0000","last_active":"2024-09-13T15:51:03.114859+0000","last_peered":"2024-09-13T15:51:03.114859+0000","last_clean":"2024-09-13T15:51:03.114859+0000","last_became_active":"2024-09-13T15:35:20.165658+0000","last_became_peered":"2024-09-13T15:35:20.165658+0000","last_unstale":"2024-09-13T15:51:03.114859+0000","last_undegraded":"2024-09-13T15:51:03.114859+0000","last_fullsized":"2024-09-13T15:51:03.114859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:33.891919+0000","last_clean_scrub_stamp":"2024-09-13T15:34:33.891919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:39.648291+0000","last_change":"2024-09-13T15:51:39.648291+0000","last_active":"2024-09-13T15:51:39.648291+0000","last_peered":"2024-09-13T15:51:39.648291+0000","last_clean":"2024-09-13T15:51:39.648291+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:51:39.648291+0000","last_undegraded":"2024-09-13T15:51:39.648291+0000","last_fullsized":"2024-09-13T15:51:39.648291+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:39.647966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:39.647966+0000","last_clean_scrub_stamp":"2024-09-13T15:51:39.647966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:57.782751+0000","scrub_duration":0.0028655859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:39.860860+0000","last_change":"2024-09-13T15:51:39.860860+0000","last_active":"2024-09-13T15:51:39.860860+0000","last_peered":"2024-09-13T15:51:39.860860+0000","last_clean":"2024-09-13T15:51:39.860860+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:51:39.860860+0000","last_undegraded":"2024-09-13T15:51:39.860860+0000","last_fullsized":"2024-09-13T15:51:39.860860+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:39.860518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:39.860518+0000","last_clean_scrub_stamp":"2024-09-13T15:51:39.860518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:23.434457+0000","scrub_duration":0.0030233840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.b","version":"58'3","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:15.024123+0000","last_change":"2024-09-13T15:52:15.024349+0000","last_active":"2024-09-13T15:52:15.024123+0000","last_peered":"2024-09-13T15:52:15.024123+0000","last_clean":"2024-09-13T15:52:15.024123+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:52:15.024123+0000","last_undegraded":"2024-09-13T15:52:15.024123+0000","last_fullsized":"2024-09-13T15:52:15.024123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:15.024036+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:15.024036+0000","last_clean_scrub_stamp":"2024-09-13T15:52:15.024036+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:39.808527+0000","scrub_duration":0.0057298569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:41.947110+0000","last_change":"2024-09-13T15:51:41.947387+0000","last_active":"2024-09-13T15:51:41.947110+0000","last_peered":"2024-09-13T15:51:41.947110+0000","last_clean":"2024-09-13T15:51:41.947110+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:51:41.947110+0000","last_undegraded":"2024-09-13T15:51:41.947110+0000","last_fullsized":"2024-09-13T15:51:41.947110+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:41.947053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:41.947053+0000","last_clean_scrub_stamp":"2024-09-13T15:51:41.947053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:08.395633+0000","scrub_duration":0.0028106099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:11.761645+0000","last_change":"2024-09-13T15:52:11.761861+0000","last_active":"2024-09-13T15:52:11.761645+0000","last_peered":"2024-09-13T15:52:11.761645+0000","last_clean":"2024-09-13T15:52:11.761645+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:52:11.761645+0000","last_undegraded":"2024-09-13T15:52:11.761645+0000","last_fullsized":"2024-09-13T15:52:11.761645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:11.761591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:11.761591+0000","last_clean_scrub_stamp":"2024-09-13T15:52:11.761591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:27.292711+0000","scrub_duration":0.002907158,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.604941+0000","last_change":"2024-09-13T15:51:42.604941+0000","last_active":"2024-09-13T15:51:42.604941+0000","last_peered":"2024-09-13T15:51:42.604941+0000","last_clean":"2024-09-13T15:51:42.604941+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:51:42.604941+0000","last_undegraded":"2024-09-13T15:51:42.604941+0000","last_fullsized":"2024-09-13T15:51:42.604941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:42.604669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:42.604669+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.604669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:36.719016+0000","scrub_duration":0.0029141129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:06.735540+0000","last_change":"2024-09-13T15:52:06.735763+0000","last_active":"2024-09-13T15:52:06.735540+0000","last_peered":"2024-09-13T15:52:06.735540+0000","last_clean":"2024-09-13T15:52:06.735540+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:52:06.735540+0000","last_undegraded":"2024-09-13T15:52:06.735540+0000","last_fullsized":"2024-09-13T15:52:06.735540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:06.735489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:06.735489+0000","last_clean_scrub_stamp":"2024-09-13T15:52:06.735489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:06.778123+0000","scrub_duration":0.0029280899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:37.836156+0000","last_change":"2024-09-13T15:51:37.836156+0000","last_active":"2024-09-13T15:51:37.836156+0000","last_peered":"2024-09-13T15:51:37.836156+0000","last_clean":"2024-09-13T15:51:37.836156+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:51:37.836156+0000","last_undegraded":"2024-09-13T15:51:37.836156+0000","last_fullsized":"2024-09-13T15:51:37.836156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:37.835829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:37.835829+0000","last_clean_scrub_stamp":"2024-09-13T15:51:37.835829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.328337+0000","scrub_duration":0.0028480789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:13.998133+0000","last_change":"2024-09-13T15:52:13.998423+0000","last_active":"2024-09-13T15:52:13.998133+0000","last_peered":"2024-09-13T15:52:13.998133+0000","last_clean":"2024-09-13T15:52:13.998133+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:52:13.998133+0000","last_undegraded":"2024-09-13T15:52:13.998133+0000","last_fullsized":"2024-09-13T15:52:13.998133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:13.998078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:13.998078+0000","last_clean_scrub_stamp":"2024-09-13T15:52:13.998078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:29.529198+0000","scrub_duration":0.0029036449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:49.022056+0000","last_change":"2024-09-13T15:51:49.022056+0000","last_active":"2024-09-13T15:51:49.022056+0000","last_peered":"2024-09-13T15:51:49.022056+0000","last_clean":"2024-09-13T15:51:49.022056+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:51:49.022056+0000","last_undegraded":"2024-09-13T15:51:49.022056+0000","last_fullsized":"2024-09-13T15:51:49.022056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:49.021803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:49.021803+0000","last_clean_scrub_stamp":"2024-09-13T15:51:49.021803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:25.975161+0000","scrub_duration":0.0028090350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"58'3","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:19.734221+0000","last_change":"2024-09-13T15:52:19.734430+0000","last_active":"2024-09-13T15:52:19.734221+0000","last_peered":"2024-09-13T15:52:19.734221+0000","last_clean":"2024-09-13T15:52:19.734221+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:52:19.734221+0000","last_undegraded":"2024-09-13T15:52:19.734221+0000","last_fullsized":"2024-09-13T15:52:19.734221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:19.734162+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:19.734162+0000","last_clean_scrub_stamp":"2024-09-13T15:52:19.734162+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:17.552169+0000","scrub_duration":0.0056413829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:11.573279+0000","last_change":"2024-09-13T15:51:11.573279+0000","last_active":"2024-09-13T15:51:11.573279+0000","last_peered":"2024-09-13T15:51:11.573279+0000","last_clean":"2024-09-13T15:51:11.573279+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:51:11.573279+0000","last_undegraded":"2024-09-13T15:51:11.573279+0000","last_fullsized":"2024-09-13T15:51:11.573279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:11.572987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:11.572987+0000","last_clean_scrub_stamp":"2024-09-13T15:51:11.572987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:21.045297+0000","scrub_duration":0.0030285730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"58'2","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:16.655350+0000","last_change":"2024-09-13T15:52:16.655582+0000","last_active":"2024-09-13T15:52:16.655350+0000","last_peered":"2024-09-13T15:52:16.655350+0000","last_clean":"2024-09-13T15:52:16.655350+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:52:16.655350+0000","last_undegraded":"2024-09-13T15:52:16.655350+0000","last_fullsized":"2024-09-13T15:52:16.655350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-13T15:52:16.655296+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-13T15:52:16.655296+0000","last_clean_scrub_stamp":"2024-09-13T15:52:16.655296+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:54.785663+0000","scrub_duration":0.0061258019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:10.000654+0000","last_change":"2024-09-13T15:51:10.000654+0000","last_active":"2024-09-13T15:51:10.000654+0000","last_peered":"2024-09-13T15:51:10.000654+0000","last_clean":"2024-09-13T15:51:10.000654+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:51:10.000654+0000","last_undegraded":"2024-09-13T15:51:10.000654+0000","last_fullsized":"2024-09-13T15:51:10.000654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:10.000340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:10.000340+0000","last_clean_scrub_stamp":"2024-09-13T15:51:10.000340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.854008+0000","scrub_duration":0.0030965559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:15.701497+0000","last_change":"2024-09-13T15:52:15.701711+0000","last_active":"2024-09-13T15:52:15.701497+0000","last_peered":"2024-09-13T15:52:15.701497+0000","last_clean":"2024-09-13T15:52:15.701497+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:52:15.701497+0000","last_undegraded":"2024-09-13T15:52:15.701497+0000","last_fullsized":"2024-09-13T15:52:15.701497+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:15.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:15.701448+0000","last_clean_scrub_stamp":"2024-09-13T15:52:15.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:09.871999+0000","scrub_duration":0.0031982540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:08.634807+0000","last_change":"2024-09-13T15:51:08.634807+0000","last_active":"2024-09-13T15:51:08.634807+0000","last_peered":"2024-09-13T15:51:08.634807+0000","last_clean":"2024-09-13T15:51:08.634807+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:51:08.634807+0000","last_undegraded":"2024-09-13T15:51:08.634807+0000","last_fullsized":"2024-09-13T15:51:08.634807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:08.634488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:08.634488+0000","last_clean_scrub_stamp":"2024-09-13T15:51:08.634488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:29.659635+0000","scrub_duration":0.0033577189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:12.742813+0000","last_change":"2024-09-13T15:52:12.743022+0000","last_active":"2024-09-13T15:52:12.742813+0000","last_peered":"2024-09-13T15:52:12.742813+0000","last_clean":"2024-09-13T15:52:12.742813+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:52:12.742813+0000","last_undegraded":"2024-09-13T15:52:12.742813+0000","last_fullsized":"2024-09-13T15:52:12.742813+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:12.742764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:12.742764+0000","last_clean_scrub_stamp":"2024-09-13T15:52:12.742764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:37.527255+0000","scrub_duration":0.0029269640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:43.932444+0000","last_change":"2024-09-13T15:51:43.932667+0000","last_active":"2024-09-13T15:51:43.932444+0000","last_peered":"2024-09-13T15:51:43.932444+0000","last_clean":"2024-09-13T15:51:43.932444+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:51:43.932444+0000","last_undegraded":"2024-09-13T15:51:43.932444+0000","last_fullsized":"2024-09-13T15:51:43.932444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:43.932395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:43.932395+0000","last_clean_scrub_stamp":"2024-09-13T15:51:43.932395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:50.418406+0000","scrub_duration":0.0030891629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:22.935326+0000","last_change":"2024-09-13T15:52:22.935577+0000","last_active":"2024-09-13T15:52:22.935326+0000","last_peered":"2024-09-13T15:52:22.935326+0000","last_clean":"2024-09-13T15:52:22.935326+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:52:22.935326+0000","last_undegraded":"2024-09-13T15:52:22.935326+0000","last_fullsized":"2024-09-13T15:52:22.935326+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:22.935273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:22.935273+0000","last_clean_scrub_stamp":"2024-09-13T15:52:22.935273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:32.208431+0000","scrub_duration":0.002821306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:34.984870+0000","last_change":"2024-09-13T15:51:34.985088+0000","last_active":"2024-09-13T15:51:34.984870+0000","last_peered":"2024-09-13T15:51:34.984870+0000","last_clean":"2024-09-13T15:51:34.984870+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:51:34.984870+0000","last_undegraded":"2024-09-13T15:51:34.984870+0000","last_fullsized":"2024-09-13T15:51:34.984870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:34.984821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:34.984821+0000","last_clean_scrub_stamp":"2024-09-13T15:51:34.984821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:43.477329+0000","scrub_duration":0.0030114199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:59.489759+0000","last_change":"2024-09-13T15:51:59.489969+0000","last_active":"2024-09-13T15:51:59.489759+0000","last_peered":"2024-09-13T15:51:59.489759+0000","last_clean":"2024-09-13T15:51:59.489759+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:51:59.489759+0000","last_undegraded":"2024-09-13T15:51:59.489759+0000","last_fullsized":"2024-09-13T15:51:59.489759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:59.489693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:59.489693+0000","last_clean_scrub_stamp":"2024-09-13T15:51:59.489693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:42.511558+0000","scrub_duration":0.0029566660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:56.928710+0000","last_change":"2024-09-13T15:51:56.928926+0000","last_active":"2024-09-13T15:51:56.928710+0000","last_peered":"2024-09-13T15:51:56.928710+0000","last_clean":"2024-09-13T15:51:56.928710+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:51:56.928710+0000","last_undegraded":"2024-09-13T15:51:56.928710+0000","last_fullsized":"2024-09-13T15:51:56.928710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:56.928661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:56.928661+0000","last_clean_scrub_stamp":"2024-09-13T15:51:56.928661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:27.237108+0000","scrub_duration":0.0029743360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:48.563736+0000","last_change":"2024-09-13T15:51:48.563977+0000","last_active":"2024-09-13T15:51:48.563736+0000","last_peered":"2024-09-13T15:51:48.563736+0000","last_clean":"2024-09-13T15:51:48.563736+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:51:48.563736+0000","last_undegraded":"2024-09-13T15:51:48.563736+0000","last_fullsized":"2024-09-13T15:51:48.563736+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:48.563689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:48.563689+0000","last_clean_scrub_stamp":"2024-09-13T15:51:48.563689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:57.056198+0000","scrub_duration":0.0028270109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:28.063597+0000","last_change":"2024-09-13T15:51:28.063807+0000","last_active":"2024-09-13T15:51:28.063597+0000","last_peered":"2024-09-13T15:51:28.063597+0000","last_clean":"2024-09-13T15:51:28.063597+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:51:28.063597+0000","last_undegraded":"2024-09-13T15:51:28.063597+0000","last_fullsized":"2024-09-13T15:51:28.063597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:28.063549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:28.063549+0000","last_clean_scrub_stamp":"2024-09-13T15:51:28.063549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:22.177895+0000","scrub_duration":0.0027253830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:09.786228+0000","last_change":"2024-09-13T15:52:09.786444+0000","last_active":"2024-09-13T15:52:09.786228+0000","last_peered":"2024-09-13T15:52:09.786228+0000","last_clean":"2024-09-13T15:52:09.786228+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:52:09.786228+0000","last_undegraded":"2024-09-13T15:52:09.786228+0000","last_fullsized":"2024-09-13T15:52:09.786228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:09.786175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:09.786175+0000","last_clean_scrub_stamp":"2024-09-13T15:52:09.786175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:43.684744+0000","scrub_duration":0.002697287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"58'110","reported_seq":244,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:01.775924+0000","last_change":"2024-09-13T15:52:01.776195+0000","last_active":"2024-09-13T15:52:01.775924+0000","last_peered":"2024-09-13T15:52:01.775924+0000","last_clean":"2024-09-13T15:52:01.775924+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:52:01.775924+0000","last_undegraded":"2024-09-13T15:52:01.775924+0000","last_fullsized":"2024-09-13T15:52:01.775924+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'110","last_scrub_stamp":"2024-09-13T15:52:01.775864+0000","last_deep_scrub":"58'110","last_deep_scrub_stamp":"2024-09-13T15:52:01.775864+0000","last_clean_scrub_stamp":"2024-09-13T15:52:01.775864+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:06.410483+0000","scrub_duration":0.0095732660000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":70,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:09.022828+0000","last_change":"2024-09-13T15:51:09.023040+0000","last_active":"2024-09-13T15:51:09.022828+0000","last_peered":"2024-09-13T15:51:09.022828+0000","last_clean":"2024-09-13T15:51:09.022828+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:51:09.022828+0000","last_undegraded":"2024-09-13T15:51:09.022828+0000","last_fullsized":"2024-09-13T15:51:09.022828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:09.022780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:09.022780+0000","last_clean_scrub_stamp":"2024-09-13T15:51:09.022780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:57.652179+0000","scrub_duration":0.0027795350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:53.492621+0000","last_change":"2024-09-13T15:51:53.492836+0000","last_active":"2024-09-13T15:51:53.492621+0000","last_peered":"2024-09-13T15:51:53.492621+0000","last_clean":"2024-09-13T15:51:53.492621+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:51:53.492621+0000","last_undegraded":"2024-09-13T15:51:53.492621+0000","last_fullsized":"2024-09-13T15:51:53.492621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:53.492570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:53.492570+0000","last_clean_scrub_stamp":"2024-09-13T15:51:53.492570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:19.941150+0000","scrub_duration":0.0029359529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:36.814688+0000","last_change":"2024-09-13T15:51:36.814917+0000","last_active":"2024-09-13T15:51:36.814688+0000","last_peered":"2024-09-13T15:51:36.814688+0000","last_clean":"2024-09-13T15:51:36.814688+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:51:36.814688+0000","last_undegraded":"2024-09-13T15:51:36.814688+0000","last_fullsized":"2024-09-13T15:51:36.814688+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:36.814631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:36.814631+0000","last_clean_scrub_stamp":"2024-09-13T15:51:36.814631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:30.056367+0000","scrub_duration":0.0030192740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"58'2","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:59.782356+0000","last_change":"2024-09-13T15:51:59.782573+0000","last_active":"2024-09-13T15:51:59.782356+0000","last_peered":"2024-09-13T15:51:59.782356+0000","last_clean":"2024-09-13T15:51:59.782356+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:51:59.782356+0000","last_undegraded":"2024-09-13T15:51:59.782356+0000","last_fullsized":"2024-09-13T15:51:59.782356+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-13T15:51:59.782304+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-13T15:51:59.782304+0000","last_clean_scrub_stamp":"2024-09-13T15:51:59.782304+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:01.886087+0000","scrub_duration":0.0062355980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:48.041344+0000","last_change":"2024-09-13T15:51:48.041512+0000","last_active":"2024-09-13T15:51:48.041344+0000","last_peered":"2024-09-13T15:51:48.041344+0000","last_clean":"2024-09-13T15:51:48.041344+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:51:48.041344+0000","last_undegraded":"2024-09-13T15:51:48.041344+0000","last_fullsized":"2024-09-13T15:51:48.041344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:48.041303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:48.041303+0000","last_clean_scrub_stamp":"2024-09-13T15:51:48.041303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:50.423013+0000","scrub_duration":0.001557817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"58'3","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:12.472984+0000","last_change":"2024-09-13T15:52:12.473201+0000","last_active":"2024-09-13T15:52:12.472984+0000","last_peered":"2024-09-13T15:52:12.472984+0000","last_clean":"2024-09-13T15:52:12.472984+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:52:12.472984+0000","last_undegraded":"2024-09-13T15:52:12.472984+0000","last_fullsized":"2024-09-13T15:52:12.472984+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:12.472917+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:12.472917+0000","last_clean_scrub_stamp":"2024-09-13T15:52:12.472917+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:34.717523+0000","scrub_duration":0.0060779959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:20.704723+0000","last_change":"2024-09-13T15:51:20.704937+0000","last_active":"2024-09-13T15:51:20.704723+0000","last_peered":"2024-09-13T15:51:20.704723+0000","last_clean":"2024-09-13T15:51:20.704723+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:51:20.704723+0000","last_undegraded":"2024-09-13T15:51:20.704723+0000","last_fullsized":"2024-09-13T15:51:20.704723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:20.704675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:20.704675+0000","last_clean_scrub_stamp":"2024-09-13T15:51:20.704675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:41.029516+0000","scrub_duration":0.0028536220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"58'2","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:19.049123+0000","last_change":"2024-09-13T15:52:19.049433+0000","last_active":"2024-09-13T15:52:19.049123+0000","last_peered":"2024-09-13T15:52:19.049123+0000","last_clean":"2024-09-13T15:52:19.049123+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:52:19.049123+0000","last_undegraded":"2024-09-13T15:52:19.049123+0000","last_fullsized":"2024-09-13T15:52:19.049123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-13T15:52:19.049070+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-13T15:52:19.049070+0000","last_clean_scrub_stamp":"2024-09-13T15:52:19.049070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:13.219621+0000","scrub_duration":0.0060239409999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:23.631969+0000","last_change":"2024-09-13T15:51:23.632249+0000","last_active":"2024-09-13T15:51:23.631969+0000","last_peered":"2024-09-13T15:51:23.631969+0000","last_clean":"2024-09-13T15:51:23.631969+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:51:23.631969+0000","last_undegraded":"2024-09-13T15:51:23.631969+0000","last_fullsized":"2024-09-13T15:51:23.631969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:23.631921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:23.631921+0000","last_clean_scrub_stamp":"2024-09-13T15:51:23.631921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:28.485589+0000","scrub_duration":0.0028528719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"58'12","reported_seq":84,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:54.450870+0000","last_change":"2024-09-13T15:51:54.451094+0000","last_active":"2024-09-13T15:51:54.450870+0000","last_peered":"2024-09-13T15:51:54.450870+0000","last_clean":"2024-09-13T15:51:54.450870+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:51:54.450870+0000","last_undegraded":"2024-09-13T15:51:54.450870+0000","last_fullsized":"2024-09-13T15:51:54.450870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'12","last_scrub_stamp":"2024-09-13T15:51:54.450813+0000","last_deep_scrub":"58'12","last_deep_scrub_stamp":"2024-09-13T15:51:54.450813+0000","last_clean_scrub_stamp":"2024-09-13T15:51:54.450813+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:00.936823+0000","scrub_duration":0.009138218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:26.093049+0000","last_change":"2024-09-13T15:51:26.093274+0000","last_active":"2024-09-13T15:51:26.093049+0000","last_peered":"2024-09-13T15:51:26.093049+0000","last_clean":"2024-09-13T15:51:26.093049+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:51:26.093049+0000","last_undegraded":"2024-09-13T15:51:26.093049+0000","last_fullsized":"2024-09-13T15:51:26.093049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:26.092993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:26.092993+0000","last_clean_scrub_stamp":"2024-09-13T15:51:26.092993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:44.227778+0000","scrub_duration":0.0029912200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:23.938159+0000","last_change":"2024-09-13T15:52:23.938364+0000","last_active":"2024-09-13T15:52:23.938159+0000","last_peered":"2024-09-13T15:52:23.938159+0000","last_clean":"2024-09-13T15:52:23.938159+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:52:23.938159+0000","last_undegraded":"2024-09-13T15:52:23.938159+0000","last_fullsized":"2024-09-13T15:52:23.938159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:23.938111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:23.938111+0000","last_clean_scrub_stamp":"2024-09-13T15:52:23.938111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:11.313812+0000","scrub_duration":0.002901799,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:20.688069+0000","last_change":"2024-09-13T15:52:20.688300+0000","last_active":"2024-09-13T15:52:20.688069+0000","last_peered":"2024-09-13T15:52:20.688069+0000","last_clean":"2024-09-13T15:52:20.688069+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:52:20.688069+0000","last_undegraded":"2024-09-13T15:52:20.688069+0000","last_fullsized":"2024-09-13T15:52:20.688069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:20.687995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:20.687995+0000","last_clean_scrub_stamp":"2024-09-13T15:52:20.687995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:08.063697+0000","scrub_duration":0.0030836829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:50.568853+0000","last_change":"2024-09-13T15:51:50.569089+0000","last_active":"2024-09-13T15:51:50.568853+0000","last_peered":"2024-09-13T15:51:50.568853+0000","last_clean":"2024-09-13T15:51:50.568853+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:51:50.568853+0000","last_undegraded":"2024-09-13T15:51:50.568853+0000","last_fullsized":"2024-09-13T15:51:50.568853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:50.568804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:50.568804+0000","last_clean_scrub_stamp":"2024-09-13T15:51:50.568804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:34.142743+0000","scrub_duration":0.0031469549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:33.819531+0000","last_change":"2024-09-13T15:51:33.819817+0000","last_active":"2024-09-13T15:51:33.819531+0000","last_peered":"2024-09-13T15:51:33.819531+0000","last_clean":"2024-09-13T15:51:33.819531+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:51:33.819531+0000","last_undegraded":"2024-09-13T15:51:33.819531+0000","last_fullsized":"2024-09-13T15:51:33.819531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:33.819477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:33.819477+0000","last_clean_scrub_stamp":"2024-09-13T15:51:33.819477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:21.665891+0000","scrub_duration":0.0030701579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"58'4","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:10.949624+0000","last_change":"2024-09-13T15:52:10.949879+0000","last_active":"2024-09-13T15:52:10.949624+0000","last_peered":"2024-09-13T15:52:10.949624+0000","last_clean":"2024-09-13T15:52:10.949624+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:52:10.949624+0000","last_undegraded":"2024-09-13T15:52:10.949624+0000","last_fullsized":"2024-09-13T15:52:10.949624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'4","last_scrub_stamp":"2024-09-13T15:52:10.949571+0000","last_deep_scrub":"58'4","last_deep_scrub_stamp":"2024-09-13T15:52:10.949571+0000","last_clean_scrub_stamp":"2024-09-13T15:52:10.949571+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:41.038648+0000","scrub_duration":0.0066544100000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.920706+0000","last_change":"2024-09-13T15:51:42.920918+0000","last_active":"2024-09-13T15:51:42.920706+0000","last_peered":"2024-09-13T15:51:42.920706+0000","last_clean":"2024-09-13T15:51:42.920706+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:51:42.920706+0000","last_undegraded":"2024-09-13T15:51:42.920706+0000","last_fullsized":"2024-09-13T15:51:42.920706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:42.920654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:42.920654+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.920654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:09.369234+0000","scrub_duration":0.0027763269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"58'16","reported_seq":88,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:10.408842+0000","last_change":"2024-09-13T15:52:10.409098+0000","last_active":"2024-09-13T15:52:10.408842+0000","last_peered":"2024-09-13T15:52:10.408842+0000","last_clean":"2024-09-13T15:52:10.408842+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:52:10.408842+0000","last_undegraded":"2024-09-13T15:52:10.408842+0000","last_fullsized":"2024-09-13T15:52:10.408842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'16","last_scrub_stamp":"2024-09-13T15:52:10.408789+0000","last_deep_scrub":"58'16","last_deep_scrub_stamp":"2024-09-13T15:52:10.408789+0000","last_clean_scrub_stamp":"2024-09-13T15:52:10.408789+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:40.717236+0000","scrub_duration":0.0096950700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2638,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.015505+0000","last_change":"2024-09-13T15:51:07.015632+0000","last_active":"2024-09-13T15:51:07.015505+0000","last_peered":"2024-09-13T15:51:07.015505+0000","last_clean":"2024-09-13T15:51:07.015505+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:51:07.015505+0000","last_undegraded":"2024-09-13T15:51:07.015505+0000","last_fullsized":"2024-09-13T15:51:07.015505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:07.015482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:07.015482+0000","last_clean_scrub_stamp":"2024-09-13T15:51:07.015482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:27.340322+0000","scrub_duration":0.001887321,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"58'5","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.931081+0000","last_change":"2024-09-13T15:51:42.931297+0000","last_active":"2024-09-13T15:51:42.931081+0000","last_peered":"2024-09-13T15:51:42.931081+0000","last_clean":"2024-09-13T15:51:42.931081+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:51:42.931081+0000","last_undegraded":"2024-09-13T15:51:42.931081+0000","last_fullsized":"2024-09-13T15:51:42.931081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'5","last_scrub_stamp":"2024-09-13T15:51:42.931027+0000","last_deep_scrub":"58'5","last_deep_scrub_stamp":"2024-09-13T15:51:42.931027+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.931027+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:04.378223+0000","scrub_duration":0.0069458810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:51.933694+0000","last_change":"2024-09-13T15:51:51.933959+0000","last_active":"2024-09-13T15:51:51.933694+0000","last_peered":"2024-09-13T15:51:51.933694+0000","last_clean":"2024-09-13T15:51:51.933694+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:51:51.933694+0000","last_undegraded":"2024-09-13T15:51:51.933694+0000","last_fullsized":"2024-09-13T15:51:51.933694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:51.933640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:51.933640+0000","last_clean_scrub_stamp":"2024-09-13T15:51:51.933640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:23.904863+0000","scrub_duration":0.0029495559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:21.012986+0000","last_change":"2024-09-13T15:52:21.013257+0000","last_active":"2024-09-13T15:52:21.012986+0000","last_peered":"2024-09-13T15:52:21.012986+0000","last_clean":"2024-09-13T15:52:21.012986+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:52:21.012986+0000","last_undegraded":"2024-09-13T15:52:21.012986+0000","last_fullsized":"2024-09-13T15:52:21.012986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:21.012937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:21.012937+0000","last_clean_scrub_stamp":"2024-09-13T15:52:21.012937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:59.143304+0000","scrub_duration":0.0029541960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:19.658733+0000","last_change":"2024-09-13T15:51:19.658733+0000","last_active":"2024-09-13T15:51:19.658733+0000","last_peered":"2024-09-13T15:51:19.658733+0000","last_clean":"2024-09-13T15:51:19.658733+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:51:19.658733+0000","last_undegraded":"2024-09-13T15:51:19.658733+0000","last_fullsized":"2024-09-13T15:51:19.658733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:19.658442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:19.658442+0000","last_clean_scrub_stamp":"2024-09-13T15:51:19.658442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:52.886746+0000","scrub_duration":0.0031503270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:56.835944+0000","last_change":"2024-09-13T15:51:56.836271+0000","last_active":"2024-09-13T15:51:56.835944+0000","last_peered":"2024-09-13T15:51:56.835944+0000","last_clean":"2024-09-13T15:51:56.835944+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:51:56.835944+0000","last_undegraded":"2024-09-13T15:51:56.835944+0000","last_fullsized":"2024-09-13T15:51:56.835944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:56.835893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:56.835893+0000","last_clean_scrub_stamp":"2024-09-13T15:51:56.835893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:19.080500+0000","scrub_duration":0.0030846369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:54.842266+0000","last_change":"2024-09-13T15:51:54.842471+0000","last_active":"2024-09-13T15:51:54.842266+0000","last_peered":"2024-09-13T15:51:54.842266+0000","last_clean":"2024-09-13T15:51:54.842266+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:51:54.842266+0000","last_undegraded":"2024-09-13T15:51:54.842266+0000","last_fullsized":"2024-09-13T15:51:54.842266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:54.842213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:54.842213+0000","last_clean_scrub_stamp":"2024-09-13T15:51:54.842213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:25.150660+0000","scrub_duration":0.003082988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:27.037519+0000","last_change":"2024-09-13T15:52:27.037759+0000","last_active":"2024-09-13T15:52:27.037519+0000","last_peered":"2024-09-13T15:52:27.037519+0000","last_clean":"2024-09-13T15:52:27.037519+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:52:27.037519+0000","last_undegraded":"2024-09-13T15:52:27.037519+0000","last_fullsized":"2024-09-13T15:52:27.037519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:27.037466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:27.037466+0000","last_clean_scrub_stamp":"2024-09-13T15:52:27.037466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:22.593712+0000","scrub_duration":0.0028811259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:44.659569+0000","last_change":"2024-09-13T15:51:44.659803+0000","last_active":"2024-09-13T15:51:44.659569+0000","last_peered":"2024-09-13T15:51:44.659569+0000","last_clean":"2024-09-13T15:51:44.659569+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:51:44.659569+0000","last_undegraded":"2024-09-13T15:51:44.659569+0000","last_fullsized":"2024-09-13T15:51:44.659569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:44.659519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:44.659519+0000","last_clean_scrub_stamp":"2024-09-13T15:51:44.659519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:32.505933+0000","scrub_duration":0.0028280330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:03.993268+0000","last_change":"2024-09-13T15:52:03.993484+0000","last_active":"2024-09-13T15:52:03.993268+0000","last_peered":"2024-09-13T15:52:03.993268+0000","last_clean":"2024-09-13T15:52:03.993268+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:52:03.993268+0000","last_undegraded":"2024-09-13T15:52:03.993268+0000","last_fullsized":"2024-09-13T15:52:03.993268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:03.993217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:03.993217+0000","last_clean_scrub_stamp":"2024-09-13T15:52:03.993217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:08.627836+0000","scrub_duration":0.0029228980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:14.409834+0000","last_change":"2024-09-13T15:52:14.410059+0000","last_active":"2024-09-13T15:52:14.409834+0000","last_peered":"2024-09-13T15:52:14.409834+0000","last_clean":"2024-09-13T15:52:14.409834+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:52:14.409834+0000","last_undegraded":"2024-09-13T15:52:14.409834+0000","last_fullsized":"2024-09-13T15:52:14.409834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-13T15:52:14.409780+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-09-13T15:52:14.409780+0000","last_clean_scrub_stamp":"2024-09-13T15:52:14.409780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:10.097142+0000","scrub_duration":0.0030991119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:58.866284+0000","last_change":"2024-09-13T15:51:58.866284+0000","last_active":"2024-09-13T15:51:58.866284+0000","last_peered":"2024-09-13T15:51:58.866284+0000","last_clean":"2024-09-13T15:51:58.866284+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:51:58.866284+0000","last_undegraded":"2024-09-13T15:51:58.866284+0000","last_fullsized":"2024-09-13T15:51:58.866284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:58.866014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:58.866014+0000","last_clean_scrub_stamp":"2024-09-13T15:51:58.866014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:21.110620+0000","scrub_duration":0.002811142,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:49.917138+0000","last_change":"2024-09-13T15:51:49.917138+0000","last_active":"2024-09-13T15:51:49.917138+0000","last_peered":"2024-09-13T15:51:49.917138+0000","last_clean":"2024-09-13T15:51:49.917138+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:51:49.917138+0000","last_undegraded":"2024-09-13T15:51:49.917138+0000","last_fullsized":"2024-09-13T15:51:49.917138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-13T15:51:49.916844+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-09-13T15:51:49.916844+0000","last_clean_scrub_stamp":"2024-09-13T15:51:49.916844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:21.888067+0000","scrub_duration":0.0029938650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:30.052443+0000","last_change":"2024-09-13T15:51:30.052443+0000","last_active":"2024-09-13T15:51:30.052443+0000","last_peered":"2024-09-13T15:51:30.052443+0000","last_clean":"2024-09-13T15:51:30.052443+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:51:30.052443+0000","last_undegraded":"2024-09-13T15:51:30.052443+0000","last_fullsized":"2024-09-13T15:51:30.052443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:30.052149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:30.052149+0000","last_clean_scrub_stamp":"2024-09-13T15:51:30.052149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:17.898563+0000","scrub_duration":0.002920181,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:17.394868+0000","last_change":"2024-09-13T15:52:17.395084+0000","last_active":"2024-09-13T15:52:17.394868+0000","last_peered":"2024-09-13T15:52:17.394868+0000","last_clean":"2024-09-13T15:52:17.394868+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:52:17.394868+0000","last_undegraded":"2024-09-13T15:52:17.394868+0000","last_fullsized":"2024-09-13T15:52:17.394868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:17.394817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:17.394817+0000","last_clean_scrub_stamp":"2024-09-13T15:52:17.394817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:22.029436+0000","scrub_duration":0.003240714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:15.611315+0000","last_change":"2024-09-13T15:51:15.611315+0000","last_active":"2024-09-13T15:51:15.611315+0000","last_peered":"2024-09-13T15:51:15.611315+0000","last_clean":"2024-09-13T15:51:15.611315+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:51:15.611315+0000","last_undegraded":"2024-09-13T15:51:15.611315+0000","last_fullsized":"2024-09-13T15:51:15.611315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:15.611033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:15.611033+0000","last_clean_scrub_stamp":"2024-09-13T15:51:15.611033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:31.771056+0000","scrub_duration":0.0029690459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:01.966177+0000","last_change":"2024-09-13T15:52:01.966436+0000","last_active":"2024-09-13T15:52:01.966177+0000","last_peered":"2024-09-13T15:52:01.966177+0000","last_clean":"2024-09-13T15:52:01.966177+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:52:01.966177+0000","last_undegraded":"2024-09-13T15:52:01.966177+0000","last_fullsized":"2024-09-13T15:52:01.966177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:01.966110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:01.966110+0000","last_clean_scrub_stamp":"2024-09-13T15:52:01.966110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:04.069892+0000","scrub_duration":0.0027739829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:10.591481+0000","last_change":"2024-09-13T15:51:10.591481+0000","last_active":"2024-09-13T15:51:10.591481+0000","last_peered":"2024-09-13T15:51:10.591481+0000","last_clean":"2024-09-13T15:51:10.591481+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:51:10.591481+0000","last_undegraded":"2024-09-13T15:51:10.591481+0000","last_fullsized":"2024-09-13T15:51:10.591481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:10.591224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:10.591224+0000","last_clean_scrub_stamp":"2024-09-13T15:51:10.591224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:30.916064+0000","scrub_duration":0.0029806559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":50,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.267016+0000","last_change":"2024-09-13T15:35:20.157986+0000","last_active":"2024-09-13T15:51:03.267016+0000","last_peered":"2024-09-13T15:51:03.267016+0000","last_clean":"2024-09-13T15:51:03.267016+0000","last_became_active":"2024-09-13T15:35:20.157317+0000","last_became_peered":"2024-09-13T15:35:20.157317+0000","last_unstale":"2024-09-13T15:51:03.267016+0000","last_undegraded":"2024-09-13T15:51:03.267016+0000","last_fullsized":"2024-09-13T15:51:03.267016+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:44.901282+0000","last_change":"2024-09-13T15:51:44.901282+0000","last_active":"2024-09-13T15:51:44.901282+0000","last_peered":"2024-09-13T15:51:44.901282+0000","last_clean":"2024-09-13T15:51:44.901282+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:51:44.901282+0000","last_undegraded":"2024-09-13T15:51:44.901282+0000","last_fullsized":"2024-09-13T15:51:44.901282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:44.901011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:44.901011+0000","last_clean_scrub_stamp":"2024-09-13T15:51:44.901011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:47.282721+0000","scrub_duration":0.002805597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:15.444436+0000","last_change":"2024-09-13T15:52:15.444698+0000","last_active":"2024-09-13T15:52:15.444436+0000","last_peered":"2024-09-13T15:52:15.444436+0000","last_clean":"2024-09-13T15:52:15.444436+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:52:15.444436+0000","last_undegraded":"2024-09-13T15:52:15.444436+0000","last_fullsized":"2024-09-13T15:52:15.444436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:15.444381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:15.444381+0000","last_clean_scrub_stamp":"2024-09-13T15:52:15.444381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:17.548163+0000","scrub_duration":0.0027820800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:14.575770+0000","last_change":"2024-09-13T15:51:14.575770+0000","last_active":"2024-09-13T15:51:14.575770+0000","last_peered":"2024-09-13T15:51:14.575770+0000","last_clean":"2024-09-13T15:51:14.575770+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:51:14.575770+0000","last_undegraded":"2024-09-13T15:51:14.575770+0000","last_fullsized":"2024-09-13T15:51:14.575770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:14.575511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:14.575511+0000","last_clean_scrub_stamp":"2024-09-13T15:51:14.575511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:22.946343+0000","scrub_duration":0.0031682049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:31.763566+0000","last_change":"2024-09-13T15:51:31.763566+0000","last_active":"2024-09-13T15:51:31.763566+0000","last_peered":"2024-09-13T15:51:31.763566+0000","last_clean":"2024-09-13T15:51:31.763566+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:51:31.763566+0000","last_undegraded":"2024-09-13T15:51:31.763566+0000","last_fullsized":"2024-09-13T15:51:31.763566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:31.763240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:31.763240+0000","last_clean_scrub_stamp":"2024-09-13T15:51:31.763240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:25.877586+0000","scrub_duration":0.0031492009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746175+0000","last_change":"2024-09-13T15:34:35.324523+0000","last_active":"2024-09-13T15:51:03.746175+0000","last_peered":"2024-09-13T15:51:03.746175+0000","last_clean":"2024-09-13T15:51:03.746175+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:51:03.746175+0000","last_undegraded":"2024-09-13T15:51:03.746175+0000","last_fullsized":"2024-09-13T15:51:03.746175+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:25.684674+0000","last_change":"2024-09-13T15:52:25.684890+0000","last_active":"2024-09-13T15:52:25.684674+0000","last_peered":"2024-09-13T15:52:25.684674+0000","last_clean":"2024-09-13T15:52:25.684674+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:52:25.684674+0000","last_undegraded":"2024-09-13T15:52:25.684674+0000","last_fullsized":"2024-09-13T15:52:25.684674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:25.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:25.684625+0000","last_clean_scrub_stamp":"2024-09-13T15:52:25.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:18:52.083110+0000","scrub_duration":0.0031391589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":50,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.734854+0000","last_change":"2024-09-13T15:35:20.156675+0000","last_active":"2024-09-13T15:51:06.734854+0000","last_peered":"2024-09-13T15:51:06.734854+0000","last_clean":"2024-09-13T15:51:06.734854+0000","last_became_active":"2024-09-13T15:35:20.152889+0000","last_became_peered":"2024-09-13T15:35:20.152889+0000","last_unstale":"2024-09-13T15:51:06.734854+0000","last_undegraded":"2024-09-13T15:51:06.734854+0000","last_fullsized":"2024-09-13T15:51:06.734854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.746153+0000","last_change":"2024-09-13T15:34:35.346893+0000","last_active":"2024-09-13T15:51:03.746153+0000","last_peered":"2024-09-13T15:51:03.746153+0000","last_clean":"2024-09-13T15:51:03.746153+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:51:03.746153+0000","last_undegraded":"2024-09-13T15:51:03.746153+0000","last_fullsized":"2024-09-13T15:51:03.746153+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:14.607793+0000","last_change":"2024-09-13T15:51:14.608116+0000","last_active":"2024-09-13T15:51:14.607793+0000","last_peered":"2024-09-13T15:51:14.607793+0000","last_clean":"2024-09-13T15:51:14.607793+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:51:14.607793+0000","last_undegraded":"2024-09-13T15:51:14.607793+0000","last_fullsized":"2024-09-13T15:51:14.607793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:14.607733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:14.607733+0000","last_clean_scrub_stamp":"2024-09-13T15:51:14.607733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:57.098851+0000","scrub_duration":0.0030409230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:22.464879+0000","last_change":"2024-09-13T15:52:22.465099+0000","last_active":"2024-09-13T15:52:22.464879+0000","last_peered":"2024-09-13T15:52:22.464879+0000","last_clean":"2024-09-13T15:52:22.464879+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:52:22.464879+0000","last_undegraded":"2024-09-13T15:52:22.464879+0000","last_fullsized":"2024-09-13T15:52:22.464879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:22.464830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:22.464830+0000","last_clean_scrub_stamp":"2024-09-13T15:52:22.464830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:22.507464+0000","scrub_duration":0.002969541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:23.745830+0000","last_change":"2024-09-13T15:52:23.746051+0000","last_active":"2024-09-13T15:52:23.745830+0000","last_peered":"2024-09-13T15:52:23.745830+0000","last_clean":"2024-09-13T15:52:23.745830+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:52:23.745830+0000","last_undegraded":"2024-09-13T15:52:23.745830+0000","last_fullsized":"2024-09-13T15:52:23.745830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:23.745782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:23.745782+0000","last_clean_scrub_stamp":"2024-09-13T15:52:23.745782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:19.302029+0000","scrub_duration":0.0028699760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:25.542771+0000","last_change":"2024-09-13T15:52:25.543013+0000","last_active":"2024-09-13T15:52:25.542771+0000","last_peered":"2024-09-13T15:52:25.542771+0000","last_clean":"2024-09-13T15:52:25.542771+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:52:25.542771+0000","last_undegraded":"2024-09-13T15:52:25.542771+0000","last_fullsized":"2024-09-13T15:52:25.542771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:25.542672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:25.542672+0000","last_clean_scrub_stamp":"2024-09-13T15:52:25.542672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:55.631749+0000","scrub_duration":0.0032676430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.262421+0000","last_change":"2024-09-13T15:34:35.333765+0000","last_active":"2024-09-13T15:51:03.262421+0000","last_peered":"2024-09-13T15:51:03.262421+0000","last_clean":"2024-09-13T15:51:03.262421+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:51:03.262421+0000","last_undegraded":"2024-09-13T15:51:03.262421+0000","last_fullsized":"2024-09-13T15:51:03.262421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:12.628563+0000","last_change":"2024-09-13T15:51:12.628806+0000","last_active":"2024-09-13T15:51:12.628563+0000","last_peered":"2024-09-13T15:51:12.628563+0000","last_clean":"2024-09-13T15:51:12.628563+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:51:12.628563+0000","last_undegraded":"2024-09-13T15:51:12.628563+0000","last_fullsized":"2024-09-13T15:51:12.628563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:12.628512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:12.628512+0000","last_clean_scrub_stamp":"2024-09-13T15:51:12.628512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:01.257911+0000","scrub_duration":0.0030549050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279823+0000","last_change":"2024-09-13T15:34:35.335252+0000","last_active":"2024-09-13T15:51:06.279823+0000","last_peered":"2024-09-13T15:51:06.279823+0000","last_clean":"2024-09-13T15:51:06.279823+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:51:06.279823+0000","last_undegraded":"2024-09-13T15:51:06.279823+0000","last_fullsized":"2024-09-13T15:51:06.279823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279866+0000","last_change":"2024-09-13T15:34:35.330875+0000","last_active":"2024-09-13T15:51:06.279866+0000","last_peered":"2024-09-13T15:51:06.279866+0000","last_clean":"2024-09-13T15:51:06.279866+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:51:06.279866+0000","last_undegraded":"2024-09-13T15:51:06.279866+0000","last_fullsized":"2024-09-13T15:51:06.279866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279961+0000","last_change":"2024-09-13T15:34:35.331709+0000","last_active":"2024-09-13T15:51:06.279961+0000","last_peered":"2024-09-13T15:51:06.279961+0000","last_clean":"2024-09-13T15:51:06.279961+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:51:06.279961+0000","last_undegraded":"2024-09-13T15:51:06.279961+0000","last_fullsized":"2024-09-13T15:51:06.279961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:09.587225+0000","last_change":"2024-09-13T15:51:09.587225+0000","last_active":"2024-09-13T15:51:09.587225+0000","last_peered":"2024-09-13T15:51:09.587225+0000","last_clean":"2024-09-13T15:51:09.587225+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:51:09.587225+0000","last_undegraded":"2024-09-13T15:51:09.587225+0000","last_fullsized":"2024-09-13T15:51:09.587225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:09.586889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:09.586889+0000","last_clean_scrub_stamp":"2024-09-13T15:51:09.586889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:42.815192+0000","scrub_duration":0.0032138610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.735088+0000","last_change":"2024-09-13T15:34:35.345251+0000","last_active":"2024-09-13T15:51:06.735088+0000","last_peered":"2024-09-13T15:51:06.735088+0000","last_clean":"2024-09-13T15:51:06.735088+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:51:06.735088+0000","last_undegraded":"2024-09-13T15:51:06.735088+0000","last_fullsized":"2024-09-13T15:51:06.735088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.192716+0000","last_change":"2024-09-13T15:34:35.335400+0000","last_active":"2024-09-13T15:51:07.192716+0000","last_peered":"2024-09-13T15:51:07.192716+0000","last_clean":"2024-09-13T15:51:07.192716+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:51:07.192716+0000","last_undegraded":"2024-09-13T15:51:07.192716+0000","last_fullsized":"2024-09-13T15:51:07.192716+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:28.690653+0000","last_change":"2024-09-13T15:51:28.690653+0000","last_active":"2024-09-13T15:51:28.690653+0000","last_peered":"2024-09-13T15:51:28.690653+0000","last_clean":"2024-09-13T15:51:28.690653+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:51:28.690653+0000","last_undegraded":"2024-09-13T15:51:28.690653+0000","last_fullsized":"2024-09-13T15:51:28.690653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:28.690380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:28.690380+0000","last_clean_scrub_stamp":"2024-09-13T15:51:28.690380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:46.825165+0000","scrub_duration":0.0029361040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:27.608345+0000","last_change":"2024-09-13T15:52:27.608569+0000","last_active":"2024-09-13T15:52:27.608345+0000","last_peered":"2024-09-13T15:52:27.608345+0000","last_clean":"2024-09-13T15:52:27.608345+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:52:27.608345+0000","last_undegraded":"2024-09-13T15:52:27.608345+0000","last_fullsized":"2024-09-13T15:52:27.608345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:27.608290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:27.608290+0000","last_clean_scrub_stamp":"2024-09-13T15:52:27.608290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:43.139410+0000","scrub_duration":0.0032251570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.280037+0000","last_change":"2024-09-13T15:34:35.327922+0000","last_active":"2024-09-13T15:51:06.280037+0000","last_peered":"2024-09-13T15:51:06.280037+0000","last_clean":"2024-09-13T15:51:06.280037+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:51:06.280037+0000","last_undegraded":"2024-09-13T15:51:06.280037+0000","last_fullsized":"2024-09-13T15:51:06.280037+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:03.115070+0000","last_change":"2024-09-13T15:34:35.330864+0000","last_active":"2024-09-13T15:51:03.115070+0000","last_peered":"2024-09-13T15:51:03.115070+0000","last_clean":"2024-09-13T15:51:03.115070+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:51:03.115070+0000","last_undegraded":"2024-09-13T15:51:03.115070+0000","last_fullsized":"2024-09-13T15:51:03.115070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.280073+0000","last_change":"2024-09-13T15:34:35.324580+0000","last_active":"2024-09-13T15:51:06.280073+0000","last_peered":"2024-09-13T15:51:06.280073+0000","last_clean":"2024-09-13T15:51:06.280073+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:51:06.280073+0000","last_undegraded":"2024-09-13T15:51:06.280073+0000","last_fullsized":"2024-09-13T15:51:06.280073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.735041+0000","last_change":"2024-09-13T15:34:35.329279+0000","last_active":"2024-09-13T15:51:06.735041+0000","last_peered":"2024-09-13T15:51:06.735041+0000","last_clean":"2024-09-13T15:51:06.735041+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:51:06.735041+0000","last_undegraded":"2024-09-13T15:51:06.735041+0000","last_fullsized":"2024-09-13T15:51:06.735041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.280137+0000","last_change":"2024-09-13T15:34:35.347293+0000","last_active":"2024-09-13T15:51:06.280137+0000","last_peered":"2024-09-13T15:51:06.280137+0000","last_clean":"2024-09-13T15:51:06.280137+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:51:06.280137+0000","last_undegraded":"2024-09-13T15:51:06.280137+0000","last_fullsized":"2024-09-13T15:51:06.280137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3436,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66,"ondisk_log_size":66,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738588,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99880,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94271960,"statfs":{"total":96636764160,"available":96534487040,"internally_reserved":0,"allocated":688128,"data_stored":300221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:51:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.49299999999999999,"15min":0.438},"min":{"1min":0.29999999999999999,"5min":0.20499999999999999,"15min":0.152},"max":{"1min":0.77600000000000002,"5min":0.83899999999999997,"15min":3.4550000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.47199999999999998},"min":{"1min":0.29299999999999998,"5min":0.248,"15min":0.18099999999999999},"max":{"1min":0.69799999999999995,"5min":0.97499999999999998,"15min":6.1989999999999998},"last":0.52200000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:51:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.46899999999999997},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.185},"max":{"1min":0.66000000000000003,"5min":1.006,"15min":1.4790000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56599999999999995,"15min":0.505},"min":{"1min":0.376,"5min":0.30299999999999999,"15min":0.17799999999999999},"max":{"1min":0.74099999999999999,"5min":1.0589999999999999,"15min":1.399},"last":0.45900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738587,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148852,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":94222988,"statfs":{"total":96636764160,"available":96484339712,"internally_reserved":0,"allocated":1290240,"data_stored":891249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:51:59 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47099999999999997,"15min":0.40899999999999997},"min":{"1min":0.32600000000000001,"5min":0.26700000000000002,"15min":0.159},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.89900000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52500000000000002,"15min":0.44400000000000001},"min":{"1min":0.29099999999999998,"5min":0.20399999999999999,"15min":0.17599999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64100000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:51:59 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53300000000000003,"15min":0.45000000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.17199999999999999},"max":{"1min":0.65100000000000002,"5min":0.748,"15min":0.82999999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.495},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.19400000000000001},"max":{"1min":0.68899999999999995,"5min":0.93000000000000005,"15min":1.2789999999999999},"last":0.60699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738589,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":158696,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94213144,"statfs":{"total":96636764160,"available":96474259456,"internally_reserved":0,"allocated":1277952,"data_stored":888575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":161216966},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:51:59 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.495,"15min":0.41899999999999998},"min":{"1min":0.39700000000000002,"5min":0.20399999999999999,"15min":0.158},"max":{"1min":0.76000000000000001,"5min":0.80900000000000005,"15min":0.873},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51700000000000002,"15min":0.438},"min":{"1min":0.45800000000000002,"5min":0.215,"15min":0.186},"max":{"1min":0.65000000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:51:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54700000000000004,"15min":0.496},"min":{"1min":0.47499999999999998,"5min":0.252,"15min":0.17899999999999999},"max":{"1min":0.66300000000000003,"5min":0.82099999999999995,"15min":9.4610000000000003},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.5},"min":{"1min":0.52400000000000002,"5min":0.245,"15min":0.20300000000000001},"max":{"1min":0.755,"5min":0.82099999999999995,"15min":0.90700000000000003},"last":0.56299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:52:28.955 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T15:34:33.891919+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=33, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.956 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.956 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.956 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.956 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.957 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.957 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.957 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.957 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.957 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.957 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.958 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.958 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.958 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.958 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.958 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:28.958 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T15:52:31.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:52:48.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:52:49.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.094+0000 7f449acc3640 1 Processor -- start 2024-09-13T15:52:49.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.094+0000 7f449acc3640 1 -- start start 2024-09-13T15:52:49.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.094+0000 7f449acc3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f44940b8910 0x7f449406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:49.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.094+0000 7f449acc3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44940be820 con 0x7f44940b8530 2024-09-13T15:52:49.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.094+0000 7f449acc3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4494153940 con 0x7f44940b8910 2024-09-13T15:52:49.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.094+0000 7f4498a5f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f44940b8530 0x7f449406f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35560/0 (socket says 172.21.15.40:35560) 2024-09-13T15:52:49.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.094+0000 7f4498a5f640 1 -- 172.21.15.40:0/119867775 learned_addr learned my addr 172.21.15.40:0/119867775 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:52:49.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.094+0000 7f4493fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f44940b8910 0x7f449406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:49.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.094+0000 7f4493fff640 1 -- 172.21.15.40:0/119867775 >> v1:172.21.15.40:6789/0 conn(0x7f44940b8530 legacy=0x7f449406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:49.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.094+0000 7f4493fff640 1 -- 172.21.15.40:0/119867775 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940c1290 con 0x7f44940b8910 2024-09-13T15:52:49.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f4493fff640 1 --2- 172.21.15.40:0/119867775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44940b8910 0x7f449406e4d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f447c009740 tx=0x7f447c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47ffb56ea9f969c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:49.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f44937fe640 1 -- 172.21.15.40:0/119867775 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f447c0ab530 con 0x7f44940b8910 2024-09-13T15:52:49.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f44937fe640 1 -- 172.21.15.40:0/119867775 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c0a7050 con 0x7f44940b8910 2024-09-13T15:52:49.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f44937fe640 1 -- 172.21.15.40:0/119867775 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f447c0ab7e0 con 0x7f44940b8910 2024-09-13T15:52:49.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f449acc3640 1 -- 172.21.15.40:0/119867775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44940b8910 msgr2=0x7f449406e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:49.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f449acc3640 1 --2- 172.21.15.40:0/119867775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44940b8910 0x7f449406e4d0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f447c009740 tx=0x7f447c01c420 comp rx=0 tx=0).stop 2024-09-13T15:52:49.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f449acc3640 1 -- 172.21.15.40:0/119867775 shutdown_connections 2024-09-13T15:52:49.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f449acc3640 1 --2- 172.21.15.40:0/119867775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44940b8910 0x7f449406e4d0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:49.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f449acc3640 1 -- 172.21.15.40:0/119867775 >> 172.21.15.40:0/119867775 conn(0x7f449406a540 msgr2=0x7f44940a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:52:49.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f449acc3640 1 -- 172.21.15.40:0/119867775 shutdown_connections 2024-09-13T15:52:49.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f449acc3640 1 -- 172.21.15.40:0/119867775 wait complete. 2024-09-13T15:52:49.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f449acc3640 1 Processor -- start 2024-09-13T15:52:49.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f449acc3640 1 -- start start 2024-09-13T15:52:49.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f449acc3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44940b8530 0x7f4494154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:49.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f449acc3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494155490 con 0x7f44940b8530 2024-09-13T15:52:49.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f4498a5f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44940b8530 0x7f4494154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:49.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f4498a5f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44940b8530 0x7f4494154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:48744/0 (socket says 172.21.15.40:48744) 2024-09-13T15:52:49.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.098+0000 7f4498a5f640 1 -- 172.21.15.40:0/892487583 learned_addr learned my addr 172.21.15.40:0/892487583 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:52:49.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f4498a5f640 1 -- 172.21.15.40:0/892487583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c009420 con 0x7f44940b8530 2024-09-13T15:52:49.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f4498a5f640 1 --2- 172.21.15.40:0/892487583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44940b8530 0x7f4494154f50 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f448400c480 tx=0x7f448400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:49.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f44917fa640 1 -- 172.21.15.40:0/892487583 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4484005c20 con 0x7f44940b8530 2024-09-13T15:52:49.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f44917fa640 1 -- 172.21.15.40:0/892487583 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4484005d80 con 0x7f44940b8530 2024-09-13T15:52:49.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f449acc3640 1 -- 172.21.15.40:0/892487583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4494157400 con 0x7f44940b8530 2024-09-13T15:52:49.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f44917fa640 1 -- 172.21.15.40:0/892487583 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44840071a0 con 0x7f44940b8530 2024-09-13T15:52:49.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f449acc3640 1 -- 172.21.15.40:0/892487583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44941ec550 con 0x7f44940b8530 2024-09-13T15:52:49.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f44917fa640 1 -- 172.21.15.40:0/892487583 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f4484007300 con 0x7f44940b8530 2024-09-13T15:52:49.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f449acc3640 1 -- 172.21.15.40:0/892487583 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44940c0000 con 0x7f44940b8530 2024-09-13T15:52:49.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f44917fa640 1 --2- 172.21.15.40:0/892487583 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4474035530 0x7f44740379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:52:49.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f44917fa640 1 -- 172.21.15.40:0/892487583 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f44840472b0 con 0x7f44940b8530 2024-09-13T15:52:49.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f4493fff640 1 --2- 172.21.15.40:0/892487583 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4474035530 0x7f44740379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:52:49.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.102+0000 7f4493fff640 1 --2- 172.21.15.40:0/892487583 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4474035530 0x7f44740379f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f447c0ad000 tx=0x7f447c0a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:52:49.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.106+0000 7f44917fa640 1 -- 172.21.15.40:0/892487583 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f448401b3b0 con 0x7f44940b8530 2024-09-13T15:52:49.266 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.262+0000 7f449acc3640 1 -- 172.21.15.40:0/892487583 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4494153e80 con 0x7f4474035530 2024-09-13T15:52:49.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.282+0000 7f44917fa640 1 -- 172.21.15.40:0/892487583 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251468 (secure 0 0 0) 0x7f447c0ab5e0 con 0x7f4474035530 2024-09-13T15:52:49.285 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:52:49.287 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:52:49.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.286+0000 7f449acc3640 1 -- 172.21.15.40:0/892487583 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4474035530 msgr2=0x7f44740379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:49.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.286+0000 7f449acc3640 1 --2- 172.21.15.40:0/892487583 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4474035530 0x7f44740379f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f447c0ad000 tx=0x7f447c0a6000 comp rx=0 tx=0).stop 2024-09-13T15:52:49.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.286+0000 7f449acc3640 1 -- 172.21.15.40:0/892487583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44940b8530 msgr2=0x7f4494154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:52:49.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.286+0000 7f449acc3640 1 --2- 172.21.15.40:0/892487583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44940b8530 0x7f4494154f50 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f448400c480 tx=0x7f448400c940 comp rx=0 tx=0).stop 2024-09-13T15:52:49.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.286+0000 7f449acc3640 1 -- 172.21.15.40:0/892487583 shutdown_connections 2024-09-13T15:52:49.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.286+0000 7f449acc3640 1 --2- 172.21.15.40:0/892487583 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f4474035530 0x7f44740379f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:49.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.286+0000 7f449acc3640 1 --2- 172.21.15.40:0/892487583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f44940b8530 0x7f4494154f50 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:52:49.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.286+0000 7f449acc3640 1 -- 172.21.15.40:0/892487583 >> 172.21.15.40:0/892487583 conn(0x7f449406a540 msgr2=0x7f44940bcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:52:49.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.286+0000 7f449acc3640 1 -- 172.21.15.40:0/892487583 shutdown_connections 2024-09-13T15:52:49.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:52:49.286+0000 7f449acc3640 1 -- 172.21.15.40:0/892487583 wait complete. 2024-09-13T15:52:49.303 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":507,"stamp":"2024-09-13T15:52:47.883484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593804,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":208,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":407428,"kb_used_data":3180,"kb_used_omap":4,"kb_used_meta":404219,"kb_avail":282708092,"statfs":{"total":289910292480,"available":289493086208,"internally_reserved":0,"allocated":3256320,"data_stored":2080045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":413920594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004114"},"pg_stats":[{"pgid":"2.1f","version":"58'6","reported_seq":79,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:00.925214+0000","last_change":"2024-09-13T15:52:00.925433+0000","last_active":"2024-09-13T15:52:00.925214+0000","last_peered":"2024-09-13T15:52:00.925214+0000","last_clean":"2024-09-13T15:52:00.925214+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:52:00.925214+0000","last_undegraded":"2024-09-13T15:52:00.925214+0000","last_fullsized":"2024-09-13T15:52:00.925214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'6","last_scrub_stamp":"2024-09-13T15:52:00.925158+0000","last_deep_scrub":"58'6","last_deep_scrub_stamp":"2024-09-13T15:52:00.925158+0000","last_clean_scrub_stamp":"2024-09-13T15:52:00.925158+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:56.612520+0000","scrub_duration":0.0072895659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:22.675350+0000","last_change":"2024-09-13T15:51:22.675350+0000","last_active":"2024-09-13T15:51:22.675350+0000","last_peered":"2024-09-13T15:51:22.675350+0000","last_clean":"2024-09-13T15:51:22.675350+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:51:22.675350+0000","last_undegraded":"2024-09-13T15:51:22.675350+0000","last_fullsized":"2024-09-13T15:51:22.675350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:22.675078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:22.675078+0000","last_clean_scrub_stamp":"2024-09-13T15:51:22.675078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:11.304477+0000","scrub_duration":0.002879932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:47.519523+0000","last_change":"2024-09-13T15:51:47.519523+0000","last_active":"2024-09-13T15:51:47.519523+0000","last_peered":"2024-09-13T15:51:47.519523+0000","last_clean":"2024-09-13T15:51:47.519523+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:51:47.519523+0000","last_undegraded":"2024-09-13T15:51:47.519523+0000","last_fullsized":"2024-09-13T15:51:47.519523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-13T15:51:47.519216+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-09-13T15:51:47.519216+0000","last_clean_scrub_stamp":"2024-09-13T15:51:47.519216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:40.760952+0000","scrub_duration":0.0029653919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:08.926430+0000","last_change":"2024-09-13T15:52:08.926656+0000","last_active":"2024-09-13T15:52:08.926430+0000","last_peered":"2024-09-13T15:52:08.926430+0000","last_clean":"2024-09-13T15:52:08.926430+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:52:08.926430+0000","last_undegraded":"2024-09-13T15:52:08.926430+0000","last_fullsized":"2024-09-13T15:52:08.926430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:08.926380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:08.926380+0000","last_clean_scrub_stamp":"2024-09-13T15:52:08.926380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:08.969015+0000","scrub_duration":0.0030086520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"58'3","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:21.975274+0000","last_change":"2024-09-13T15:52:21.975506+0000","last_active":"2024-09-13T15:52:21.975274+0000","last_peered":"2024-09-13T15:52:21.975274+0000","last_clean":"2024-09-13T15:52:21.975274+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:52:21.975274+0000","last_undegraded":"2024-09-13T15:52:21.975274+0000","last_fullsized":"2024-09-13T15:52:21.975274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:21.975219+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:21.975219+0000","last_clean_scrub_stamp":"2024-09-13T15:52:21.975219+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:53.668027+0000","scrub_duration":0.0060361980000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:58.792615+0000","last_change":"2024-09-13T15:51:58.792615+0000","last_active":"2024-09-13T15:51:58.792615+0000","last_peered":"2024-09-13T15:51:58.792615+0000","last_clean":"2024-09-13T15:51:58.792615+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:51:58.792615+0000","last_undegraded":"2024-09-13T15:51:58.792615+0000","last_fullsized":"2024-09-13T15:51:58.792615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:58.792356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:58.792356+0000","last_clean_scrub_stamp":"2024-09-13T15:51:58.792356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:54.479718+0000","scrub_duration":0.0030650410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"58'3","reported_seq":65,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:36.534737+0000","last_change":"2024-09-13T15:52:36.534966+0000","last_active":"2024-09-13T15:52:36.534737+0000","last_peered":"2024-09-13T15:52:36.534737+0000","last_clean":"2024-09-13T15:52:36.534737+0000","last_became_active":"2024-09-13T15:35:20.165658+0000","last_became_peered":"2024-09-13T15:35:20.165658+0000","last_unstale":"2024-09-13T15:52:36.534737+0000","last_undegraded":"2024-09-13T15:52:36.534737+0000","last_fullsized":"2024-09-13T15:52:36.534737+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:36.534681+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:36.534681+0000","last_clean_scrub_stamp":"2024-09-13T15:52:36.534681+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:34.352689+0000","scrub_duration":0.0061760349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:39.648291+0000","last_change":"2024-09-13T15:51:39.648291+0000","last_active":"2024-09-13T15:51:39.648291+0000","last_peered":"2024-09-13T15:51:39.648291+0000","last_clean":"2024-09-13T15:51:39.648291+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:51:39.648291+0000","last_undegraded":"2024-09-13T15:51:39.648291+0000","last_fullsized":"2024-09-13T15:51:39.648291+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:39.647966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:39.647966+0000","last_clean_scrub_stamp":"2024-09-13T15:51:39.647966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:57.782751+0000","scrub_duration":0.0028655859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:39.860860+0000","last_change":"2024-09-13T15:51:39.860860+0000","last_active":"2024-09-13T15:51:39.860860+0000","last_peered":"2024-09-13T15:51:39.860860+0000","last_clean":"2024-09-13T15:51:39.860860+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:51:39.860860+0000","last_undegraded":"2024-09-13T15:51:39.860860+0000","last_fullsized":"2024-09-13T15:51:39.860860+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:39.860518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:39.860518+0000","last_clean_scrub_stamp":"2024-09-13T15:51:39.860518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:23.434457+0000","scrub_duration":0.0030233840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.b","version":"58'3","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:15.024349+0000","last_change":"2024-09-13T15:52:15.024349+0000","last_active":"2024-09-13T15:52:15.024349+0000","last_peered":"2024-09-13T15:52:15.024349+0000","last_clean":"2024-09-13T15:52:15.024349+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:52:15.024349+0000","last_undegraded":"2024-09-13T15:52:15.024349+0000","last_fullsized":"2024-09-13T15:52:15.024349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:15.024036+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:15.024036+0000","last_clean_scrub_stamp":"2024-09-13T15:52:15.024036+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:39.808527+0000","scrub_duration":0.0057298569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:41.947387+0000","last_change":"2024-09-13T15:51:41.947387+0000","last_active":"2024-09-13T15:51:41.947387+0000","last_peered":"2024-09-13T15:51:41.947387+0000","last_clean":"2024-09-13T15:51:41.947387+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:51:41.947387+0000","last_undegraded":"2024-09-13T15:51:41.947387+0000","last_fullsized":"2024-09-13T15:51:41.947387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:41.947053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:41.947053+0000","last_clean_scrub_stamp":"2024-09-13T15:51:41.947053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:08.395633+0000","scrub_duration":0.0028106099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:11.761645+0000","last_change":"2024-09-13T15:52:11.761861+0000","last_active":"2024-09-13T15:52:11.761645+0000","last_peered":"2024-09-13T15:52:11.761645+0000","last_clean":"2024-09-13T15:52:11.761645+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:52:11.761645+0000","last_undegraded":"2024-09-13T15:52:11.761645+0000","last_fullsized":"2024-09-13T15:52:11.761645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:11.761591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:11.761591+0000","last_clean_scrub_stamp":"2024-09-13T15:52:11.761591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:27.292711+0000","scrub_duration":0.002907158,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.604941+0000","last_change":"2024-09-13T15:51:42.604941+0000","last_active":"2024-09-13T15:51:42.604941+0000","last_peered":"2024-09-13T15:51:42.604941+0000","last_clean":"2024-09-13T15:51:42.604941+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:51:42.604941+0000","last_undegraded":"2024-09-13T15:51:42.604941+0000","last_fullsized":"2024-09-13T15:51:42.604941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:42.604669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:42.604669+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.604669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:36.719016+0000","scrub_duration":0.0029141129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:06.735540+0000","last_change":"2024-09-13T15:52:06.735763+0000","last_active":"2024-09-13T15:52:06.735540+0000","last_peered":"2024-09-13T15:52:06.735540+0000","last_clean":"2024-09-13T15:52:06.735540+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:52:06.735540+0000","last_undegraded":"2024-09-13T15:52:06.735540+0000","last_fullsized":"2024-09-13T15:52:06.735540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:06.735489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:06.735489+0000","last_clean_scrub_stamp":"2024-09-13T15:52:06.735489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:06.778123+0000","scrub_duration":0.0029280899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:37.836156+0000","last_change":"2024-09-13T15:51:37.836156+0000","last_active":"2024-09-13T15:51:37.836156+0000","last_peered":"2024-09-13T15:51:37.836156+0000","last_clean":"2024-09-13T15:51:37.836156+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:51:37.836156+0000","last_undegraded":"2024-09-13T15:51:37.836156+0000","last_fullsized":"2024-09-13T15:51:37.836156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:37.835829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:37.835829+0000","last_clean_scrub_stamp":"2024-09-13T15:51:37.835829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.328337+0000","scrub_duration":0.0028480789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:13.998133+0000","last_change":"2024-09-13T15:52:13.998423+0000","last_active":"2024-09-13T15:52:13.998133+0000","last_peered":"2024-09-13T15:52:13.998133+0000","last_clean":"2024-09-13T15:52:13.998133+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:52:13.998133+0000","last_undegraded":"2024-09-13T15:52:13.998133+0000","last_fullsized":"2024-09-13T15:52:13.998133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:13.998078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:13.998078+0000","last_clean_scrub_stamp":"2024-09-13T15:52:13.998078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:29.529198+0000","scrub_duration":0.0029036449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:49.022056+0000","last_change":"2024-09-13T15:51:49.022056+0000","last_active":"2024-09-13T15:51:49.022056+0000","last_peered":"2024-09-13T15:51:49.022056+0000","last_clean":"2024-09-13T15:51:49.022056+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:51:49.022056+0000","last_undegraded":"2024-09-13T15:51:49.022056+0000","last_fullsized":"2024-09-13T15:51:49.022056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:49.021803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:49.021803+0000","last_clean_scrub_stamp":"2024-09-13T15:51:49.021803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:25.975161+0000","scrub_duration":0.0028090350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"58'3","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:19.734221+0000","last_change":"2024-09-13T15:52:19.734430+0000","last_active":"2024-09-13T15:52:19.734221+0000","last_peered":"2024-09-13T15:52:19.734221+0000","last_clean":"2024-09-13T15:52:19.734221+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:52:19.734221+0000","last_undegraded":"2024-09-13T15:52:19.734221+0000","last_fullsized":"2024-09-13T15:52:19.734221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:19.734162+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:19.734162+0000","last_clean_scrub_stamp":"2024-09-13T15:52:19.734162+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:17.552169+0000","scrub_duration":0.0056413829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:11.573279+0000","last_change":"2024-09-13T15:51:11.573279+0000","last_active":"2024-09-13T15:51:11.573279+0000","last_peered":"2024-09-13T15:51:11.573279+0000","last_clean":"2024-09-13T15:51:11.573279+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:51:11.573279+0000","last_undegraded":"2024-09-13T15:51:11.573279+0000","last_fullsized":"2024-09-13T15:51:11.573279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:11.572987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:11.572987+0000","last_clean_scrub_stamp":"2024-09-13T15:51:11.572987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:21.045297+0000","scrub_duration":0.0030285730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"58'2","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:16.655350+0000","last_change":"2024-09-13T15:52:16.655582+0000","last_active":"2024-09-13T15:52:16.655350+0000","last_peered":"2024-09-13T15:52:16.655350+0000","last_clean":"2024-09-13T15:52:16.655350+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:52:16.655350+0000","last_undegraded":"2024-09-13T15:52:16.655350+0000","last_fullsized":"2024-09-13T15:52:16.655350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-13T15:52:16.655296+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-13T15:52:16.655296+0000","last_clean_scrub_stamp":"2024-09-13T15:52:16.655296+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:54.785663+0000","scrub_duration":0.0061258019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:10.000654+0000","last_change":"2024-09-13T15:51:10.000654+0000","last_active":"2024-09-13T15:51:10.000654+0000","last_peered":"2024-09-13T15:51:10.000654+0000","last_clean":"2024-09-13T15:51:10.000654+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:51:10.000654+0000","last_undegraded":"2024-09-13T15:51:10.000654+0000","last_fullsized":"2024-09-13T15:51:10.000654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:10.000340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:10.000340+0000","last_clean_scrub_stamp":"2024-09-13T15:51:10.000340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.854008+0000","scrub_duration":0.0030965559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:15.701497+0000","last_change":"2024-09-13T15:52:15.701711+0000","last_active":"2024-09-13T15:52:15.701497+0000","last_peered":"2024-09-13T15:52:15.701497+0000","last_clean":"2024-09-13T15:52:15.701497+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:52:15.701497+0000","last_undegraded":"2024-09-13T15:52:15.701497+0000","last_fullsized":"2024-09-13T15:52:15.701497+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:15.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:15.701448+0000","last_clean_scrub_stamp":"2024-09-13T15:52:15.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:09.871999+0000","scrub_duration":0.0031982540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:08.634807+0000","last_change":"2024-09-13T15:51:08.634807+0000","last_active":"2024-09-13T15:51:08.634807+0000","last_peered":"2024-09-13T15:51:08.634807+0000","last_clean":"2024-09-13T15:51:08.634807+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:51:08.634807+0000","last_undegraded":"2024-09-13T15:51:08.634807+0000","last_fullsized":"2024-09-13T15:51:08.634807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:08.634488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:08.634488+0000","last_clean_scrub_stamp":"2024-09-13T15:51:08.634488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:29.659635+0000","scrub_duration":0.0033577189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:12.742813+0000","last_change":"2024-09-13T15:52:12.743022+0000","last_active":"2024-09-13T15:52:12.742813+0000","last_peered":"2024-09-13T15:52:12.742813+0000","last_clean":"2024-09-13T15:52:12.742813+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:52:12.742813+0000","last_undegraded":"2024-09-13T15:52:12.742813+0000","last_fullsized":"2024-09-13T15:52:12.742813+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:12.742764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:12.742764+0000","last_clean_scrub_stamp":"2024-09-13T15:52:12.742764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:37.527255+0000","scrub_duration":0.0029269640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:43.932444+0000","last_change":"2024-09-13T15:51:43.932667+0000","last_active":"2024-09-13T15:51:43.932444+0000","last_peered":"2024-09-13T15:51:43.932444+0000","last_clean":"2024-09-13T15:51:43.932444+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:51:43.932444+0000","last_undegraded":"2024-09-13T15:51:43.932444+0000","last_fullsized":"2024-09-13T15:51:43.932444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:43.932395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:43.932395+0000","last_clean_scrub_stamp":"2024-09-13T15:51:43.932395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:50.418406+0000","scrub_duration":0.0030891629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:22.935326+0000","last_change":"2024-09-13T15:52:22.935577+0000","last_active":"2024-09-13T15:52:22.935326+0000","last_peered":"2024-09-13T15:52:22.935326+0000","last_clean":"2024-09-13T15:52:22.935326+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:52:22.935326+0000","last_undegraded":"2024-09-13T15:52:22.935326+0000","last_fullsized":"2024-09-13T15:52:22.935326+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:22.935273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:22.935273+0000","last_clean_scrub_stamp":"2024-09-13T15:52:22.935273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:32.208431+0000","scrub_duration":0.002821306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:34.985088+0000","last_change":"2024-09-13T15:51:34.985088+0000","last_active":"2024-09-13T15:51:34.985088+0000","last_peered":"2024-09-13T15:51:34.985088+0000","last_clean":"2024-09-13T15:51:34.985088+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:51:34.985088+0000","last_undegraded":"2024-09-13T15:51:34.985088+0000","last_fullsized":"2024-09-13T15:51:34.985088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:34.984821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:34.984821+0000","last_clean_scrub_stamp":"2024-09-13T15:51:34.984821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:43.477329+0000","scrub_duration":0.0030114199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:59.489759+0000","last_change":"2024-09-13T15:51:59.489969+0000","last_active":"2024-09-13T15:51:59.489759+0000","last_peered":"2024-09-13T15:51:59.489759+0000","last_clean":"2024-09-13T15:51:59.489759+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:51:59.489759+0000","last_undegraded":"2024-09-13T15:51:59.489759+0000","last_fullsized":"2024-09-13T15:51:59.489759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:59.489693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:59.489693+0000","last_clean_scrub_stamp":"2024-09-13T15:51:59.489693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:42.511558+0000","scrub_duration":0.0029566660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:56.928710+0000","last_change":"2024-09-13T15:51:56.928926+0000","last_active":"2024-09-13T15:51:56.928710+0000","last_peered":"2024-09-13T15:51:56.928710+0000","last_clean":"2024-09-13T15:51:56.928710+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:51:56.928710+0000","last_undegraded":"2024-09-13T15:51:56.928710+0000","last_fullsized":"2024-09-13T15:51:56.928710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:56.928661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:56.928661+0000","last_clean_scrub_stamp":"2024-09-13T15:51:56.928661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:27.237108+0000","scrub_duration":0.0029743360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:48.563977+0000","last_change":"2024-09-13T15:51:48.563977+0000","last_active":"2024-09-13T15:51:48.563977+0000","last_peered":"2024-09-13T15:51:48.563977+0000","last_clean":"2024-09-13T15:51:48.563977+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:51:48.563977+0000","last_undegraded":"2024-09-13T15:51:48.563977+0000","last_fullsized":"2024-09-13T15:51:48.563977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:48.563689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:48.563689+0000","last_clean_scrub_stamp":"2024-09-13T15:51:48.563689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:57.056198+0000","scrub_duration":0.0028270109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:28.063597+0000","last_change":"2024-09-13T15:51:28.063807+0000","last_active":"2024-09-13T15:51:28.063597+0000","last_peered":"2024-09-13T15:51:28.063597+0000","last_clean":"2024-09-13T15:51:28.063597+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:51:28.063597+0000","last_undegraded":"2024-09-13T15:51:28.063597+0000","last_fullsized":"2024-09-13T15:51:28.063597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:28.063549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:28.063549+0000","last_clean_scrub_stamp":"2024-09-13T15:51:28.063549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:22.177895+0000","scrub_duration":0.0027253830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:09.786228+0000","last_change":"2024-09-13T15:52:09.786444+0000","last_active":"2024-09-13T15:52:09.786228+0000","last_peered":"2024-09-13T15:52:09.786228+0000","last_clean":"2024-09-13T15:52:09.786228+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:52:09.786228+0000","last_undegraded":"2024-09-13T15:52:09.786228+0000","last_fullsized":"2024-09-13T15:52:09.786228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:09.786175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:09.786175+0000","last_clean_scrub_stamp":"2024-09-13T15:52:09.786175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:43.684744+0000","scrub_duration":0.002697287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"58'110","reported_seq":245,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:01.776195+0000","last_change":"2024-09-13T15:52:01.776195+0000","last_active":"2024-09-13T15:52:01.776195+0000","last_peered":"2024-09-13T15:52:01.776195+0000","last_clean":"2024-09-13T15:52:01.776195+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:52:01.776195+0000","last_undegraded":"2024-09-13T15:52:01.776195+0000","last_fullsized":"2024-09-13T15:52:01.776195+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'110","last_scrub_stamp":"2024-09-13T15:52:01.775864+0000","last_deep_scrub":"58'110","last_deep_scrub_stamp":"2024-09-13T15:52:01.775864+0000","last_clean_scrub_stamp":"2024-09-13T15:52:01.775864+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:06.410483+0000","scrub_duration":0.0095732660000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:09.023040+0000","last_change":"2024-09-13T15:51:09.023040+0000","last_active":"2024-09-13T15:51:09.023040+0000","last_peered":"2024-09-13T15:51:09.023040+0000","last_clean":"2024-09-13T15:51:09.023040+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:51:09.023040+0000","last_undegraded":"2024-09-13T15:51:09.023040+0000","last_fullsized":"2024-09-13T15:51:09.023040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:09.022780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:09.022780+0000","last_clean_scrub_stamp":"2024-09-13T15:51:09.022780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:57.652179+0000","scrub_duration":0.0027795350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:53.492836+0000","last_change":"2024-09-13T15:51:53.492836+0000","last_active":"2024-09-13T15:51:53.492836+0000","last_peered":"2024-09-13T15:51:53.492836+0000","last_clean":"2024-09-13T15:51:53.492836+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:51:53.492836+0000","last_undegraded":"2024-09-13T15:51:53.492836+0000","last_fullsized":"2024-09-13T15:51:53.492836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:53.492570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:53.492570+0000","last_clean_scrub_stamp":"2024-09-13T15:51:53.492570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:19.941150+0000","scrub_duration":0.0029359529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:36.814917+0000","last_change":"2024-09-13T15:51:36.814917+0000","last_active":"2024-09-13T15:51:36.814917+0000","last_peered":"2024-09-13T15:51:36.814917+0000","last_clean":"2024-09-13T15:51:36.814917+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:51:36.814917+0000","last_undegraded":"2024-09-13T15:51:36.814917+0000","last_fullsized":"2024-09-13T15:51:36.814917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:36.814631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:36.814631+0000","last_clean_scrub_stamp":"2024-09-13T15:51:36.814631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:30.056367+0000","scrub_duration":0.0030192740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"58'2","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:59.782573+0000","last_change":"2024-09-13T15:51:59.782573+0000","last_active":"2024-09-13T15:51:59.782573+0000","last_peered":"2024-09-13T15:51:59.782573+0000","last_clean":"2024-09-13T15:51:59.782573+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:51:59.782573+0000","last_undegraded":"2024-09-13T15:51:59.782573+0000","last_fullsized":"2024-09-13T15:51:59.782573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-13T15:51:59.782304+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-13T15:51:59.782304+0000","last_clean_scrub_stamp":"2024-09-13T15:51:59.782304+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:01.886087+0000","scrub_duration":0.0062355980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:48.041512+0000","last_change":"2024-09-13T15:51:48.041512+0000","last_active":"2024-09-13T15:51:48.041512+0000","last_peered":"2024-09-13T15:51:48.041512+0000","last_clean":"2024-09-13T15:51:48.041512+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:51:48.041512+0000","last_undegraded":"2024-09-13T15:51:48.041512+0000","last_fullsized":"2024-09-13T15:51:48.041512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:48.041303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:48.041303+0000","last_clean_scrub_stamp":"2024-09-13T15:51:48.041303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:50.423013+0000","scrub_duration":0.001557817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"58'3","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:12.473201+0000","last_change":"2024-09-13T15:52:12.473201+0000","last_active":"2024-09-13T15:52:12.473201+0000","last_peered":"2024-09-13T15:52:12.473201+0000","last_clean":"2024-09-13T15:52:12.473201+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:52:12.473201+0000","last_undegraded":"2024-09-13T15:52:12.473201+0000","last_fullsized":"2024-09-13T15:52:12.473201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:12.472917+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:12.472917+0000","last_clean_scrub_stamp":"2024-09-13T15:52:12.472917+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:34.717523+0000","scrub_duration":0.0060779959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:20.704937+0000","last_change":"2024-09-13T15:51:20.704937+0000","last_active":"2024-09-13T15:51:20.704937+0000","last_peered":"2024-09-13T15:51:20.704937+0000","last_clean":"2024-09-13T15:51:20.704937+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:51:20.704937+0000","last_undegraded":"2024-09-13T15:51:20.704937+0000","last_fullsized":"2024-09-13T15:51:20.704937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:20.704675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:20.704675+0000","last_clean_scrub_stamp":"2024-09-13T15:51:20.704675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:41.029516+0000","scrub_duration":0.0028536220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"58'2","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:19.049433+0000","last_change":"2024-09-13T15:52:19.049433+0000","last_active":"2024-09-13T15:52:19.049433+0000","last_peered":"2024-09-13T15:52:19.049433+0000","last_clean":"2024-09-13T15:52:19.049433+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:52:19.049433+0000","last_undegraded":"2024-09-13T15:52:19.049433+0000","last_fullsized":"2024-09-13T15:52:19.049433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-13T15:52:19.049070+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-13T15:52:19.049070+0000","last_clean_scrub_stamp":"2024-09-13T15:52:19.049070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:13.219621+0000","scrub_duration":0.0060239409999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:23.631969+0000","last_change":"2024-09-13T15:51:23.632249+0000","last_active":"2024-09-13T15:51:23.631969+0000","last_peered":"2024-09-13T15:51:23.631969+0000","last_clean":"2024-09-13T15:51:23.631969+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:51:23.631969+0000","last_undegraded":"2024-09-13T15:51:23.631969+0000","last_fullsized":"2024-09-13T15:51:23.631969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:23.631921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:23.631921+0000","last_clean_scrub_stamp":"2024-09-13T15:51:23.631921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:28.485589+0000","scrub_duration":0.0028528719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"58'12","reported_seq":84,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:54.450870+0000","last_change":"2024-09-13T15:51:54.451094+0000","last_active":"2024-09-13T15:51:54.450870+0000","last_peered":"2024-09-13T15:51:54.450870+0000","last_clean":"2024-09-13T15:51:54.450870+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:51:54.450870+0000","last_undegraded":"2024-09-13T15:51:54.450870+0000","last_fullsized":"2024-09-13T15:51:54.450870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'12","last_scrub_stamp":"2024-09-13T15:51:54.450813+0000","last_deep_scrub":"58'12","last_deep_scrub_stamp":"2024-09-13T15:51:54.450813+0000","last_clean_scrub_stamp":"2024-09-13T15:51:54.450813+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:00.936823+0000","scrub_duration":0.009138218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:26.093049+0000","last_change":"2024-09-13T15:51:26.093274+0000","last_active":"2024-09-13T15:51:26.093049+0000","last_peered":"2024-09-13T15:51:26.093049+0000","last_clean":"2024-09-13T15:51:26.093049+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:51:26.093049+0000","last_undegraded":"2024-09-13T15:51:26.093049+0000","last_fullsized":"2024-09-13T15:51:26.093049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:26.092993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:26.092993+0000","last_clean_scrub_stamp":"2024-09-13T15:51:26.092993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:44.227778+0000","scrub_duration":0.0029912200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:23.938159+0000","last_change":"2024-09-13T15:52:23.938364+0000","last_active":"2024-09-13T15:52:23.938159+0000","last_peered":"2024-09-13T15:52:23.938159+0000","last_clean":"2024-09-13T15:52:23.938159+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:52:23.938159+0000","last_undegraded":"2024-09-13T15:52:23.938159+0000","last_fullsized":"2024-09-13T15:52:23.938159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:23.938111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:23.938111+0000","last_clean_scrub_stamp":"2024-09-13T15:52:23.938111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:11.313812+0000","scrub_duration":0.002901799,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:20.688069+0000","last_change":"2024-09-13T15:52:20.688300+0000","last_active":"2024-09-13T15:52:20.688069+0000","last_peered":"2024-09-13T15:52:20.688069+0000","last_clean":"2024-09-13T15:52:20.688069+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:52:20.688069+0000","last_undegraded":"2024-09-13T15:52:20.688069+0000","last_fullsized":"2024-09-13T15:52:20.688069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:20.687995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:20.687995+0000","last_clean_scrub_stamp":"2024-09-13T15:52:20.687995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:08.063697+0000","scrub_duration":0.0030836829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:50.568853+0000","last_change":"2024-09-13T15:51:50.569089+0000","last_active":"2024-09-13T15:51:50.568853+0000","last_peered":"2024-09-13T15:51:50.568853+0000","last_clean":"2024-09-13T15:51:50.568853+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:51:50.568853+0000","last_undegraded":"2024-09-13T15:51:50.568853+0000","last_fullsized":"2024-09-13T15:51:50.568853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:50.568804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:50.568804+0000","last_clean_scrub_stamp":"2024-09-13T15:51:50.568804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:34.142743+0000","scrub_duration":0.0031469549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:33.819531+0000","last_change":"2024-09-13T15:51:33.819817+0000","last_active":"2024-09-13T15:51:33.819531+0000","last_peered":"2024-09-13T15:51:33.819531+0000","last_clean":"2024-09-13T15:51:33.819531+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:51:33.819531+0000","last_undegraded":"2024-09-13T15:51:33.819531+0000","last_fullsized":"2024-09-13T15:51:33.819531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:33.819477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:33.819477+0000","last_clean_scrub_stamp":"2024-09-13T15:51:33.819477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:21.665891+0000","scrub_duration":0.0030701579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"58'4","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:10.949624+0000","last_change":"2024-09-13T15:52:10.949879+0000","last_active":"2024-09-13T15:52:10.949624+0000","last_peered":"2024-09-13T15:52:10.949624+0000","last_clean":"2024-09-13T15:52:10.949624+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:52:10.949624+0000","last_undegraded":"2024-09-13T15:52:10.949624+0000","last_fullsized":"2024-09-13T15:52:10.949624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'4","last_scrub_stamp":"2024-09-13T15:52:10.949571+0000","last_deep_scrub":"58'4","last_deep_scrub_stamp":"2024-09-13T15:52:10.949571+0000","last_clean_scrub_stamp":"2024-09-13T15:52:10.949571+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:41.038648+0000","scrub_duration":0.0066544100000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.920706+0000","last_change":"2024-09-13T15:51:42.920918+0000","last_active":"2024-09-13T15:51:42.920706+0000","last_peered":"2024-09-13T15:51:42.920706+0000","last_clean":"2024-09-13T15:51:42.920706+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:51:42.920706+0000","last_undegraded":"2024-09-13T15:51:42.920706+0000","last_fullsized":"2024-09-13T15:51:42.920706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:42.920654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:42.920654+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.920654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:09.369234+0000","scrub_duration":0.0027763269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"58'16","reported_seq":88,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:10.408842+0000","last_change":"2024-09-13T15:52:10.409098+0000","last_active":"2024-09-13T15:52:10.408842+0000","last_peered":"2024-09-13T15:52:10.408842+0000","last_clean":"2024-09-13T15:52:10.408842+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:52:10.408842+0000","last_undegraded":"2024-09-13T15:52:10.408842+0000","last_fullsized":"2024-09-13T15:52:10.408842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'16","last_scrub_stamp":"2024-09-13T15:52:10.408789+0000","last_deep_scrub":"58'16","last_deep_scrub_stamp":"2024-09-13T15:52:10.408789+0000","last_clean_scrub_stamp":"2024-09-13T15:52:10.408789+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:40.717236+0000","scrub_duration":0.0096950700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2638,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.015505+0000","last_change":"2024-09-13T15:51:07.015632+0000","last_active":"2024-09-13T15:51:07.015505+0000","last_peered":"2024-09-13T15:51:07.015505+0000","last_clean":"2024-09-13T15:51:07.015505+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:51:07.015505+0000","last_undegraded":"2024-09-13T15:51:07.015505+0000","last_fullsized":"2024-09-13T15:51:07.015505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:07.015482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:07.015482+0000","last_clean_scrub_stamp":"2024-09-13T15:51:07.015482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:27.340322+0000","scrub_duration":0.001887321,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"58'5","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.931081+0000","last_change":"2024-09-13T15:51:42.931297+0000","last_active":"2024-09-13T15:51:42.931081+0000","last_peered":"2024-09-13T15:51:42.931081+0000","last_clean":"2024-09-13T15:51:42.931081+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:51:42.931081+0000","last_undegraded":"2024-09-13T15:51:42.931081+0000","last_fullsized":"2024-09-13T15:51:42.931081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'5","last_scrub_stamp":"2024-09-13T15:51:42.931027+0000","last_deep_scrub":"58'5","last_deep_scrub_stamp":"2024-09-13T15:51:42.931027+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.931027+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:04.378223+0000","scrub_duration":0.0069458810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:51.933694+0000","last_change":"2024-09-13T15:51:51.933959+0000","last_active":"2024-09-13T15:51:51.933694+0000","last_peered":"2024-09-13T15:51:51.933694+0000","last_clean":"2024-09-13T15:51:51.933694+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:51:51.933694+0000","last_undegraded":"2024-09-13T15:51:51.933694+0000","last_fullsized":"2024-09-13T15:51:51.933694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:51.933640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:51.933640+0000","last_clean_scrub_stamp":"2024-09-13T15:51:51.933640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:23.904863+0000","scrub_duration":0.0029495559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:21.012986+0000","last_change":"2024-09-13T15:52:21.013257+0000","last_active":"2024-09-13T15:52:21.012986+0000","last_peered":"2024-09-13T15:52:21.012986+0000","last_clean":"2024-09-13T15:52:21.012986+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:52:21.012986+0000","last_undegraded":"2024-09-13T15:52:21.012986+0000","last_fullsized":"2024-09-13T15:52:21.012986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:21.012937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:21.012937+0000","last_clean_scrub_stamp":"2024-09-13T15:52:21.012937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:59.143304+0000","scrub_duration":0.0029541960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:19.658733+0000","last_change":"2024-09-13T15:51:19.658733+0000","last_active":"2024-09-13T15:51:19.658733+0000","last_peered":"2024-09-13T15:51:19.658733+0000","last_clean":"2024-09-13T15:51:19.658733+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:51:19.658733+0000","last_undegraded":"2024-09-13T15:51:19.658733+0000","last_fullsized":"2024-09-13T15:51:19.658733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:19.658442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:19.658442+0000","last_clean_scrub_stamp":"2024-09-13T15:51:19.658442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:52.886746+0000","scrub_duration":0.0031503270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:56.835944+0000","last_change":"2024-09-13T15:51:56.836271+0000","last_active":"2024-09-13T15:51:56.835944+0000","last_peered":"2024-09-13T15:51:56.835944+0000","last_clean":"2024-09-13T15:51:56.835944+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:51:56.835944+0000","last_undegraded":"2024-09-13T15:51:56.835944+0000","last_fullsized":"2024-09-13T15:51:56.835944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:56.835893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:56.835893+0000","last_clean_scrub_stamp":"2024-09-13T15:51:56.835893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:19.080500+0000","scrub_duration":0.0030846369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:54.842266+0000","last_change":"2024-09-13T15:51:54.842471+0000","last_active":"2024-09-13T15:51:54.842266+0000","last_peered":"2024-09-13T15:51:54.842266+0000","last_clean":"2024-09-13T15:51:54.842266+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:51:54.842266+0000","last_undegraded":"2024-09-13T15:51:54.842266+0000","last_fullsized":"2024-09-13T15:51:54.842266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:54.842213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:54.842213+0000","last_clean_scrub_stamp":"2024-09-13T15:51:54.842213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:25.150660+0000","scrub_duration":0.003082988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:27.037519+0000","last_change":"2024-09-13T15:52:27.037759+0000","last_active":"2024-09-13T15:52:27.037519+0000","last_peered":"2024-09-13T15:52:27.037519+0000","last_clean":"2024-09-13T15:52:27.037519+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:52:27.037519+0000","last_undegraded":"2024-09-13T15:52:27.037519+0000","last_fullsized":"2024-09-13T15:52:27.037519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:27.037466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:27.037466+0000","last_clean_scrub_stamp":"2024-09-13T15:52:27.037466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:22.593712+0000","scrub_duration":0.0028811259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:44.659569+0000","last_change":"2024-09-13T15:51:44.659803+0000","last_active":"2024-09-13T15:51:44.659569+0000","last_peered":"2024-09-13T15:51:44.659569+0000","last_clean":"2024-09-13T15:51:44.659569+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:51:44.659569+0000","last_undegraded":"2024-09-13T15:51:44.659569+0000","last_fullsized":"2024-09-13T15:51:44.659569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:44.659519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:44.659519+0000","last_clean_scrub_stamp":"2024-09-13T15:51:44.659519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:32.505933+0000","scrub_duration":0.0028280330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:03.993268+0000","last_change":"2024-09-13T15:52:03.993484+0000","last_active":"2024-09-13T15:52:03.993268+0000","last_peered":"2024-09-13T15:52:03.993268+0000","last_clean":"2024-09-13T15:52:03.993268+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:52:03.993268+0000","last_undegraded":"2024-09-13T15:52:03.993268+0000","last_fullsized":"2024-09-13T15:52:03.993268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:03.993217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:03.993217+0000","last_clean_scrub_stamp":"2024-09-13T15:52:03.993217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:08.627836+0000","scrub_duration":0.0029228980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:14.409834+0000","last_change":"2024-09-13T15:52:14.410059+0000","last_active":"2024-09-13T15:52:14.409834+0000","last_peered":"2024-09-13T15:52:14.409834+0000","last_clean":"2024-09-13T15:52:14.409834+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:52:14.409834+0000","last_undegraded":"2024-09-13T15:52:14.409834+0000","last_fullsized":"2024-09-13T15:52:14.409834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-13T15:52:14.409780+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-09-13T15:52:14.409780+0000","last_clean_scrub_stamp":"2024-09-13T15:52:14.409780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:10.097142+0000","scrub_duration":0.0030991119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:58.866284+0000","last_change":"2024-09-13T15:51:58.866284+0000","last_active":"2024-09-13T15:51:58.866284+0000","last_peered":"2024-09-13T15:51:58.866284+0000","last_clean":"2024-09-13T15:51:58.866284+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:51:58.866284+0000","last_undegraded":"2024-09-13T15:51:58.866284+0000","last_fullsized":"2024-09-13T15:51:58.866284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:58.866014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:58.866014+0000","last_clean_scrub_stamp":"2024-09-13T15:51:58.866014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:21.110620+0000","scrub_duration":0.002811142,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:49.917138+0000","last_change":"2024-09-13T15:51:49.917138+0000","last_active":"2024-09-13T15:51:49.917138+0000","last_peered":"2024-09-13T15:51:49.917138+0000","last_clean":"2024-09-13T15:51:49.917138+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:51:49.917138+0000","last_undegraded":"2024-09-13T15:51:49.917138+0000","last_fullsized":"2024-09-13T15:51:49.917138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-13T15:51:49.916844+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-09-13T15:51:49.916844+0000","last_clean_scrub_stamp":"2024-09-13T15:51:49.916844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:21.888067+0000","scrub_duration":0.0029938650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:30.052443+0000","last_change":"2024-09-13T15:51:30.052443+0000","last_active":"2024-09-13T15:51:30.052443+0000","last_peered":"2024-09-13T15:51:30.052443+0000","last_clean":"2024-09-13T15:51:30.052443+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:51:30.052443+0000","last_undegraded":"2024-09-13T15:51:30.052443+0000","last_fullsized":"2024-09-13T15:51:30.052443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:30.052149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:30.052149+0000","last_clean_scrub_stamp":"2024-09-13T15:51:30.052149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:17.898563+0000","scrub_duration":0.002920181,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:17.394868+0000","last_change":"2024-09-13T15:52:17.395084+0000","last_active":"2024-09-13T15:52:17.394868+0000","last_peered":"2024-09-13T15:52:17.394868+0000","last_clean":"2024-09-13T15:52:17.394868+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:52:17.394868+0000","last_undegraded":"2024-09-13T15:52:17.394868+0000","last_fullsized":"2024-09-13T15:52:17.394868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:17.394817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:17.394817+0000","last_clean_scrub_stamp":"2024-09-13T15:52:17.394817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:22.029436+0000","scrub_duration":0.003240714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:15.611315+0000","last_change":"2024-09-13T15:51:15.611315+0000","last_active":"2024-09-13T15:51:15.611315+0000","last_peered":"2024-09-13T15:51:15.611315+0000","last_clean":"2024-09-13T15:51:15.611315+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:51:15.611315+0000","last_undegraded":"2024-09-13T15:51:15.611315+0000","last_fullsized":"2024-09-13T15:51:15.611315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:15.611033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:15.611033+0000","last_clean_scrub_stamp":"2024-09-13T15:51:15.611033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:31.771056+0000","scrub_duration":0.0029690459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:01.966177+0000","last_change":"2024-09-13T15:52:01.966436+0000","last_active":"2024-09-13T15:52:01.966177+0000","last_peered":"2024-09-13T15:52:01.966177+0000","last_clean":"2024-09-13T15:52:01.966177+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:52:01.966177+0000","last_undegraded":"2024-09-13T15:52:01.966177+0000","last_fullsized":"2024-09-13T15:52:01.966177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:01.966110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:01.966110+0000","last_clean_scrub_stamp":"2024-09-13T15:52:01.966110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:04.069892+0000","scrub_duration":0.0027739829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:10.591481+0000","last_change":"2024-09-13T15:51:10.591481+0000","last_active":"2024-09-13T15:51:10.591481+0000","last_peered":"2024-09-13T15:51:10.591481+0000","last_clean":"2024-09-13T15:51:10.591481+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:51:10.591481+0000","last_undegraded":"2024-09-13T15:51:10.591481+0000","last_fullsized":"2024-09-13T15:51:10.591481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:10.591224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:10.591224+0000","last_clean_scrub_stamp":"2024-09-13T15:51:10.591224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:30.916064+0000","scrub_duration":0.0029806559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:46.613765+0000","last_change":"2024-09-13T15:52:46.614030+0000","last_active":"2024-09-13T15:52:46.613765+0000","last_peered":"2024-09-13T15:52:46.613765+0000","last_clean":"2024-09-13T15:52:46.613765+0000","last_became_active":"2024-09-13T15:35:20.157317+0000","last_became_peered":"2024-09-13T15:35:20.157317+0000","last_unstale":"2024-09-13T15:52:46.613765+0000","last_undegraded":"2024-09-13T15:52:46.613765+0000","last_fullsized":"2024-09-13T15:52:46.613765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:46.613716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:46.613716+0000","last_clean_scrub_stamp":"2024-09-13T15:52:46.613716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:41:24.257075+0000","scrub_duration":0.0028778440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:44.901282+0000","last_change":"2024-09-13T15:51:44.901282+0000","last_active":"2024-09-13T15:51:44.901282+0000","last_peered":"2024-09-13T15:51:44.901282+0000","last_clean":"2024-09-13T15:51:44.901282+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:51:44.901282+0000","last_undegraded":"2024-09-13T15:51:44.901282+0000","last_fullsized":"2024-09-13T15:51:44.901282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:44.901011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:44.901011+0000","last_clean_scrub_stamp":"2024-09-13T15:51:44.901011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:47.282721+0000","scrub_duration":0.002805597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:15.444436+0000","last_change":"2024-09-13T15:52:15.444698+0000","last_active":"2024-09-13T15:52:15.444436+0000","last_peered":"2024-09-13T15:52:15.444436+0000","last_clean":"2024-09-13T15:52:15.444436+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:52:15.444436+0000","last_undegraded":"2024-09-13T15:52:15.444436+0000","last_fullsized":"2024-09-13T15:52:15.444436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:15.444381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:15.444381+0000","last_clean_scrub_stamp":"2024-09-13T15:52:15.444381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:17.548163+0000","scrub_duration":0.0027820800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:14.575770+0000","last_change":"2024-09-13T15:51:14.575770+0000","last_active":"2024-09-13T15:51:14.575770+0000","last_peered":"2024-09-13T15:51:14.575770+0000","last_clean":"2024-09-13T15:51:14.575770+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:51:14.575770+0000","last_undegraded":"2024-09-13T15:51:14.575770+0000","last_fullsized":"2024-09-13T15:51:14.575770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:14.575511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:14.575511+0000","last_clean_scrub_stamp":"2024-09-13T15:51:14.575511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:22.946343+0000","scrub_duration":0.0031682049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:31.763566+0000","last_change":"2024-09-13T15:51:31.763566+0000","last_active":"2024-09-13T15:51:31.763566+0000","last_peered":"2024-09-13T15:51:31.763566+0000","last_clean":"2024-09-13T15:51:31.763566+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:51:31.763566+0000","last_undegraded":"2024-09-13T15:51:31.763566+0000","last_fullsized":"2024-09-13T15:51:31.763566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:31.763240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:31.763240+0000","last_clean_scrub_stamp":"2024-09-13T15:51:31.763240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:25.877586+0000","scrub_duration":0.0031492009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:28.046988+0000","last_change":"2024-09-13T15:52:28.046988+0000","last_active":"2024-09-13T15:52:28.046988+0000","last_peered":"2024-09-13T15:52:28.046988+0000","last_clean":"2024-09-13T15:52:28.046988+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:52:28.046988+0000","last_undegraded":"2024-09-13T15:52:28.046988+0000","last_fullsized":"2024-09-13T15:52:28.046988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:28.046680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:28.046680+0000","last_clean_scrub_stamp":"2024-09-13T15:52:28.046680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:10.337897+0000","scrub_duration":0.0031231890000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:25.684890+0000","last_change":"2024-09-13T15:52:25.684890+0000","last_active":"2024-09-13T15:52:25.684890+0000","last_peered":"2024-09-13T15:52:25.684890+0000","last_clean":"2024-09-13T15:52:25.684890+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:52:25.684890+0000","last_undegraded":"2024-09-13T15:52:25.684890+0000","last_fullsized":"2024-09-13T15:52:25.684890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:25.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:25.684625+0000","last_clean_scrub_stamp":"2024-09-13T15:52:25.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:18:52.083110+0000","scrub_duration":0.0031391589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:44.676934+0000","last_change":"2024-09-13T15:52:44.677165+0000","last_active":"2024-09-13T15:52:44.676934+0000","last_peered":"2024-09-13T15:52:44.676934+0000","last_clean":"2024-09-13T15:52:44.676934+0000","last_became_active":"2024-09-13T15:35:20.152889+0000","last_became_peered":"2024-09-13T15:35:20.152889+0000","last_unstale":"2024-09-13T15:52:44.676934+0000","last_undegraded":"2024-09-13T15:52:44.676934+0000","last_fullsized":"2024-09-13T15:52:44.676934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:44.676884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:44.676884+0000","last_clean_scrub_stamp":"2024-09-13T15:52:44.676884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:52.758217+0000","scrub_duration":0.0029833960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:47.040704+0000","last_change":"2024-09-13T15:52:47.040945+0000","last_active":"2024-09-13T15:52:47.040704+0000","last_peered":"2024-09-13T15:52:47.040704+0000","last_clean":"2024-09-13T15:52:47.040704+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:52:47.040704+0000","last_undegraded":"2024-09-13T15:52:47.040704+0000","last_fullsized":"2024-09-13T15:52:47.040704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:47.040652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:47.040652+0000","last_clean_scrub_stamp":"2024-09-13T15:52:47.040652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:01.782343+0000","scrub_duration":0.0028536780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:14.608116+0000","last_change":"2024-09-13T15:51:14.608116+0000","last_active":"2024-09-13T15:51:14.608116+0000","last_peered":"2024-09-13T15:51:14.608116+0000","last_clean":"2024-09-13T15:51:14.608116+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:51:14.608116+0000","last_undegraded":"2024-09-13T15:51:14.608116+0000","last_fullsized":"2024-09-13T15:51:14.608116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:14.607733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:14.607733+0000","last_clean_scrub_stamp":"2024-09-13T15:51:14.607733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:57.098851+0000","scrub_duration":0.0030409230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:22.464879+0000","last_change":"2024-09-13T15:52:22.465099+0000","last_active":"2024-09-13T15:52:22.464879+0000","last_peered":"2024-09-13T15:52:22.464879+0000","last_clean":"2024-09-13T15:52:22.464879+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:52:22.464879+0000","last_undegraded":"2024-09-13T15:52:22.464879+0000","last_fullsized":"2024-09-13T15:52:22.464879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:22.464830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:22.464830+0000","last_clean_scrub_stamp":"2024-09-13T15:52:22.464830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:22.507464+0000","scrub_duration":0.002969541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:23.745830+0000","last_change":"2024-09-13T15:52:23.746051+0000","last_active":"2024-09-13T15:52:23.745830+0000","last_peered":"2024-09-13T15:52:23.745830+0000","last_clean":"2024-09-13T15:52:23.745830+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:52:23.745830+0000","last_undegraded":"2024-09-13T15:52:23.745830+0000","last_fullsized":"2024-09-13T15:52:23.745830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:23.745782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:23.745782+0000","last_clean_scrub_stamp":"2024-09-13T15:52:23.745782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:19.302029+0000","scrub_duration":0.0028699760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:25.542771+0000","last_change":"2024-09-13T15:52:25.543013+0000","last_active":"2024-09-13T15:52:25.542771+0000","last_peered":"2024-09-13T15:52:25.542771+0000","last_clean":"2024-09-13T15:52:25.542771+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:52:25.542771+0000","last_undegraded":"2024-09-13T15:52:25.542771+0000","last_fullsized":"2024-09-13T15:52:25.542771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:25.542672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:25.542672+0000","last_clean_scrub_stamp":"2024-09-13T15:52:25.542672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:55.631749+0000","scrub_duration":0.0032676430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:34.706904+0000","last_change":"2024-09-13T15:52:34.707132+0000","last_active":"2024-09-13T15:52:34.706904+0000","last_peered":"2024-09-13T15:52:34.706904+0000","last_clean":"2024-09-13T15:52:34.706904+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:52:34.706904+0000","last_undegraded":"2024-09-13T15:52:34.706904+0000","last_fullsized":"2024-09-13T15:52:34.706904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:34.706852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:34.706852+0000","last_clean_scrub_stamp":"2024-09-13T15:52:34.706852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:23:07.479249+0000","scrub_duration":0.003033703,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:12.628563+0000","last_change":"2024-09-13T15:51:12.628806+0000","last_active":"2024-09-13T15:51:12.628563+0000","last_peered":"2024-09-13T15:51:12.628563+0000","last_clean":"2024-09-13T15:51:12.628563+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:51:12.628563+0000","last_undegraded":"2024-09-13T15:51:12.628563+0000","last_fullsized":"2024-09-13T15:51:12.628563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:12.628512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:12.628512+0000","last_clean_scrub_stamp":"2024-09-13T15:51:12.628512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:01.257911+0000","scrub_duration":0.0030549050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:38.100757+0000","last_change":"2024-09-13T15:52:38.100978+0000","last_active":"2024-09-13T15:52:38.100757+0000","last_peered":"2024-09-13T15:52:38.100757+0000","last_clean":"2024-09-13T15:52:38.100757+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:52:38.100757+0000","last_undegraded":"2024-09-13T15:52:38.100757+0000","last_fullsized":"2024-09-13T15:52:38.100757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:38.100708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:38.100708+0000","last_clean_scrub_stamp":"2024-09-13T15:52:38.100708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:23:10.873106+0000","scrub_duration":0.0029443469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279866+0000","last_change":"2024-09-13T15:34:35.330875+0000","last_active":"2024-09-13T15:51:06.279866+0000","last_peered":"2024-09-13T15:51:06.279866+0000","last_clean":"2024-09-13T15:51:06.279866+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:51:06.279866+0000","last_undegraded":"2024-09-13T15:51:06.279866+0000","last_fullsized":"2024-09-13T15:51:06.279866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":60,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.279961+0000","last_change":"2024-09-13T15:34:35.331709+0000","last_active":"2024-09-13T15:51:06.279961+0000","last_peered":"2024-09-13T15:51:06.279961+0000","last_clean":"2024-09-13T15:51:06.279961+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:51:06.279961+0000","last_undegraded":"2024-09-13T15:51:06.279961+0000","last_fullsized":"2024-09-13T15:51:06.279961+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:09.587225+0000","last_change":"2024-09-13T15:51:09.587225+0000","last_active":"2024-09-13T15:51:09.587225+0000","last_peered":"2024-09-13T15:51:09.587225+0000","last_clean":"2024-09-13T15:51:09.587225+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:51:09.587225+0000","last_undegraded":"2024-09-13T15:51:09.587225+0000","last_fullsized":"2024-09-13T15:51:09.587225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:09.586889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:09.586889+0000","last_clean_scrub_stamp":"2024-09-13T15:51:09.586889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:42.815192+0000","scrub_duration":0.0032138610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:40.675870+0000","last_change":"2024-09-13T15:52:40.676163+0000","last_active":"2024-09-13T15:52:40.675870+0000","last_peered":"2024-09-13T15:52:40.675870+0000","last_clean":"2024-09-13T15:52:40.675870+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:52:40.675870+0000","last_undegraded":"2024-09-13T15:52:40.675870+0000","last_fullsized":"2024-09-13T15:52:40.675870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:40.675816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:40.675816+0000","last_clean_scrub_stamp":"2024-09-13T15:52:40.675816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:55.417507+0000","scrub_duration":0.0030529149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:33.571999+0000","last_change":"2024-09-13T15:52:33.572236+0000","last_active":"2024-09-13T15:52:33.571999+0000","last_peered":"2024-09-13T15:52:33.571999+0000","last_clean":"2024-09-13T15:52:33.571999+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:52:33.571999+0000","last_undegraded":"2024-09-13T15:52:33.571999+0000","last_fullsized":"2024-09-13T15:52:33.571999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:33.571950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:33.571950+0000","last_clean_scrub_stamp":"2024-09-13T15:52:33.571950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:11.702316+0000","scrub_duration":0.0030862469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:28.690653+0000","last_change":"2024-09-13T15:51:28.690653+0000","last_active":"2024-09-13T15:51:28.690653+0000","last_peered":"2024-09-13T15:51:28.690653+0000","last_clean":"2024-09-13T15:51:28.690653+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:51:28.690653+0000","last_undegraded":"2024-09-13T15:51:28.690653+0000","last_fullsized":"2024-09-13T15:51:28.690653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:28.690380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:28.690380+0000","last_clean_scrub_stamp":"2024-09-13T15:51:28.690380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:46.825165+0000","scrub_duration":0.0029361040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:27.608345+0000","last_change":"2024-09-13T15:52:27.608569+0000","last_active":"2024-09-13T15:52:27.608345+0000","last_peered":"2024-09-13T15:52:27.608345+0000","last_clean":"2024-09-13T15:52:27.608345+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:52:27.608345+0000","last_undegraded":"2024-09-13T15:52:27.608345+0000","last_fullsized":"2024-09-13T15:52:27.608345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:27.608290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:27.608290+0000","last_clean_scrub_stamp":"2024-09-13T15:52:27.608290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:43.139410+0000","scrub_duration":0.0032251570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:39.056544+0000","last_change":"2024-09-13T15:52:39.056819+0000","last_active":"2024-09-13T15:52:39.056544+0000","last_peered":"2024-09-13T15:52:39.056544+0000","last_clean":"2024-09-13T15:52:39.056544+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:52:39.056544+0000","last_undegraded":"2024-09-13T15:52:39.056544+0000","last_fullsized":"2024-09-13T15:52:39.056544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:39.056493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:39.056493+0000","last_clean_scrub_stamp":"2024-09-13T15:52:39.056493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:19.221648+0000","scrub_duration":0.0032573279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:32.588290+0000","last_change":"2024-09-13T15:52:32.588290+0000","last_active":"2024-09-13T15:52:32.588290+0000","last_peered":"2024-09-13T15:52:32.588290+0000","last_clean":"2024-09-13T15:52:32.588290+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:52:32.588290+0000","last_undegraded":"2024-09-13T15:52:32.588290+0000","last_fullsized":"2024-09-13T15:52:32.588290+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:32.587995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:32.587995+0000","last_clean_scrub_stamp":"2024-09-13T15:52:32.587995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:26.758546+0000","scrub_duration":0.002949185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.280073+0000","last_change":"2024-09-13T15:34:35.324580+0000","last_active":"2024-09-13T15:51:06.280073+0000","last_peered":"2024-09-13T15:51:06.280073+0000","last_clean":"2024-09-13T15:51:06.280073+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:51:06.280073+0000","last_undegraded":"2024-09-13T15:51:06.280073+0000","last_fullsized":"2024-09-13T15:51:06.280073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:35.695407+0000","last_change":"2024-09-13T15:52:35.695638+0000","last_active":"2024-09-13T15:52:35.695407+0000","last_peered":"2024-09-13T15:52:35.695407+0000","last_clean":"2024-09-13T15:52:35.695407+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:52:35.695407+0000","last_undegraded":"2024-09-13T15:52:35.695407+0000","last_fullsized":"2024-09-13T15:52:35.695407+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:35.695356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:35.695356+0000","last_clean_scrub_stamp":"2024-09-13T15:52:35.695356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:15.860511+0000","scrub_duration":0.002846417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:06.280137+0000","last_change":"2024-09-13T15:34:35.347293+0000","last_active":"2024-09-13T15:51:06.280137+0000","last_peered":"2024-09-13T15:51:06.280137+0000","last_clean":"2024-09-13T15:51:06.280137+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:51:06.280137+0000","last_undegraded":"2024-09-13T15:51:06.280137+0000","last_fullsized":"2024-09-13T15:51:06.280137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:34:34.897425+0000","last_clean_scrub_stamp":"2024-09-13T15:34:34.897425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3436,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738592,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99880,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94271960,"statfs":{"total":96636764160,"available":96534487040,"internally_reserved":0,"allocated":688128,"data_stored":300221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:51:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.49299999999999999,"15min":0.438},"min":{"1min":0.29999999999999999,"5min":0.20499999999999999,"15min":0.152},"max":{"1min":0.77600000000000002,"5min":0.83899999999999997,"15min":3.4550000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.47199999999999998},"min":{"1min":0.29299999999999998,"5min":0.248,"15min":0.18099999999999999},"max":{"1min":0.69799999999999995,"5min":0.97499999999999998,"15min":6.1989999999999998},"last":0.58499999999999996}]},{"osd":1,"last update":"Fri Sep 13 15:51:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53900000000000003,"15min":0.46899999999999997},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.185},"max":{"1min":0.66000000000000003,"5min":1.006,"15min":1.4790000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.56599999999999995,"15min":0.505},"min":{"1min":0.376,"5min":0.30299999999999999,"15min":0.17799999999999999},"max":{"1min":0.74099999999999999,"5min":1.0589999999999999,"15min":1.399},"last":0.54100000000000004}]}]},{"osd":1,"up_from":8,"seq":34359738591,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148852,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":94222988,"statfs":{"total":96636764160,"available":96484339712,"internally_reserved":0,"allocated":1290240,"data_stored":891249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:51:59 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.47099999999999997,"15min":0.40899999999999997},"min":{"1min":0.32600000000000001,"5min":0.26700000000000002,"15min":0.159},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.89900000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52500000000000002,"15min":0.44400000000000001},"min":{"1min":0.29099999999999998,"5min":0.20399999999999999,"15min":0.17599999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:51:59 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.53300000000000003,"15min":0.45000000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.17199999999999999},"max":{"1min":0.65100000000000002,"5min":0.748,"15min":0.82999999999999996},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57999999999999996,"15min":0.495},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.19400000000000001},"max":{"1min":0.68899999999999995,"5min":0.93000000000000005,"15min":1.2789999999999999},"last":0.67100000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738593,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":158696,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94213144,"statfs":{"total":96636764160,"available":96474259456,"internally_reserved":0,"allocated":1277952,"data_stored":888575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":161216966},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:51:59 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.495,"15min":0.41899999999999998},"min":{"1min":0.39700000000000002,"5min":0.20399999999999999,"15min":0.158},"max":{"1min":0.76000000000000001,"5min":0.80900000000000005,"15min":0.873},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.51700000000000002,"15min":0.438},"min":{"1min":0.45800000000000002,"5min":0.215,"15min":0.186},"max":{"1min":0.65000000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:51:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54700000000000004,"15min":0.496},"min":{"1min":0.47499999999999998,"5min":0.252,"15min":0.17899999999999999},"max":{"1min":0.66300000000000003,"5min":0.82099999999999995,"15min":9.4610000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.5},"min":{"1min":0.52400000000000002,"5min":0.245,"15min":0.20300000000000001},"max":{"1min":0.755,"5min":0.82099999999999995,"15min":0.90700000000000003},"last":0.63}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:52:49.308 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:49.308 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:49.308 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:49.309 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T15:34:34.897425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=34, tm_sec=34, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=51, tm_sec=4, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:52:49.309 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T15:53:01.969 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:53:09.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:53:09.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.446+0000 7f5265d13640 1 Processor -- start 2024-09-13T15:53:09.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.446+0000 7f5265d13640 1 -- start start 2024-09-13T15:53:09.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.446+0000 7f5265d13640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f526006f360 0x7f52600b9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:09.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.446+0000 7f5265d13640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526006b8c0 con 0x7f526006ef80 2024-09-13T15:53:09.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.446+0000 7f5265d13640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526006b400 con 0x7f526006f360 2024-09-13T15:53:09.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.446+0000 7f525effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f526006f360 0x7f52600b9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:09.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.446+0000 7f525f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f526006ef80 0x7f52600b78f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55386/0 (socket says 172.21.15.40:55386) 2024-09-13T15:53:09.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.446+0000 7f525effd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f526006f360 0x7f52600b9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42884/0 (socket says 172.21.15.40:42884) 2024-09-13T15:53:09.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.446+0000 7f525f7fe640 1 -- 172.21.15.40:0/2640809868 learned_addr learned my addr 172.21.15.40:0/2640809868 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:53:09.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.446+0000 7f525effd640 1 -- 172.21.15.40:0/2640809868 >> v1:172.21.15.40:6789/0 conn(0x7f526006ef80 legacy=0x7f52600b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:09.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.446+0000 7f525e7fc640 1 -- 172.21.15.40:0/2640809868 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891692039 0 0) 0x7f526006b8c0 con 0x7f526006ef80 2024-09-13T15:53:09.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.446+0000 7f525effd640 1 -- 172.21.15.40:0/2640809868 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600ba4d0 con 0x7f526006f360 2024-09-13T15:53:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f525effd640 1 --2- 172.21.15.40:0/2640809868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526006f360 0x7f52600b9640 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5254009740 tx=0x7f525401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c893128f3d08fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f525e7fc640 1 -- 172.21.15.40:0/2640809868 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52540ab570 con 0x7f526006f360 2024-09-13T15:53:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f525e7fc640 1 -- 172.21.15.40:0/2640809868 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52540a7070 con 0x7f526006f360 2024-09-13T15:53:09.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f525e7fc640 1 -- 172.21.15.40:0/2640809868 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52540ab820 con 0x7f526006f360 2024-09-13T15:53:09.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f5265d13640 1 -- 172.21.15.40:0/2640809868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526006f360 msgr2=0x7f52600b9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:09.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f5265d13640 1 --2- 172.21.15.40:0/2640809868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526006f360 0x7f52600b9640 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5254009740 tx=0x7f525401c3e0 comp rx=0 tx=0).stop 2024-09-13T15:53:09.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f5265d13640 1 -- 172.21.15.40:0/2640809868 shutdown_connections 2024-09-13T15:53:09.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f5265d13640 1 --2- 172.21.15.40:0/2640809868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526006f360 0x7f52600b9640 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:09.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f5265d13640 1 -- 172.21.15.40:0/2640809868 >> 172.21.15.40:0/2640809868 conn(0x7f5260070a80 msgr2=0x7f5260070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:09.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f5265d13640 1 -- 172.21.15.40:0/2640809868 shutdown_connections 2024-09-13T15:53:09.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f5265d13640 1 -- 172.21.15.40:0/2640809868 wait complete. 2024-09-13T15:53:09.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f5265d13640 1 Processor -- start 2024-09-13T15:53:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f5265d13640 1 -- start start 2024-09-13T15:53:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f5265d13640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526006ef80 0x7f5260138e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f5265d13640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5260149b40 con 0x7f526006ef80 2024-09-13T15:53:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f525f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526006ef80 0x7f5260138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f525f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526006ef80 0x7f5260138e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42900/0 (socket says 172.21.15.40:42900) 2024-09-13T15:53:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f525f7fe640 1 -- 172.21.15.40:0/3505404642 learned_addr learned my addr 172.21.15.40:0/3505404642 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:53:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.450+0000 7f525f7fe640 1 -- 172.21.15.40:0/3505404642 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5254009420 con 0x7f526006ef80 2024-09-13T15:53:09.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.454+0000 7f525f7fe640 1 --2- 172.21.15.40:0/3505404642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526006ef80 0x7f5260138e20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f525000c420 tx=0x7f525000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:09.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.454+0000 7f5247fff640 1 -- 172.21.15.40:0/3505404642 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f52500074d0 con 0x7f526006ef80 2024-09-13T15:53:09.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.454+0000 7f5247fff640 1 -- 172.21.15.40:0/3505404642 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5250007630 con 0x7f526006ef80 2024-09-13T15:53:09.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.454+0000 7f5247fff640 1 -- 172.21.15.40:0/3505404642 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5250004960 con 0x7f526006ef80 2024-09-13T15:53:09.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.454+0000 7f5265d13640 1 -- 172.21.15.40:0/3505404642 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52601f41b0 con 0x7f526006ef80 2024-09-13T15:53:09.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.454+0000 7f5265d13640 1 -- 172.21.15.40:0/3505404642 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5260149840 con 0x7f526006ef80 2024-09-13T15:53:09.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.454+0000 7f5247fff640 1 -- 172.21.15.40:0/3505404642 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f5250004ac0 con 0x7f526006ef80 2024-09-13T15:53:09.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.454+0000 7f5265d13640 1 -- 172.21.15.40:0/3505404642 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52601f4340 con 0x7f526006ef80 2024-09-13T15:53:09.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.454+0000 7f5247fff640 1 --2- 172.21.15.40:0/3505404642 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f524c035530 0x7f524c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:09.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.454+0000 7f5247fff640 1 -- 172.21.15.40:0/3505404642 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f5250047440 con 0x7f526006ef80 2024-09-13T15:53:09.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.454+0000 7f525effd640 1 --2- 172.21.15.40:0/3505404642 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f524c035530 0x7f524c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:09.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.454+0000 7f525effd640 1 --2- 172.21.15.40:0/3505404642 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f524c035530 0x7f524c0379f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f52540af000 tx=0x7f5254008040 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:09.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.458+0000 7f5247fff640 1 -- 172.21.15.40:0/3505404642 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f525001acd0 con 0x7f526006ef80 2024-09-13T15:53:09.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.614+0000 7f5265d13640 1 -- 172.21.15.40:0/3505404642 --> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52600b9640 con 0x7f524c035530 2024-09-13T15:53:09.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.634+0000 7f5247fff640 1 -- 172.21.15.40:0/3505404642 <== mgr.4386 v2:172.21.15.40:6824/3416149431 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251799 (secure 0 0 0) 0x7f52600b9640 con 0x7f524c035530 2024-09-13T15:53:09.638 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:53:09.639 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-09-13T15:53:09.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.638+0000 7f5265d13640 1 -- 172.21.15.40:0/3505404642 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f524c035530 msgr2=0x7f524c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:09.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.638+0000 7f5265d13640 1 --2- 172.21.15.40:0/3505404642 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f524c035530 0x7f524c0379f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f52540af000 tx=0x7f5254008040 comp rx=0 tx=0).stop 2024-09-13T15:53:09.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.638+0000 7f5265d13640 1 -- 172.21.15.40:0/3505404642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526006ef80 msgr2=0x7f5260138e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:09.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.638+0000 7f5265d13640 1 --2- 172.21.15.40:0/3505404642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526006ef80 0x7f5260138e20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f525000c420 tx=0x7f525000c8e0 comp rx=0 tx=0).stop 2024-09-13T15:53:09.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.638+0000 7f5265d13640 1 -- 172.21.15.40:0/3505404642 shutdown_connections 2024-09-13T15:53:09.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.638+0000 7f5265d13640 1 --2- 172.21.15.40:0/3505404642 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f524c035530 0x7f524c0379f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:09.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.638+0000 7f5265d13640 1 --2- 172.21.15.40:0/3505404642 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526006ef80 0x7f5260138e20 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:09.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.638+0000 7f5265d13640 1 -- 172.21.15.40:0/3505404642 >> 172.21.15.40:0/3505404642 conn(0x7f5260070a80 msgr2=0x7f526014bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:09.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.638+0000 7f5265d13640 1 -- 172.21.15.40:0/3505404642 shutdown_connections 2024-09-13T15:53:09.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.638+0000 7f5265d13640 1 -- 172.21.15.40:0/3505404642 wait complete. 2024-09-13T15:53:09.657 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":517,"stamp":"2024-09-13T15:53:07.890580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593804,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":208,"num_write_kb":1914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":407428,"kb_used_data":3180,"kb_used_omap":4,"kb_used_meta":404219,"kb_avail":282708092,"statfs":{"total":289910292480,"available":289493086208,"internally_reserved":0,"allocated":3256320,"data_stored":2080045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4782,"internal_metadata":413920594},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003959"},"pg_stats":[{"pgid":"2.1f","version":"58'6","reported_seq":79,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:00.925214+0000","last_change":"2024-09-13T15:52:00.925433+0000","last_active":"2024-09-13T15:52:00.925214+0000","last_peered":"2024-09-13T15:52:00.925214+0000","last_clean":"2024-09-13T15:52:00.925214+0000","last_became_active":"2024-09-13T15:34:34.960127+0000","last_became_peered":"2024-09-13T15:34:34.960127+0000","last_unstale":"2024-09-13T15:52:00.925214+0000","last_undegraded":"2024-09-13T15:52:00.925214+0000","last_fullsized":"2024-09-13T15:52:00.925214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'6","last_scrub_stamp":"2024-09-13T15:52:00.925158+0000","last_deep_scrub":"58'6","last_deep_scrub_stamp":"2024-09-13T15:52:00.925158+0000","last_clean_scrub_stamp":"2024-09-13T15:52:00.925158+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:56.612520+0000","scrub_duration":0.0072895659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:22.675350+0000","last_change":"2024-09-13T15:51:22.675350+0000","last_active":"2024-09-13T15:51:22.675350+0000","last_peered":"2024-09-13T15:51:22.675350+0000","last_clean":"2024-09-13T15:51:22.675350+0000","last_became_active":"2024-09-13T15:34:35.338023+0000","last_became_peered":"2024-09-13T15:34:35.338023+0000","last_unstale":"2024-09-13T15:51:22.675350+0000","last_undegraded":"2024-09-13T15:51:22.675350+0000","last_fullsized":"2024-09-13T15:51:22.675350+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:22.675078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:22.675078+0000","last_clean_scrub_stamp":"2024-09-13T15:51:22.675078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:11.304477+0000","scrub_duration":0.002879932,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"15'1","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:47.519523+0000","last_change":"2024-09-13T15:51:47.519523+0000","last_active":"2024-09-13T15:51:47.519523+0000","last_peered":"2024-09-13T15:51:47.519523+0000","last_clean":"2024-09-13T15:51:47.519523+0000","last_became_active":"2024-09-13T15:34:34.955340+0000","last_became_peered":"2024-09-13T15:34:34.955340+0000","last_unstale":"2024-09-13T15:51:47.519523+0000","last_undegraded":"2024-09-13T15:51:47.519523+0000","last_fullsized":"2024-09-13T15:51:47.519523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-13T15:51:47.519216+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-09-13T15:51:47.519216+0000","last_clean_scrub_stamp":"2024-09-13T15:51:47.519216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:40.760952+0000","scrub_duration":0.0029653919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:08.926430+0000","last_change":"2024-09-13T15:52:08.926656+0000","last_active":"2024-09-13T15:52:08.926430+0000","last_peered":"2024-09-13T15:52:08.926430+0000","last_clean":"2024-09-13T15:52:08.926430+0000","last_became_active":"2024-09-13T15:34:35.346796+0000","last_became_peered":"2024-09-13T15:34:35.346796+0000","last_unstale":"2024-09-13T15:52:08.926430+0000","last_undegraded":"2024-09-13T15:52:08.926430+0000","last_fullsized":"2024-09-13T15:52:08.926430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:08.926380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:08.926380+0000","last_clean_scrub_stamp":"2024-09-13T15:52:08.926380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:08.969015+0000","scrub_duration":0.0030086520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"58'3","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:21.975274+0000","last_change":"2024-09-13T15:52:21.975506+0000","last_active":"2024-09-13T15:52:21.975274+0000","last_peered":"2024-09-13T15:52:21.975274+0000","last_clean":"2024-09-13T15:52:21.975274+0000","last_became_active":"2024-09-13T15:34:34.947672+0000","last_became_peered":"2024-09-13T15:34:34.947672+0000","last_unstale":"2024-09-13T15:52:21.975274+0000","last_undegraded":"2024-09-13T15:52:21.975274+0000","last_fullsized":"2024-09-13T15:52:21.975274+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:21.975219+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:21.975219+0000","last_clean_scrub_stamp":"2024-09-13T15:52:21.975219+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:53.668027+0000","scrub_duration":0.0060361980000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:58.792615+0000","last_change":"2024-09-13T15:51:58.792615+0000","last_active":"2024-09-13T15:51:58.792615+0000","last_peered":"2024-09-13T15:51:58.792615+0000","last_clean":"2024-09-13T15:51:58.792615+0000","last_became_active":"2024-09-13T15:34:35.333358+0000","last_became_peered":"2024-09-13T15:34:35.333358+0000","last_unstale":"2024-09-13T15:51:58.792615+0000","last_undegraded":"2024-09-13T15:51:58.792615+0000","last_fullsized":"2024-09-13T15:51:58.792615+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:58.792356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:58.792356+0000","last_clean_scrub_stamp":"2024-09-13T15:51:58.792356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:54.479718+0000","scrub_duration":0.0030650410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"58'3","reported_seq":66,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:36.534966+0000","last_change":"2024-09-13T15:52:36.534966+0000","last_active":"2024-09-13T15:52:36.534966+0000","last_peered":"2024-09-13T15:52:36.534966+0000","last_clean":"2024-09-13T15:52:36.534966+0000","last_became_active":"2024-09-13T15:35:20.165658+0000","last_became_peered":"2024-09-13T15:35:20.165658+0000","last_unstale":"2024-09-13T15:52:36.534966+0000","last_undegraded":"2024-09-13T15:52:36.534966+0000","last_fullsized":"2024-09-13T15:52:36.534966+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:36.534681+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:36.534681+0000","last_clean_scrub_stamp":"2024-09-13T15:52:36.534681+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:34.352689+0000","scrub_duration":0.0061760349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:39.648291+0000","last_change":"2024-09-13T15:51:39.648291+0000","last_active":"2024-09-13T15:51:39.648291+0000","last_peered":"2024-09-13T15:51:39.648291+0000","last_clean":"2024-09-13T15:51:39.648291+0000","last_became_active":"2024-09-13T15:34:35.328651+0000","last_became_peered":"2024-09-13T15:34:35.328651+0000","last_unstale":"2024-09-13T15:51:39.648291+0000","last_undegraded":"2024-09-13T15:51:39.648291+0000","last_fullsized":"2024-09-13T15:51:39.648291+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:39.647966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:39.647966+0000","last_clean_scrub_stamp":"2024-09-13T15:51:39.647966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:57.782751+0000","scrub_duration":0.0028655859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:39.860860+0000","last_change":"2024-09-13T15:51:39.860860+0000","last_active":"2024-09-13T15:51:39.860860+0000","last_peered":"2024-09-13T15:51:39.860860+0000","last_clean":"2024-09-13T15:51:39.860860+0000","last_became_active":"2024-09-13T15:34:35.328188+0000","last_became_peered":"2024-09-13T15:34:35.328188+0000","last_unstale":"2024-09-13T15:51:39.860860+0000","last_undegraded":"2024-09-13T15:51:39.860860+0000","last_fullsized":"2024-09-13T15:51:39.860860+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:39.860518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:39.860518+0000","last_clean_scrub_stamp":"2024-09-13T15:51:39.860518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:23.434457+0000","scrub_duration":0.0030233840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.b","version":"58'3","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:15.024349+0000","last_change":"2024-09-13T15:52:15.024349+0000","last_active":"2024-09-13T15:52:15.024349+0000","last_peered":"2024-09-13T15:52:15.024349+0000","last_clean":"2024-09-13T15:52:15.024349+0000","last_became_active":"2024-09-13T15:34:34.939762+0000","last_became_peered":"2024-09-13T15:34:34.939762+0000","last_unstale":"2024-09-13T15:52:15.024349+0000","last_undegraded":"2024-09-13T15:52:15.024349+0000","last_fullsized":"2024-09-13T15:52:15.024349+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:15.024036+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:15.024036+0000","last_clean_scrub_stamp":"2024-09-13T15:52:15.024036+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:39.808527+0000","scrub_duration":0.0057298569999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:41.947387+0000","last_change":"2024-09-13T15:51:41.947387+0000","last_active":"2024-09-13T15:51:41.947387+0000","last_peered":"2024-09-13T15:51:41.947387+0000","last_clean":"2024-09-13T15:51:41.947387+0000","last_became_active":"2024-09-13T15:34:35.339430+0000","last_became_peered":"2024-09-13T15:34:35.339430+0000","last_unstale":"2024-09-13T15:51:41.947387+0000","last_undegraded":"2024-09-13T15:51:41.947387+0000","last_fullsized":"2024-09-13T15:51:41.947387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:41.947053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:41.947053+0000","last_clean_scrub_stamp":"2024-09-13T15:51:41.947053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:08.395633+0000","scrub_duration":0.0028106099999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:11.761645+0000","last_change":"2024-09-13T15:52:11.761861+0000","last_active":"2024-09-13T15:52:11.761645+0000","last_peered":"2024-09-13T15:52:11.761645+0000","last_clean":"2024-09-13T15:52:11.761645+0000","last_became_active":"2024-09-13T15:34:34.943241+0000","last_became_peered":"2024-09-13T15:34:34.943241+0000","last_unstale":"2024-09-13T15:52:11.761645+0000","last_undegraded":"2024-09-13T15:52:11.761645+0000","last_fullsized":"2024-09-13T15:52:11.761645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:11.761591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:11.761591+0000","last_clean_scrub_stamp":"2024-09-13T15:52:11.761591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:27.292711+0000","scrub_duration":0.002907158,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.604941+0000","last_change":"2024-09-13T15:51:42.604941+0000","last_active":"2024-09-13T15:51:42.604941+0000","last_peered":"2024-09-13T15:51:42.604941+0000","last_clean":"2024-09-13T15:51:42.604941+0000","last_became_active":"2024-09-13T15:34:35.337407+0000","last_became_peered":"2024-09-13T15:34:35.337407+0000","last_unstale":"2024-09-13T15:51:42.604941+0000","last_undegraded":"2024-09-13T15:51:42.604941+0000","last_fullsized":"2024-09-13T15:51:42.604941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:42.604669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:42.604669+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.604669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:36.719016+0000","scrub_duration":0.0029141129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:06.735540+0000","last_change":"2024-09-13T15:52:06.735763+0000","last_active":"2024-09-13T15:52:06.735540+0000","last_peered":"2024-09-13T15:52:06.735540+0000","last_clean":"2024-09-13T15:52:06.735540+0000","last_became_active":"2024-09-13T15:34:34.942522+0000","last_became_peered":"2024-09-13T15:34:34.942522+0000","last_unstale":"2024-09-13T15:52:06.735540+0000","last_undegraded":"2024-09-13T15:52:06.735540+0000","last_fullsized":"2024-09-13T15:52:06.735540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:06.735489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:06.735489+0000","last_clean_scrub_stamp":"2024-09-13T15:52:06.735489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:06.778123+0000","scrub_duration":0.0029280899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:37.836156+0000","last_change":"2024-09-13T15:51:37.836156+0000","last_active":"2024-09-13T15:51:37.836156+0000","last_peered":"2024-09-13T15:51:37.836156+0000","last_clean":"2024-09-13T15:51:37.836156+0000","last_became_active":"2024-09-13T15:34:35.322438+0000","last_became_peered":"2024-09-13T15:34:35.322438+0000","last_unstale":"2024-09-13T15:51:37.836156+0000","last_undegraded":"2024-09-13T15:51:37.836156+0000","last_fullsized":"2024-09-13T15:51:37.836156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:37.835829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:37.835829+0000","last_clean_scrub_stamp":"2024-09-13T15:51:37.835829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:46.328337+0000","scrub_duration":0.0028480789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:13.998133+0000","last_change":"2024-09-13T15:52:13.998423+0000","last_active":"2024-09-13T15:52:13.998133+0000","last_peered":"2024-09-13T15:52:13.998133+0000","last_clean":"2024-09-13T15:52:13.998133+0000","last_became_active":"2024-09-13T15:34:34.939586+0000","last_became_peered":"2024-09-13T15:34:34.939586+0000","last_unstale":"2024-09-13T15:52:13.998133+0000","last_undegraded":"2024-09-13T15:52:13.998133+0000","last_fullsized":"2024-09-13T15:52:13.998133+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:13.998078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:13.998078+0000","last_clean_scrub_stamp":"2024-09-13T15:52:13.998078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:29.529198+0000","scrub_duration":0.0029036449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:49.022056+0000","last_change":"2024-09-13T15:51:49.022056+0000","last_active":"2024-09-13T15:51:49.022056+0000","last_peered":"2024-09-13T15:51:49.022056+0000","last_clean":"2024-09-13T15:51:49.022056+0000","last_became_active":"2024-09-13T15:34:35.333982+0000","last_became_peered":"2024-09-13T15:34:35.333982+0000","last_unstale":"2024-09-13T15:51:49.022056+0000","last_undegraded":"2024-09-13T15:51:49.022056+0000","last_fullsized":"2024-09-13T15:51:49.022056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:49.021803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:49.021803+0000","last_clean_scrub_stamp":"2024-09-13T15:51:49.021803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:25.975161+0000","scrub_duration":0.0028090350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"58'3","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:19.734221+0000","last_change":"2024-09-13T15:52:19.734430+0000","last_active":"2024-09-13T15:52:19.734221+0000","last_peered":"2024-09-13T15:52:19.734221+0000","last_clean":"2024-09-13T15:52:19.734221+0000","last_became_active":"2024-09-13T15:34:34.945856+0000","last_became_peered":"2024-09-13T15:34:34.945856+0000","last_unstale":"2024-09-13T15:52:19.734221+0000","last_undegraded":"2024-09-13T15:52:19.734221+0000","last_fullsized":"2024-09-13T15:52:19.734221+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:19.734162+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:19.734162+0000","last_clean_scrub_stamp":"2024-09-13T15:52:19.734162+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:17.552169+0000","scrub_duration":0.0056413829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:11.573279+0000","last_change":"2024-09-13T15:51:11.573279+0000","last_active":"2024-09-13T15:51:11.573279+0000","last_peered":"2024-09-13T15:51:11.573279+0000","last_clean":"2024-09-13T15:51:11.573279+0000","last_became_active":"2024-09-13T15:34:35.337039+0000","last_became_peered":"2024-09-13T15:34:35.337039+0000","last_unstale":"2024-09-13T15:51:11.573279+0000","last_undegraded":"2024-09-13T15:51:11.573279+0000","last_fullsized":"2024-09-13T15:51:11.573279+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:11.572987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:11.572987+0000","last_clean_scrub_stamp":"2024-09-13T15:51:11.572987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:21.045297+0000","scrub_duration":0.0030285730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"58'2","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:16.655350+0000","last_change":"2024-09-13T15:52:16.655582+0000","last_active":"2024-09-13T15:52:16.655350+0000","last_peered":"2024-09-13T15:52:16.655350+0000","last_clean":"2024-09-13T15:52:16.655350+0000","last_became_active":"2024-09-13T15:34:34.941959+0000","last_became_peered":"2024-09-13T15:34:34.941959+0000","last_unstale":"2024-09-13T15:52:16.655350+0000","last_undegraded":"2024-09-13T15:52:16.655350+0000","last_fullsized":"2024-09-13T15:52:16.655350+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-13T15:52:16.655296+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-13T15:52:16.655296+0000","last_clean_scrub_stamp":"2024-09-13T15:52:16.655296+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:54.785663+0000","scrub_duration":0.0061258019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:10.000654+0000","last_change":"2024-09-13T15:51:10.000654+0000","last_active":"2024-09-13T15:51:10.000654+0000","last_peered":"2024-09-13T15:51:10.000654+0000","last_clean":"2024-09-13T15:51:10.000654+0000","last_became_active":"2024-09-13T15:34:35.337150+0000","last_became_peered":"2024-09-13T15:34:35.337150+0000","last_unstale":"2024-09-13T15:51:10.000654+0000","last_undegraded":"2024-09-13T15:51:10.000654+0000","last_fullsized":"2024-09-13T15:51:10.000654+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:10.000340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:10.000340+0000","last_clean_scrub_stamp":"2024-09-13T15:51:10.000340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:14.854008+0000","scrub_duration":0.0030965559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:15.701497+0000","last_change":"2024-09-13T15:52:15.701711+0000","last_active":"2024-09-13T15:52:15.701497+0000","last_peered":"2024-09-13T15:52:15.701497+0000","last_clean":"2024-09-13T15:52:15.701497+0000","last_became_active":"2024-09-13T15:34:34.949258+0000","last_became_peered":"2024-09-13T15:34:34.949258+0000","last_unstale":"2024-09-13T15:52:15.701497+0000","last_undegraded":"2024-09-13T15:52:15.701497+0000","last_fullsized":"2024-09-13T15:52:15.701497+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:15.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:15.701448+0000","last_clean_scrub_stamp":"2024-09-13T15:52:15.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:09.871999+0000","scrub_duration":0.0031982540000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:08.634807+0000","last_change":"2024-09-13T15:51:08.634807+0000","last_active":"2024-09-13T15:51:08.634807+0000","last_peered":"2024-09-13T15:51:08.634807+0000","last_clean":"2024-09-13T15:51:08.634807+0000","last_became_active":"2024-09-13T15:34:35.335184+0000","last_became_peered":"2024-09-13T15:34:35.335184+0000","last_unstale":"2024-09-13T15:51:08.634807+0000","last_undegraded":"2024-09-13T15:51:08.634807+0000","last_fullsized":"2024-09-13T15:51:08.634807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:08.634488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:08.634488+0000","last_clean_scrub_stamp":"2024-09-13T15:51:08.634488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:12:29.659635+0000","scrub_duration":0.0033577189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:12.742813+0000","last_change":"2024-09-13T15:52:12.743022+0000","last_active":"2024-09-13T15:52:12.742813+0000","last_peered":"2024-09-13T15:52:12.742813+0000","last_clean":"2024-09-13T15:52:12.742813+0000","last_became_active":"2024-09-13T15:34:34.944249+0000","last_became_peered":"2024-09-13T15:34:34.944249+0000","last_unstale":"2024-09-13T15:52:12.742813+0000","last_undegraded":"2024-09-13T15:52:12.742813+0000","last_fullsized":"2024-09-13T15:52:12.742813+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:12.742764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:12.742764+0000","last_clean_scrub_stamp":"2024-09-13T15:52:12.742764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:37.527255+0000","scrub_duration":0.0029269640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:43.932444+0000","last_change":"2024-09-13T15:51:43.932667+0000","last_active":"2024-09-13T15:51:43.932444+0000","last_peered":"2024-09-13T15:51:43.932444+0000","last_clean":"2024-09-13T15:51:43.932444+0000","last_became_active":"2024-09-13T15:34:35.325542+0000","last_became_peered":"2024-09-13T15:34:35.325542+0000","last_unstale":"2024-09-13T15:51:43.932444+0000","last_undegraded":"2024-09-13T15:51:43.932444+0000","last_fullsized":"2024-09-13T15:51:43.932444+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:43.932395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:43.932395+0000","last_clean_scrub_stamp":"2024-09-13T15:51:43.932395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:50.418406+0000","scrub_duration":0.0030891629999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:22.935326+0000","last_change":"2024-09-13T15:52:22.935577+0000","last_active":"2024-09-13T15:52:22.935326+0000","last_peered":"2024-09-13T15:52:22.935326+0000","last_clean":"2024-09-13T15:52:22.935326+0000","last_became_active":"2024-09-13T15:34:34.951801+0000","last_became_peered":"2024-09-13T15:34:34.951801+0000","last_unstale":"2024-09-13T15:52:22.935326+0000","last_undegraded":"2024-09-13T15:52:22.935326+0000","last_fullsized":"2024-09-13T15:52:22.935326+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:22.935273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:22.935273+0000","last_clean_scrub_stamp":"2024-09-13T15:52:22.935273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:00:32.208431+0000","scrub_duration":0.002821306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:34.985088+0000","last_change":"2024-09-13T15:51:34.985088+0000","last_active":"2024-09-13T15:51:34.985088+0000","last_peered":"2024-09-13T15:51:34.985088+0000","last_clean":"2024-09-13T15:51:34.985088+0000","last_became_active":"2024-09-13T15:34:35.336104+0000","last_became_peered":"2024-09-13T15:34:35.336104+0000","last_unstale":"2024-09-13T15:51:34.985088+0000","last_undegraded":"2024-09-13T15:51:34.985088+0000","last_fullsized":"2024-09-13T15:51:34.985088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:34.984821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:34.984821+0000","last_clean_scrub_stamp":"2024-09-13T15:51:34.984821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:43.477329+0000","scrub_duration":0.0030114199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:59.489759+0000","last_change":"2024-09-13T15:51:59.489969+0000","last_active":"2024-09-13T15:51:59.489759+0000","last_peered":"2024-09-13T15:51:59.489759+0000","last_clean":"2024-09-13T15:51:59.489759+0000","last_became_active":"2024-09-13T15:34:34.955243+0000","last_became_peered":"2024-09-13T15:34:34.955243+0000","last_unstale":"2024-09-13T15:51:59.489759+0000","last_undegraded":"2024-09-13T15:51:59.489759+0000","last_fullsized":"2024-09-13T15:51:59.489759+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:59.489693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:59.489693+0000","last_clean_scrub_stamp":"2024-09-13T15:51:59.489693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:32:42.511558+0000","scrub_duration":0.0029566660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:56.928710+0000","last_change":"2024-09-13T15:51:56.928926+0000","last_active":"2024-09-13T15:51:56.928710+0000","last_peered":"2024-09-13T15:51:56.928710+0000","last_clean":"2024-09-13T15:51:56.928710+0000","last_became_active":"2024-09-13T15:34:35.321823+0000","last_became_peered":"2024-09-13T15:34:35.321823+0000","last_unstale":"2024-09-13T15:51:56.928710+0000","last_undegraded":"2024-09-13T15:51:56.928710+0000","last_fullsized":"2024-09-13T15:51:56.928710+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:56.928661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:56.928661+0000","last_clean_scrub_stamp":"2024-09-13T15:51:56.928661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:27.237108+0000","scrub_duration":0.0029743360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:48.563977+0000","last_change":"2024-09-13T15:51:48.563977+0000","last_active":"2024-09-13T15:51:48.563977+0000","last_peered":"2024-09-13T15:51:48.563977+0000","last_clean":"2024-09-13T15:51:48.563977+0000","last_became_active":"2024-09-13T15:34:34.960387+0000","last_became_peered":"2024-09-13T15:34:34.960387+0000","last_unstale":"2024-09-13T15:51:48.563977+0000","last_undegraded":"2024-09-13T15:51:48.563977+0000","last_fullsized":"2024-09-13T15:51:48.563977+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:48.563689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:48.563689+0000","last_clean_scrub_stamp":"2024-09-13T15:51:48.563689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:04:57.056198+0000","scrub_duration":0.0028270109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:28.063597+0000","last_change":"2024-09-13T15:51:28.063807+0000","last_active":"2024-09-13T15:51:28.063597+0000","last_peered":"2024-09-13T15:51:28.063597+0000","last_clean":"2024-09-13T15:51:28.063597+0000","last_became_active":"2024-09-13T15:34:35.337064+0000","last_became_peered":"2024-09-13T15:34:35.337064+0000","last_unstale":"2024-09-13T15:51:28.063597+0000","last_undegraded":"2024-09-13T15:51:28.063597+0000","last_fullsized":"2024-09-13T15:51:28.063597+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:28.063549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:28.063549+0000","last_clean_scrub_stamp":"2024-09-13T15:51:28.063549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:22.177895+0000","scrub_duration":0.0027253830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:09.786228+0000","last_change":"2024-09-13T15:52:09.786444+0000","last_active":"2024-09-13T15:52:09.786228+0000","last_peered":"2024-09-13T15:52:09.786228+0000","last_clean":"2024-09-13T15:52:09.786228+0000","last_became_active":"2024-09-13T15:34:34.939174+0000","last_became_peered":"2024-09-13T15:34:34.939174+0000","last_unstale":"2024-09-13T15:52:09.786228+0000","last_undegraded":"2024-09-13T15:52:09.786228+0000","last_fullsized":"2024-09-13T15:52:09.786228+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:09.786175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:09.786175+0000","last_clean_scrub_stamp":"2024-09-13T15:52:09.786175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:43:43.684744+0000","scrub_duration":0.002697287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"58'110","reported_seq":245,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:01.776195+0000","last_change":"2024-09-13T15:52:01.776195+0000","last_active":"2024-09-13T15:52:01.776195+0000","last_peered":"2024-09-13T15:52:01.776195+0000","last_clean":"2024-09-13T15:52:01.776195+0000","last_became_active":"2024-09-13T15:34:27.586159+0000","last_became_peered":"2024-09-13T15:34:27.586159+0000","last_unstale":"2024-09-13T15:52:01.776195+0000","last_undegraded":"2024-09-13T15:52:01.776195+0000","last_fullsized":"2024-09-13T15:52:01.776195+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'110","last_scrub_stamp":"2024-09-13T15:52:01.775864+0000","last_deep_scrub":"58'110","last_deep_scrub_stamp":"2024-09-13T15:52:01.775864+0000","last_clean_scrub_stamp":"2024-09-13T15:52:01.775864+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:06.410483+0000","scrub_duration":0.0095732660000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:09.023040+0000","last_change":"2024-09-13T15:51:09.023040+0000","last_active":"2024-09-13T15:51:09.023040+0000","last_peered":"2024-09-13T15:51:09.023040+0000","last_clean":"2024-09-13T15:51:09.023040+0000","last_became_active":"2024-09-13T15:34:35.333460+0000","last_became_peered":"2024-09-13T15:34:35.333460+0000","last_unstale":"2024-09-13T15:51:09.023040+0000","last_undegraded":"2024-09-13T15:51:09.023040+0000","last_fullsized":"2024-09-13T15:51:09.023040+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:09.022780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:09.022780+0000","last_clean_scrub_stamp":"2024-09-13T15:51:09.022780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:57.652179+0000","scrub_duration":0.0027795350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:53.492836+0000","last_change":"2024-09-13T15:51:53.492836+0000","last_active":"2024-09-13T15:51:53.492836+0000","last_peered":"2024-09-13T15:51:53.492836+0000","last_clean":"2024-09-13T15:51:53.492836+0000","last_became_active":"2024-09-13T15:34:34.955883+0000","last_became_peered":"2024-09-13T15:34:34.955883+0000","last_unstale":"2024-09-13T15:51:53.492836+0000","last_undegraded":"2024-09-13T15:51:53.492836+0000","last_fullsized":"2024-09-13T15:51:53.492836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:53.492570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:53.492570+0000","last_clean_scrub_stamp":"2024-09-13T15:51:53.492570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:19.941150+0000","scrub_duration":0.0029359529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:36.814917+0000","last_change":"2024-09-13T15:51:36.814917+0000","last_active":"2024-09-13T15:51:36.814917+0000","last_peered":"2024-09-13T15:51:36.814917+0000","last_clean":"2024-09-13T15:51:36.814917+0000","last_became_active":"2024-09-13T15:34:35.328297+0000","last_became_peered":"2024-09-13T15:34:35.328297+0000","last_unstale":"2024-09-13T15:51:36.814917+0000","last_undegraded":"2024-09-13T15:51:36.814917+0000","last_fullsized":"2024-09-13T15:51:36.814917+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:36.814631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:36.814631+0000","last_clean_scrub_stamp":"2024-09-13T15:51:36.814631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:30.056367+0000","scrub_duration":0.0030192740000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"58'2","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:59.782573+0000","last_change":"2024-09-13T15:51:59.782573+0000","last_active":"2024-09-13T15:51:59.782573+0000","last_peered":"2024-09-13T15:51:59.782573+0000","last_clean":"2024-09-13T15:51:59.782573+0000","last_became_active":"2024-09-13T15:34:34.935565+0000","last_became_peered":"2024-09-13T15:34:34.935565+0000","last_unstale":"2024-09-13T15:51:59.782573+0000","last_undegraded":"2024-09-13T15:51:59.782573+0000","last_fullsized":"2024-09-13T15:51:59.782573+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-13T15:51:59.782304+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-13T15:51:59.782304+0000","last_clean_scrub_stamp":"2024-09-13T15:51:59.782304+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:01.886087+0000","scrub_duration":0.0062355980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:48.041512+0000","last_change":"2024-09-13T15:51:48.041512+0000","last_active":"2024-09-13T15:51:48.041512+0000","last_peered":"2024-09-13T15:51:48.041512+0000","last_clean":"2024-09-13T15:51:48.041512+0000","last_became_active":"2024-09-13T15:34:35.345531+0000","last_became_peered":"2024-09-13T15:34:35.345531+0000","last_unstale":"2024-09-13T15:51:48.041512+0000","last_undegraded":"2024-09-13T15:51:48.041512+0000","last_fullsized":"2024-09-13T15:51:48.041512+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:48.041303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:48.041303+0000","last_clean_scrub_stamp":"2024-09-13T15:51:48.041303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:50.423013+0000","scrub_duration":0.001557817,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"58'3","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:12.473201+0000","last_change":"2024-09-13T15:52:12.473201+0000","last_active":"2024-09-13T15:52:12.473201+0000","last_peered":"2024-09-13T15:52:12.473201+0000","last_clean":"2024-09-13T15:52:12.473201+0000","last_became_active":"2024-09-13T15:34:34.956252+0000","last_became_peered":"2024-09-13T15:34:34.956252+0000","last_unstale":"2024-09-13T15:52:12.473201+0000","last_undegraded":"2024-09-13T15:52:12.473201+0000","last_fullsized":"2024-09-13T15:52:12.473201+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'3","last_scrub_stamp":"2024-09-13T15:52:12.472917+0000","last_deep_scrub":"58'3","last_deep_scrub_stamp":"2024-09-13T15:52:12.472917+0000","last_clean_scrub_stamp":"2024-09-13T15:52:12.472917+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:34.717523+0000","scrub_duration":0.0060779959999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:20.704937+0000","last_change":"2024-09-13T15:51:20.704937+0000","last_active":"2024-09-13T15:51:20.704937+0000","last_peered":"2024-09-13T15:51:20.704937+0000","last_clean":"2024-09-13T15:51:20.704937+0000","last_became_active":"2024-09-13T15:34:35.331206+0000","last_became_peered":"2024-09-13T15:34:35.331206+0000","last_unstale":"2024-09-13T15:51:20.704937+0000","last_undegraded":"2024-09-13T15:51:20.704937+0000","last_fullsized":"2024-09-13T15:51:20.704937+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:20.704675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:20.704675+0000","last_clean_scrub_stamp":"2024-09-13T15:51:20.704675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:41.029516+0000","scrub_duration":0.0028536220000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"58'2","reported_seq":75,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:19.049433+0000","last_change":"2024-09-13T15:52:19.049433+0000","last_active":"2024-09-13T15:52:19.049433+0000","last_peered":"2024-09-13T15:52:19.049433+0000","last_clean":"2024-09-13T15:52:19.049433+0000","last_became_active":"2024-09-13T15:34:34.959646+0000","last_became_peered":"2024-09-13T15:34:34.959646+0000","last_unstale":"2024-09-13T15:52:19.049433+0000","last_undegraded":"2024-09-13T15:52:19.049433+0000","last_fullsized":"2024-09-13T15:52:19.049433+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'2","last_scrub_stamp":"2024-09-13T15:52:19.049070+0000","last_deep_scrub":"58'2","last_deep_scrub_stamp":"2024-09-13T15:52:19.049070+0000","last_clean_scrub_stamp":"2024-09-13T15:52:19.049070+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:13.219621+0000","scrub_duration":0.0060239409999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:23.631969+0000","last_change":"2024-09-13T15:51:23.632249+0000","last_active":"2024-09-13T15:51:23.631969+0000","last_peered":"2024-09-13T15:51:23.631969+0000","last_clean":"2024-09-13T15:51:23.631969+0000","last_became_active":"2024-09-13T15:34:35.334699+0000","last_became_peered":"2024-09-13T15:34:35.334699+0000","last_unstale":"2024-09-13T15:51:23.631969+0000","last_undegraded":"2024-09-13T15:51:23.631969+0000","last_fullsized":"2024-09-13T15:51:23.631969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:23.631921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:23.631921+0000","last_clean_scrub_stamp":"2024-09-13T15:51:23.631921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:28.485589+0000","scrub_duration":0.0028528719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"58'12","reported_seq":84,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:54.450870+0000","last_change":"2024-09-13T15:51:54.451094+0000","last_active":"2024-09-13T15:51:54.450870+0000","last_peered":"2024-09-13T15:51:54.450870+0000","last_clean":"2024-09-13T15:51:54.450870+0000","last_became_active":"2024-09-13T15:34:34.958787+0000","last_became_peered":"2024-09-13T15:34:34.958787+0000","last_unstale":"2024-09-13T15:51:54.450870+0000","last_undegraded":"2024-09-13T15:51:54.450870+0000","last_fullsized":"2024-09-13T15:51:54.450870+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'12","last_scrub_stamp":"2024-09-13T15:51:54.450813+0000","last_deep_scrub":"58'12","last_deep_scrub_stamp":"2024-09-13T15:51:54.450813+0000","last_clean_scrub_stamp":"2024-09-13T15:51:54.450813+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:00.936823+0000","scrub_duration":0.009138218,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:26.093049+0000","last_change":"2024-09-13T15:51:26.093274+0000","last_active":"2024-09-13T15:51:26.093049+0000","last_peered":"2024-09-13T15:51:26.093049+0000","last_clean":"2024-09-13T15:51:26.093049+0000","last_became_active":"2024-09-13T15:34:35.328935+0000","last_became_peered":"2024-09-13T15:34:35.328935+0000","last_unstale":"2024-09-13T15:51:26.093049+0000","last_undegraded":"2024-09-13T15:51:26.093049+0000","last_fullsized":"2024-09-13T15:51:26.093049+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:26.092993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:26.092993+0000","last_clean_scrub_stamp":"2024-09-13T15:51:26.092993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:44.227778+0000","scrub_duration":0.0029912200000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:23.938159+0000","last_change":"2024-09-13T15:52:23.938364+0000","last_active":"2024-09-13T15:52:23.938159+0000","last_peered":"2024-09-13T15:52:23.938159+0000","last_clean":"2024-09-13T15:52:23.938159+0000","last_became_active":"2024-09-13T15:34:34.950799+0000","last_became_peered":"2024-09-13T15:34:34.950799+0000","last_unstale":"2024-09-13T15:52:23.938159+0000","last_undegraded":"2024-09-13T15:52:23.938159+0000","last_fullsized":"2024-09-13T15:52:23.938159+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:23.938111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:23.938111+0000","last_clean_scrub_stamp":"2024-09-13T15:52:23.938111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:11.313812+0000","scrub_duration":0.002901799,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:20.688069+0000","last_change":"2024-09-13T15:52:20.688300+0000","last_active":"2024-09-13T15:52:20.688069+0000","last_peered":"2024-09-13T15:52:20.688069+0000","last_clean":"2024-09-13T15:52:20.688069+0000","last_became_active":"2024-09-13T15:34:35.342406+0000","last_became_peered":"2024-09-13T15:34:35.342406+0000","last_unstale":"2024-09-13T15:52:20.688069+0000","last_undegraded":"2024-09-13T15:52:20.688069+0000","last_fullsized":"2024-09-13T15:52:20.688069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:20.687995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:20.687995+0000","last_clean_scrub_stamp":"2024-09-13T15:52:20.687995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:40:08.063697+0000","scrub_duration":0.0030836829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:50.568853+0000","last_change":"2024-09-13T15:51:50.569089+0000","last_active":"2024-09-13T15:51:50.568853+0000","last_peered":"2024-09-13T15:51:50.568853+0000","last_clean":"2024-09-13T15:51:50.568853+0000","last_became_active":"2024-09-13T15:34:34.956692+0000","last_became_peered":"2024-09-13T15:34:34.956692+0000","last_unstale":"2024-09-13T15:51:50.568853+0000","last_undegraded":"2024-09-13T15:51:50.568853+0000","last_fullsized":"2024-09-13T15:51:50.568853+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:50.568804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:50.568804+0000","last_clean_scrub_stamp":"2024-09-13T15:51:50.568804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:34.142743+0000","scrub_duration":0.0031469549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:33.819531+0000","last_change":"2024-09-13T15:51:33.819817+0000","last_active":"2024-09-13T15:51:33.819531+0000","last_peered":"2024-09-13T15:51:33.819531+0000","last_clean":"2024-09-13T15:51:33.819531+0000","last_became_active":"2024-09-13T15:34:35.331945+0000","last_became_peered":"2024-09-13T15:34:35.331945+0000","last_unstale":"2024-09-13T15:51:33.819531+0000","last_undegraded":"2024-09-13T15:51:33.819531+0000","last_fullsized":"2024-09-13T15:51:33.819531+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:33.819477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:33.819477+0000","last_clean_scrub_stamp":"2024-09-13T15:51:33.819477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:21.665891+0000","scrub_duration":0.0030701579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"58'4","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:10.949624+0000","last_change":"2024-09-13T15:52:10.949879+0000","last_active":"2024-09-13T15:52:10.949624+0000","last_peered":"2024-09-13T15:52:10.949624+0000","last_clean":"2024-09-13T15:52:10.949624+0000","last_became_active":"2024-09-13T15:34:34.939092+0000","last_became_peered":"2024-09-13T15:34:34.939092+0000","last_unstale":"2024-09-13T15:52:10.949624+0000","last_undegraded":"2024-09-13T15:52:10.949624+0000","last_fullsized":"2024-09-13T15:52:10.949624+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'4","last_scrub_stamp":"2024-09-13T15:52:10.949571+0000","last_deep_scrub":"58'4","last_deep_scrub_stamp":"2024-09-13T15:52:10.949571+0000","last_clean_scrub_stamp":"2024-09-13T15:52:10.949571+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:41.038648+0000","scrub_duration":0.0066544100000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.920706+0000","last_change":"2024-09-13T15:51:42.920918+0000","last_active":"2024-09-13T15:51:42.920706+0000","last_peered":"2024-09-13T15:51:42.920706+0000","last_clean":"2024-09-13T15:51:42.920706+0000","last_became_active":"2024-09-13T15:34:35.345089+0000","last_became_peered":"2024-09-13T15:34:35.345089+0000","last_unstale":"2024-09-13T15:51:42.920706+0000","last_undegraded":"2024-09-13T15:51:42.920706+0000","last_fullsized":"2024-09-13T15:51:42.920706+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:42.920654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:42.920654+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.920654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:09.369234+0000","scrub_duration":0.0027763269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"58'16","reported_seq":88,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:10.408842+0000","last_change":"2024-09-13T15:52:10.409098+0000","last_active":"2024-09-13T15:52:10.408842+0000","last_peered":"2024-09-13T15:52:10.408842+0000","last_clean":"2024-09-13T15:52:10.408842+0000","last_became_active":"2024-09-13T15:34:34.955316+0000","last_became_peered":"2024-09-13T15:34:34.955316+0000","last_unstale":"2024-09-13T15:52:10.408842+0000","last_undegraded":"2024-09-13T15:52:10.408842+0000","last_fullsized":"2024-09-13T15:52:10.408842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'16","last_scrub_stamp":"2024-09-13T15:52:10.408789+0000","last_deep_scrub":"58'16","last_deep_scrub_stamp":"2024-09-13T15:52:10.408789+0000","last_clean_scrub_stamp":"2024-09-13T15:52:10.408789+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:40.717236+0000","scrub_duration":0.0096950700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2638,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:07.015505+0000","last_change":"2024-09-13T15:51:07.015632+0000","last_active":"2024-09-13T15:51:07.015505+0000","last_peered":"2024-09-13T15:51:07.015505+0000","last_clean":"2024-09-13T15:51:07.015505+0000","last_became_active":"2024-09-13T15:34:35.339493+0000","last_became_peered":"2024-09-13T15:34:35.339493+0000","last_unstale":"2024-09-13T15:51:07.015505+0000","last_undegraded":"2024-09-13T15:51:07.015505+0000","last_fullsized":"2024-09-13T15:51:07.015505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:07.015482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:07.015482+0000","last_clean_scrub_stamp":"2024-09-13T15:51:07.015482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:27.340322+0000","scrub_duration":0.001887321,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"58'5","reported_seq":76,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:42.931081+0000","last_change":"2024-09-13T15:51:42.931297+0000","last_active":"2024-09-13T15:51:42.931081+0000","last_peered":"2024-09-13T15:51:42.931081+0000","last_clean":"2024-09-13T15:51:42.931081+0000","last_became_active":"2024-09-13T15:34:34.949455+0000","last_became_peered":"2024-09-13T15:34:34.949455+0000","last_unstale":"2024-09-13T15:51:42.931081+0000","last_undegraded":"2024-09-13T15:51:42.931081+0000","last_fullsized":"2024-09-13T15:51:42.931081+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'5","last_scrub_stamp":"2024-09-13T15:51:42.931027+0000","last_deep_scrub":"58'5","last_deep_scrub_stamp":"2024-09-13T15:51:42.931027+0000","last_clean_scrub_stamp":"2024-09-13T15:51:42.931027+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:20:04.378223+0000","scrub_duration":0.0069458810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:51.933694+0000","last_change":"2024-09-13T15:51:51.933959+0000","last_active":"2024-09-13T15:51:51.933694+0000","last_peered":"2024-09-13T15:51:51.933694+0000","last_clean":"2024-09-13T15:51:51.933694+0000","last_became_active":"2024-09-13T15:34:35.345852+0000","last_became_peered":"2024-09-13T15:34:35.345852+0000","last_unstale":"2024-09-13T15:51:51.933694+0000","last_undegraded":"2024-09-13T15:51:51.933694+0000","last_fullsized":"2024-09-13T15:51:51.933694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:51.933640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:51.933640+0000","last_clean_scrub_stamp":"2024-09-13T15:51:51.933640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:23.904863+0000","scrub_duration":0.0029495559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:21.012986+0000","last_change":"2024-09-13T15:52:21.013257+0000","last_active":"2024-09-13T15:52:21.012986+0000","last_peered":"2024-09-13T15:52:21.012986+0000","last_clean":"2024-09-13T15:52:21.012986+0000","last_became_active":"2024-09-13T15:34:34.951315+0000","last_became_peered":"2024-09-13T15:34:34.951315+0000","last_unstale":"2024-09-13T15:52:21.012986+0000","last_undegraded":"2024-09-13T15:52:21.012986+0000","last_fullsized":"2024-09-13T15:52:21.012986+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:21.012937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:21.012937+0000","last_clean_scrub_stamp":"2024-09-13T15:52:21.012937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:59.143304+0000","scrub_duration":0.0029541960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:19.658733+0000","last_change":"2024-09-13T15:51:19.658733+0000","last_active":"2024-09-13T15:51:19.658733+0000","last_peered":"2024-09-13T15:51:19.658733+0000","last_clean":"2024-09-13T15:51:19.658733+0000","last_became_active":"2024-09-13T15:34:35.337699+0000","last_became_peered":"2024-09-13T15:34:35.337699+0000","last_unstale":"2024-09-13T15:51:19.658733+0000","last_undegraded":"2024-09-13T15:51:19.658733+0000","last_fullsized":"2024-09-13T15:51:19.658733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:19.658442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:19.658442+0000","last_clean_scrub_stamp":"2024-09-13T15:51:19.658442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:52.886746+0000","scrub_duration":0.0031503270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:56.835944+0000","last_change":"2024-09-13T15:51:56.836271+0000","last_active":"2024-09-13T15:51:56.835944+0000","last_peered":"2024-09-13T15:51:56.835944+0000","last_clean":"2024-09-13T15:51:56.835944+0000","last_became_active":"2024-09-13T15:34:34.937286+0000","last_became_peered":"2024-09-13T15:34:34.937286+0000","last_unstale":"2024-09-13T15:51:56.835944+0000","last_undegraded":"2024-09-13T15:51:56.835944+0000","last_fullsized":"2024-09-13T15:51:56.835944+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:56.835893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:56.835893+0000","last_clean_scrub_stamp":"2024-09-13T15:51:56.835893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:19.080500+0000","scrub_duration":0.0030846369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:54.842266+0000","last_change":"2024-09-13T15:51:54.842471+0000","last_active":"2024-09-13T15:51:54.842266+0000","last_peered":"2024-09-13T15:51:54.842266+0000","last_clean":"2024-09-13T15:51:54.842266+0000","last_became_active":"2024-09-13T15:34:35.335452+0000","last_became_peered":"2024-09-13T15:34:35.335452+0000","last_unstale":"2024-09-13T15:51:54.842266+0000","last_undegraded":"2024-09-13T15:51:54.842266+0000","last_fullsized":"2024-09-13T15:51:54.842266+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:54.842213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:54.842213+0000","last_clean_scrub_stamp":"2024-09-13T15:51:54.842213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:25.150660+0000","scrub_duration":0.003082988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:27.037519+0000","last_change":"2024-09-13T15:52:27.037759+0000","last_active":"2024-09-13T15:52:27.037519+0000","last_peered":"2024-09-13T15:52:27.037519+0000","last_clean":"2024-09-13T15:52:27.037519+0000","last_became_active":"2024-09-13T15:34:34.950329+0000","last_became_peered":"2024-09-13T15:34:34.950329+0000","last_unstale":"2024-09-13T15:52:27.037519+0000","last_undegraded":"2024-09-13T15:52:27.037519+0000","last_fullsized":"2024-09-13T15:52:27.037519+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:27.037466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:27.037466+0000","last_clean_scrub_stamp":"2024-09-13T15:52:27.037466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:22.593712+0000","scrub_duration":0.0028811259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:44.659569+0000","last_change":"2024-09-13T15:51:44.659803+0000","last_active":"2024-09-13T15:51:44.659569+0000","last_peered":"2024-09-13T15:51:44.659569+0000","last_clean":"2024-09-13T15:51:44.659569+0000","last_became_active":"2024-09-13T15:34:35.331078+0000","last_became_peered":"2024-09-13T15:34:35.331078+0000","last_unstale":"2024-09-13T15:51:44.659569+0000","last_undegraded":"2024-09-13T15:51:44.659569+0000","last_fullsized":"2024-09-13T15:51:44.659569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:44.659519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:44.659519+0000","last_clean_scrub_stamp":"2024-09-13T15:51:44.659519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:32.505933+0000","scrub_duration":0.0028280330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:03.993268+0000","last_change":"2024-09-13T15:52:03.993484+0000","last_active":"2024-09-13T15:52:03.993268+0000","last_peered":"2024-09-13T15:52:03.993268+0000","last_clean":"2024-09-13T15:52:03.993268+0000","last_became_active":"2024-09-13T15:34:34.950829+0000","last_became_peered":"2024-09-13T15:34:34.950829+0000","last_unstale":"2024-09-13T15:52:03.993268+0000","last_undegraded":"2024-09-13T15:52:03.993268+0000","last_fullsized":"2024-09-13T15:52:03.993268+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:03.993217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:03.993217+0000","last_clean_scrub_stamp":"2024-09-13T15:52:03.993217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:08.627836+0000","scrub_duration":0.0029228980000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"15'1","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:14.409834+0000","last_change":"2024-09-13T15:52:14.410059+0000","last_active":"2024-09-13T15:52:14.409834+0000","last_peered":"2024-09-13T15:52:14.409834+0000","last_clean":"2024-09-13T15:52:14.409834+0000","last_became_active":"2024-09-13T15:34:34.955836+0000","last_became_peered":"2024-09-13T15:34:34.955836+0000","last_unstale":"2024-09-13T15:52:14.409834+0000","last_undegraded":"2024-09-13T15:52:14.409834+0000","last_fullsized":"2024-09-13T15:52:14.409834+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-13T15:52:14.409780+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-09-13T15:52:14.409780+0000","last_clean_scrub_stamp":"2024-09-13T15:52:14.409780+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:10.097142+0000","scrub_duration":0.0030991119999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:58.866284+0000","last_change":"2024-09-13T15:51:58.866284+0000","last_active":"2024-09-13T15:51:58.866284+0000","last_peered":"2024-09-13T15:51:58.866284+0000","last_clean":"2024-09-13T15:51:58.866284+0000","last_became_active":"2024-09-13T15:34:35.328025+0000","last_became_peered":"2024-09-13T15:34:35.328025+0000","last_unstale":"2024-09-13T15:51:58.866284+0000","last_undegraded":"2024-09-13T15:51:58.866284+0000","last_fullsized":"2024-09-13T15:51:58.866284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:58.866014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:58.866014+0000","last_clean_scrub_stamp":"2024-09-13T15:51:58.866014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:21.110620+0000","scrub_duration":0.002811142,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1b","version":"15'1","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:49.917138+0000","last_change":"2024-09-13T15:51:49.917138+0000","last_active":"2024-09-13T15:51:49.917138+0000","last_peered":"2024-09-13T15:51:49.917138+0000","last_clean":"2024-09-13T15:51:49.917138+0000","last_became_active":"2024-09-13T15:34:34.944134+0000","last_became_peered":"2024-09-13T15:34:34.944134+0000","last_unstale":"2024-09-13T15:51:49.917138+0000","last_undegraded":"2024-09-13T15:51:49.917138+0000","last_fullsized":"2024-09-13T15:51:49.917138+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'1","last_scrub_stamp":"2024-09-13T15:51:49.916844+0000","last_deep_scrub":"15'1","last_deep_scrub_stamp":"2024-09-13T15:51:49.916844+0000","last_clean_scrub_stamp":"2024-09-13T15:51:49.916844+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:21.888067+0000","scrub_duration":0.0029938650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:30.052443+0000","last_change":"2024-09-13T15:51:30.052443+0000","last_active":"2024-09-13T15:51:30.052443+0000","last_peered":"2024-09-13T15:51:30.052443+0000","last_clean":"2024-09-13T15:51:30.052443+0000","last_became_active":"2024-09-13T15:34:35.339019+0000","last_became_peered":"2024-09-13T15:34:35.339019+0000","last_unstale":"2024-09-13T15:51:30.052443+0000","last_undegraded":"2024-09-13T15:51:30.052443+0000","last_fullsized":"2024-09-13T15:51:30.052443+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:30.052149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:30.052149+0000","last_clean_scrub_stamp":"2024-09-13T15:51:30.052149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:56:17.898563+0000","scrub_duration":0.002920181,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:17.394868+0000","last_change":"2024-09-13T15:52:17.395084+0000","last_active":"2024-09-13T15:52:17.394868+0000","last_peered":"2024-09-13T15:52:17.394868+0000","last_clean":"2024-09-13T15:52:17.394868+0000","last_became_active":"2024-09-13T15:34:35.330770+0000","last_became_peered":"2024-09-13T15:34:35.330770+0000","last_unstale":"2024-09-13T15:52:17.394868+0000","last_undegraded":"2024-09-13T15:52:17.394868+0000","last_fullsized":"2024-09-13T15:52:17.394868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:17.394817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:17.394817+0000","last_clean_scrub_stamp":"2024-09-13T15:52:17.394817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:22.029436+0000","scrub_duration":0.003240714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:15.611315+0000","last_change":"2024-09-13T15:51:15.611315+0000","last_active":"2024-09-13T15:51:15.611315+0000","last_peered":"2024-09-13T15:51:15.611315+0000","last_clean":"2024-09-13T15:51:15.611315+0000","last_became_active":"2024-09-13T15:34:35.335070+0000","last_became_peered":"2024-09-13T15:34:35.335070+0000","last_unstale":"2024-09-13T15:51:15.611315+0000","last_undegraded":"2024-09-13T15:51:15.611315+0000","last_fullsized":"2024-09-13T15:51:15.611315+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:15.611033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:15.611033+0000","last_clean_scrub_stamp":"2024-09-13T15:51:15.611033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:31.771056+0000","scrub_duration":0.0029690459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:01.966177+0000","last_change":"2024-09-13T15:52:01.966436+0000","last_active":"2024-09-13T15:52:01.966177+0000","last_peered":"2024-09-13T15:52:01.966177+0000","last_clean":"2024-09-13T15:52:01.966177+0000","last_became_active":"2024-09-13T15:34:35.324445+0000","last_became_peered":"2024-09-13T15:34:35.324445+0000","last_unstale":"2024-09-13T15:52:01.966177+0000","last_undegraded":"2024-09-13T15:52:01.966177+0000","last_fullsized":"2024-09-13T15:52:01.966177+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:01.966110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:01.966110+0000","last_clean_scrub_stamp":"2024-09-13T15:52:01.966110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:04.069892+0000","scrub_duration":0.0027739829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:10.591481+0000","last_change":"2024-09-13T15:51:10.591481+0000","last_active":"2024-09-13T15:51:10.591481+0000","last_peered":"2024-09-13T15:51:10.591481+0000","last_clean":"2024-09-13T15:51:10.591481+0000","last_became_active":"2024-09-13T15:34:35.327537+0000","last_became_peered":"2024-09-13T15:34:35.327537+0000","last_unstale":"2024-09-13T15:51:10.591481+0000","last_undegraded":"2024-09-13T15:51:10.591481+0000","last_fullsized":"2024-09-13T15:51:10.591481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:10.591224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:10.591224+0000","last_clean_scrub_stamp":"2024-09-13T15:51:10.591224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:30.916064+0000","scrub_duration":0.0029806559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":62,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:46.613765+0000","last_change":"2024-09-13T15:52:46.614030+0000","last_active":"2024-09-13T15:52:46.613765+0000","last_peered":"2024-09-13T15:52:46.613765+0000","last_clean":"2024-09-13T15:52:46.613765+0000","last_became_active":"2024-09-13T15:35:20.157317+0000","last_became_peered":"2024-09-13T15:35:20.157317+0000","last_unstale":"2024-09-13T15:52:46.613765+0000","last_undegraded":"2024-09-13T15:52:46.613765+0000","last_fullsized":"2024-09-13T15:52:46.613765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:46.613716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:46.613716+0000","last_clean_scrub_stamp":"2024-09-13T15:52:46.613716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:41:24.257075+0000","scrub_duration":0.0028778440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:44.901282+0000","last_change":"2024-09-13T15:51:44.901282+0000","last_active":"2024-09-13T15:51:44.901282+0000","last_peered":"2024-09-13T15:51:44.901282+0000","last_clean":"2024-09-13T15:51:44.901282+0000","last_became_active":"2024-09-13T15:34:35.336710+0000","last_became_peered":"2024-09-13T15:34:35.336710+0000","last_unstale":"2024-09-13T15:51:44.901282+0000","last_undegraded":"2024-09-13T15:51:44.901282+0000","last_fullsized":"2024-09-13T15:51:44.901282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:44.901011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:44.901011+0000","last_clean_scrub_stamp":"2024-09-13T15:51:44.901011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:47.282721+0000","scrub_duration":0.002805597,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:15.444436+0000","last_change":"2024-09-13T15:52:15.444698+0000","last_active":"2024-09-13T15:52:15.444436+0000","last_peered":"2024-09-13T15:52:15.444436+0000","last_clean":"2024-09-13T15:52:15.444436+0000","last_became_active":"2024-09-13T15:34:35.330208+0000","last_became_peered":"2024-09-13T15:34:35.330208+0000","last_unstale":"2024-09-13T15:52:15.444436+0000","last_undegraded":"2024-09-13T15:52:15.444436+0000","last_fullsized":"2024-09-13T15:52:15.444436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:15.444381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:15.444381+0000","last_clean_scrub_stamp":"2024-09-13T15:52:15.444381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:17.548163+0000","scrub_duration":0.0027820800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:14.575770+0000","last_change":"2024-09-13T15:51:14.575770+0000","last_active":"2024-09-13T15:51:14.575770+0000","last_peered":"2024-09-13T15:51:14.575770+0000","last_clean":"2024-09-13T15:51:14.575770+0000","last_became_active":"2024-09-13T15:34:35.335134+0000","last_became_peered":"2024-09-13T15:34:35.335134+0000","last_unstale":"2024-09-13T15:51:14.575770+0000","last_undegraded":"2024-09-13T15:51:14.575770+0000","last_fullsized":"2024-09-13T15:51:14.575770+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:14.575511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:14.575511+0000","last_clean_scrub_stamp":"2024-09-13T15:51:14.575511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:20:22.946343+0000","scrub_duration":0.0031682049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:31.763566+0000","last_change":"2024-09-13T15:51:31.763566+0000","last_active":"2024-09-13T15:51:31.763566+0000","last_peered":"2024-09-13T15:51:31.763566+0000","last_clean":"2024-09-13T15:51:31.763566+0000","last_became_active":"2024-09-13T15:34:35.327521+0000","last_became_peered":"2024-09-13T15:34:35.327521+0000","last_unstale":"2024-09-13T15:51:31.763566+0000","last_undegraded":"2024-09-13T15:51:31.763566+0000","last_fullsized":"2024-09-13T15:51:31.763566+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:31.763240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:31.763240+0000","last_clean_scrub_stamp":"2024-09-13T15:51:31.763240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:01:25.877586+0000","scrub_duration":0.0031492009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:28.046988+0000","last_change":"2024-09-13T15:52:28.046988+0000","last_active":"2024-09-13T15:52:28.046988+0000","last_peered":"2024-09-13T15:52:28.046988+0000","last_clean":"2024-09-13T15:52:28.046988+0000","last_became_active":"2024-09-13T15:34:35.322140+0000","last_became_peered":"2024-09-13T15:34:35.322140+0000","last_unstale":"2024-09-13T15:52:28.046988+0000","last_undegraded":"2024-09-13T15:52:28.046988+0000","last_fullsized":"2024-09-13T15:52:28.046988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:28.046680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:28.046680+0000","last_clean_scrub_stamp":"2024-09-13T15:52:28.046680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:10.337897+0000","scrub_duration":0.0031231890000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:25.684890+0000","last_change":"2024-09-13T15:52:25.684890+0000","last_active":"2024-09-13T15:52:25.684890+0000","last_peered":"2024-09-13T15:52:25.684890+0000","last_clean":"2024-09-13T15:52:25.684890+0000","last_became_active":"2024-09-13T15:34:35.329455+0000","last_became_peered":"2024-09-13T15:34:35.329455+0000","last_unstale":"2024-09-13T15:52:25.684890+0000","last_undegraded":"2024-09-13T15:52:25.684890+0000","last_fullsized":"2024-09-13T15:52:25.684890+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:25.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:25.684625+0000","last_clean_scrub_stamp":"2024-09-13T15:52:25.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:18:52.083110+0000","scrub_duration":0.0031391589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":61,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:44.676934+0000","last_change":"2024-09-13T15:52:44.677165+0000","last_active":"2024-09-13T15:52:44.676934+0000","last_peered":"2024-09-13T15:52:44.676934+0000","last_clean":"2024-09-13T15:52:44.676934+0000","last_became_active":"2024-09-13T15:35:20.152889+0000","last_became_peered":"2024-09-13T15:35:20.152889+0000","last_unstale":"2024-09-13T15:52:44.676934+0000","last_undegraded":"2024-09-13T15:52:44.676934+0000","last_fullsized":"2024-09-13T15:52:44.676934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:44.676884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:44.676884+0000","last_clean_scrub_stamp":"2024-09-13T15:52:44.676884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:52.758217+0000","scrub_duration":0.0029833960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:47.040704+0000","last_change":"2024-09-13T15:52:47.040945+0000","last_active":"2024-09-13T15:52:47.040704+0000","last_peered":"2024-09-13T15:52:47.040704+0000","last_clean":"2024-09-13T15:52:47.040704+0000","last_became_active":"2024-09-13T15:34:35.346165+0000","last_became_peered":"2024-09-13T15:34:35.346165+0000","last_unstale":"2024-09-13T15:52:47.040704+0000","last_undegraded":"2024-09-13T15:52:47.040704+0000","last_fullsized":"2024-09-13T15:52:47.040704+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:47.040652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:47.040652+0000","last_clean_scrub_stamp":"2024-09-13T15:52:47.040652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:01.782343+0000","scrub_duration":0.0028536780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:14.608116+0000","last_change":"2024-09-13T15:51:14.608116+0000","last_active":"2024-09-13T15:51:14.608116+0000","last_peered":"2024-09-13T15:51:14.608116+0000","last_clean":"2024-09-13T15:51:14.608116+0000","last_became_active":"2024-09-13T15:34:35.324026+0000","last_became_peered":"2024-09-13T15:34:35.324026+0000","last_unstale":"2024-09-13T15:51:14.608116+0000","last_undegraded":"2024-09-13T15:51:14.608116+0000","last_fullsized":"2024-09-13T15:51:14.608116+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:14.607733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:14.607733+0000","last_clean_scrub_stamp":"2024-09-13T15:51:14.607733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:45:57.098851+0000","scrub_duration":0.0030409230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:22.464879+0000","last_change":"2024-09-13T15:52:22.465099+0000","last_active":"2024-09-13T15:52:22.464879+0000","last_peered":"2024-09-13T15:52:22.464879+0000","last_clean":"2024-09-13T15:52:22.464879+0000","last_became_active":"2024-09-13T15:34:35.329634+0000","last_became_peered":"2024-09-13T15:34:35.329634+0000","last_unstale":"2024-09-13T15:52:22.464879+0000","last_undegraded":"2024-09-13T15:52:22.464879+0000","last_fullsized":"2024-09-13T15:52:22.464879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:22.464830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:22.464830+0000","last_clean_scrub_stamp":"2024-09-13T15:52:22.464830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:22.507464+0000","scrub_duration":0.002969541,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:23.745830+0000","last_change":"2024-09-13T15:52:23.746051+0000","last_active":"2024-09-13T15:52:23.745830+0000","last_peered":"2024-09-13T15:52:23.745830+0000","last_clean":"2024-09-13T15:52:23.745830+0000","last_became_active":"2024-09-13T15:34:35.333107+0000","last_became_peered":"2024-09-13T15:34:35.333107+0000","last_unstale":"2024-09-13T15:52:23.745830+0000","last_undegraded":"2024-09-13T15:52:23.745830+0000","last_fullsized":"2024-09-13T15:52:23.745830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:23.745782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:23.745782+0000","last_clean_scrub_stamp":"2024-09-13T15:52:23.745782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:19.302029+0000","scrub_duration":0.0028699760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:25.542771+0000","last_change":"2024-09-13T15:52:25.543013+0000","last_active":"2024-09-13T15:52:25.542771+0000","last_peered":"2024-09-13T15:52:25.542771+0000","last_clean":"2024-09-13T15:52:25.542771+0000","last_became_active":"2024-09-13T15:34:35.329992+0000","last_became_peered":"2024-09-13T15:34:35.329992+0000","last_unstale":"2024-09-13T15:52:25.542771+0000","last_undegraded":"2024-09-13T15:52:25.542771+0000","last_fullsized":"2024-09-13T15:52:25.542771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:25.542672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:25.542672+0000","last_clean_scrub_stamp":"2024-09-13T15:52:25.542672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:55.631749+0000","scrub_duration":0.0032676430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:34.706904+0000","last_change":"2024-09-13T15:52:34.707132+0000","last_active":"2024-09-13T15:52:34.706904+0000","last_peered":"2024-09-13T15:52:34.706904+0000","last_clean":"2024-09-13T15:52:34.706904+0000","last_became_active":"2024-09-13T15:34:35.333335+0000","last_became_peered":"2024-09-13T15:34:35.333335+0000","last_unstale":"2024-09-13T15:52:34.706904+0000","last_undegraded":"2024-09-13T15:52:34.706904+0000","last_fullsized":"2024-09-13T15:52:34.706904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:34.706852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:34.706852+0000","last_clean_scrub_stamp":"2024-09-13T15:52:34.706852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:23:07.479249+0000","scrub_duration":0.003033703,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:12.628563+0000","last_change":"2024-09-13T15:51:12.628806+0000","last_active":"2024-09-13T15:51:12.628563+0000","last_peered":"2024-09-13T15:51:12.628563+0000","last_clean":"2024-09-13T15:51:12.628563+0000","last_became_active":"2024-09-13T15:34:35.334372+0000","last_became_peered":"2024-09-13T15:34:35.334372+0000","last_unstale":"2024-09-13T15:51:12.628563+0000","last_undegraded":"2024-09-13T15:51:12.628563+0000","last_fullsized":"2024-09-13T15:51:12.628563+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:12.628512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:12.628512+0000","last_clean_scrub_stamp":"2024-09-13T15:51:12.628512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:01.257911+0000","scrub_duration":0.0030549050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:38.100757+0000","last_change":"2024-09-13T15:52:38.100978+0000","last_active":"2024-09-13T15:52:38.100757+0000","last_peered":"2024-09-13T15:52:38.100757+0000","last_clean":"2024-09-13T15:52:38.100757+0000","last_became_active":"2024-09-13T15:34:35.334125+0000","last_became_peered":"2024-09-13T15:34:35.334125+0000","last_unstale":"2024-09-13T15:52:38.100757+0000","last_undegraded":"2024-09-13T15:52:38.100757+0000","last_fullsized":"2024-09-13T15:52:38.100757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:38.100708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:38.100708+0000","last_clean_scrub_stamp":"2024-09-13T15:52:38.100708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:23:10.873106+0000","scrub_duration":0.0029443469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:50.067465+0000","last_change":"2024-09-13T15:52:50.067711+0000","last_active":"2024-09-13T15:52:50.067465+0000","last_peered":"2024-09-13T15:52:50.067465+0000","last_clean":"2024-09-13T15:52:50.067465+0000","last_became_active":"2024-09-13T15:34:35.328476+0000","last_became_peered":"2024-09-13T15:34:35.328476+0000","last_unstale":"2024-09-13T15:52:50.067465+0000","last_undegraded":"2024-09-13T15:52:50.067465+0000","last_fullsized":"2024-09-13T15:52:50.067465+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:50.067415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:50.067415+0000","last_clean_scrub_stamp":"2024-09-13T15:52:50.067415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:58.148748+0000","scrub_duration":0.0030827010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:52.121250+0000","last_change":"2024-09-13T15:52:52.121466+0000","last_active":"2024-09-13T15:52:52.121250+0000","last_peered":"2024-09-13T15:52:52.121250+0000","last_clean":"2024-09-13T15:52:52.121250+0000","last_became_active":"2024-09-13T15:34:35.331345+0000","last_became_peered":"2024-09-13T15:34:35.331345+0000","last_unstale":"2024-09-13T15:52:52.121250+0000","last_undegraded":"2024-09-13T15:52:52.121250+0000","last_fullsized":"2024-09-13T15:52:52.121250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:52.121197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:52.121197+0000","last_clean_scrub_stamp":"2024-09-13T15:52:52.121197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:41:29.764556+0000","scrub_duration":0.003220943,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:09.587225+0000","last_change":"2024-09-13T15:51:09.587225+0000","last_active":"2024-09-13T15:51:09.587225+0000","last_peered":"2024-09-13T15:51:09.587225+0000","last_clean":"2024-09-13T15:51:09.587225+0000","last_became_active":"2024-09-13T15:34:35.318978+0000","last_became_peered":"2024-09-13T15:34:35.318978+0000","last_unstale":"2024-09-13T15:51:09.587225+0000","last_undegraded":"2024-09-13T15:51:09.587225+0000","last_fullsized":"2024-09-13T15:51:09.587225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:09.586889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:09.586889+0000","last_clean_scrub_stamp":"2024-09-13T15:51:09.586889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:42.815192+0000","scrub_duration":0.0032138610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:40.675870+0000","last_change":"2024-09-13T15:52:40.676163+0000","last_active":"2024-09-13T15:52:40.675870+0000","last_peered":"2024-09-13T15:52:40.675870+0000","last_clean":"2024-09-13T15:52:40.675870+0000","last_became_active":"2024-09-13T15:34:35.344491+0000","last_became_peered":"2024-09-13T15:34:35.344491+0000","last_unstale":"2024-09-13T15:52:40.675870+0000","last_undegraded":"2024-09-13T15:52:40.675870+0000","last_fullsized":"2024-09-13T15:52:40.675870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:40.675816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:40.675816+0000","last_clean_scrub_stamp":"2024-09-13T15:52:40.675816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:55.417507+0000","scrub_duration":0.0030529149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:33.571999+0000","last_change":"2024-09-13T15:52:33.572236+0000","last_active":"2024-09-13T15:52:33.571999+0000","last_peered":"2024-09-13T15:52:33.571999+0000","last_clean":"2024-09-13T15:52:33.571999+0000","last_became_active":"2024-09-13T15:34:35.331643+0000","last_became_peered":"2024-09-13T15:34:35.331643+0000","last_unstale":"2024-09-13T15:52:33.571999+0000","last_undegraded":"2024-09-13T15:52:33.571999+0000","last_fullsized":"2024-09-13T15:52:33.571999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:33.571950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:33.571950+0000","last_clean_scrub_stamp":"2024-09-13T15:52:33.571950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:11.702316+0000","scrub_duration":0.0030862469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:51:28.690653+0000","last_change":"2024-09-13T15:51:28.690653+0000","last_active":"2024-09-13T15:51:28.690653+0000","last_peered":"2024-09-13T15:51:28.690653+0000","last_clean":"2024-09-13T15:51:28.690653+0000","last_became_active":"2024-09-13T15:34:35.334356+0000","last_became_peered":"2024-09-13T15:34:35.334356+0000","last_unstale":"2024-09-13T15:51:28.690653+0000","last_undegraded":"2024-09-13T15:51:28.690653+0000","last_fullsized":"2024-09-13T15:51:28.690653+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:51:28.690380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:51:28.690380+0000","last_clean_scrub_stamp":"2024-09-13T15:51:28.690380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:46.825165+0000","scrub_duration":0.0029361040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:27.608345+0000","last_change":"2024-09-13T15:52:27.608569+0000","last_active":"2024-09-13T15:52:27.608345+0000","last_peered":"2024-09-13T15:52:27.608345+0000","last_clean":"2024-09-13T15:52:27.608345+0000","last_became_active":"2024-09-13T15:34:35.327960+0000","last_became_peered":"2024-09-13T15:34:35.327960+0000","last_unstale":"2024-09-13T15:52:27.608345+0000","last_undegraded":"2024-09-13T15:52:27.608345+0000","last_fullsized":"2024-09-13T15:52:27.608345+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:27.608290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:27.608290+0000","last_clean_scrub_stamp":"2024-09-13T15:52:27.608290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:43.139410+0000","scrub_duration":0.0032251570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":71,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:39.056544+0000","last_change":"2024-09-13T15:52:39.056819+0000","last_active":"2024-09-13T15:52:39.056544+0000","last_peered":"2024-09-13T15:52:39.056544+0000","last_clean":"2024-09-13T15:52:39.056544+0000","last_became_active":"2024-09-13T15:34:35.325117+0000","last_became_peered":"2024-09-13T15:34:35.325117+0000","last_unstale":"2024-09-13T15:52:39.056544+0000","last_undegraded":"2024-09-13T15:52:39.056544+0000","last_fullsized":"2024-09-13T15:52:39.056544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:39.056493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:39.056493+0000","last_clean_scrub_stamp":"2024-09-13T15:52:39.056493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:19.221648+0000","scrub_duration":0.0032573279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":73,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:32.588290+0000","last_change":"2024-09-13T15:52:32.588290+0000","last_active":"2024-09-13T15:52:32.588290+0000","last_peered":"2024-09-13T15:52:32.588290+0000","last_clean":"2024-09-13T15:52:32.588290+0000","last_became_active":"2024-09-13T15:34:35.330197+0000","last_became_peered":"2024-09-13T15:34:35.330197+0000","last_unstale":"2024-09-13T15:52:32.588290+0000","last_undegraded":"2024-09-13T15:52:32.588290+0000","last_fullsized":"2024-09-13T15:52:32.588290+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:32.587995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:32.587995+0000","last_clean_scrub_stamp":"2024-09-13T15:52:32.587995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:26.758546+0000","scrub_duration":0.002949185,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:57.084785+0000","last_change":"2024-09-13T15:52:57.085011+0000","last_active":"2024-09-13T15:52:57.084785+0000","last_peered":"2024-09-13T15:52:57.084785+0000","last_clean":"2024-09-13T15:52:57.084785+0000","last_became_active":"2024-09-13T15:34:35.324228+0000","last_became_peered":"2024-09-13T15:34:35.324228+0000","last_unstale":"2024-09-13T15:52:57.084785+0000","last_undegraded":"2024-09-13T15:52:57.084785+0000","last_fullsized":"2024-09-13T15:52:57.084785+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:57.084735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:57.084735+0000","last_clean_scrub_stamp":"2024-09-13T15:52:57.084735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:03.261866+0000","scrub_duration":0.0034423639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:35.695407+0000","last_change":"2024-09-13T15:52:35.695638+0000","last_active":"2024-09-13T15:52:35.695407+0000","last_peered":"2024-09-13T15:52:35.695407+0000","last_clean":"2024-09-13T15:52:35.695407+0000","last_became_active":"2024-09-13T15:34:35.329026+0000","last_became_peered":"2024-09-13T15:34:35.329026+0000","last_unstale":"2024-09-13T15:52:35.695407+0000","last_undegraded":"2024-09-13T15:52:35.695407+0000","last_fullsized":"2024-09-13T15:52:35.695407+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:35.695356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:35.695356+0000","last_clean_scrub_stamp":"2024-09-13T15:52:35.695356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:15.860511+0000","scrub_duration":0.002846417,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":72,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-13T15:52:56.106505+0000","last_change":"2024-09-13T15:52:56.106776+0000","last_active":"2024-09-13T15:52:56.106505+0000","last_peered":"2024-09-13T15:52:56.106505+0000","last_clean":"2024-09-13T15:52:56.106505+0000","last_became_active":"2024-09-13T15:34:35.345209+0000","last_became_peered":"2024-09-13T15:34:35.345209+0000","last_unstale":"2024-09-13T15:52:56.106505+0000","last_undegraded":"2024-09-13T15:52:56.106505+0000","last_fullsized":"2024-09-13T15:52:56.106505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:52:56.106407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:52:56.106407+0000","last_clean_scrub_stamp":"2024-09-13T15:52:56.106407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:28:11.844536+0000","scrub_duration":0.0029012740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3436,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":6872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67,"ondisk_log_size":67,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":202,"num_read_kb":297,"num_write":157,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738596,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":99880,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94271960,"statfs":{"total":96636764160,"available":96534487040,"internally_reserved":0,"allocated":688128,"data_stored":300221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:52:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.499,"15min":0.44800000000000001},"min":{"1min":0.46800000000000003,"5min":0.247,"15min":0.16600000000000001},"max":{"1min":0.67800000000000005,"5min":0.77600000000000002,"15min":3.4550000000000001},"last":0.5},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.52600000000000002,"15min":0.48499999999999999},"min":{"1min":0.51800000000000002,"5min":0.26600000000000001,"15min":0.18099999999999999},"max":{"1min":0.63500000000000001,"5min":0.76900000000000002,"15min":6.1989999999999998},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Sep 13 15:52:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.47999999999999998},"min":{"1min":0.45700000000000002,"5min":0.27000000000000002,"15min":0.185},"max":{"1min":0.77600000000000002,"5min":0.90200000000000002,"15min":1.4790000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.51800000000000002},"min":{"1min":0.45900000000000002,"5min":0.30299999999999999,"15min":0.17799999999999999},"max":{"1min":0.69999999999999996,"5min":1.0589999999999999,"15min":1.399},"last":0.56299999999999994}]}]},{"osd":1,"up_from":8,"seq":34359738595,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":148852,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":147582,"kb_avail":94222988,"statfs":{"total":96636764160,"available":96484339712,"internally_reserved":0,"allocated":1290240,"data_stored":891249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":151124422},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:53:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48899999999999999,"15min":0.41999999999999998},"min":{"1min":0.46400000000000002,"5min":0.26700000000000002,"15min":0.16300000000000001},"max":{"1min":0.66500000000000004,"5min":0.74299999999999999,"15min":0.76300000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54000000000000004,"15min":0.45600000000000002},"min":{"1min":0.503,"5min":0.27800000000000002,"15min":0.17599999999999999},"max":{"1min":0.64900000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51300000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:53:00 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.46100000000000002},"min":{"1min":0.47899999999999998,"5min":0.313,"15min":0.191},"max":{"1min":0.68700000000000006,"5min":0.748,"15min":0.77200000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.59099999999999997,"15min":0.51000000000000001},"min":{"1min":0.53700000000000003,"5min":0.26100000000000001,"15min":0.19400000000000001},"max":{"1min":0.73699999999999999,"5min":0.93000000000000005,"15min":1.2789999999999999},"last":0.54500000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738597,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":158696,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94213144,"statfs":{"total":96636764160,"available":96474259456,"internally_reserved":0,"allocated":1277952,"data_stored":888575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":161216966},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:53:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51500000000000001,"15min":0.42599999999999999},"min":{"1min":0.435,"5min":0.223,"15min":0.158},"max":{"1min":0.65300000000000002,"5min":0.80900000000000005,"15min":0.873},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53100000000000003,"15min":0.44800000000000001},"min":{"1min":0.49099999999999999,"5min":0.215,"15min":0.191},"max":{"1min":0.63400000000000001,"5min":0.76700000000000002,"15min":0.83699999999999997},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Sep 13 15:53:00 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55800000000000005,"15min":0.504},"min":{"1min":0.48199999999999998,"5min":0.252,"15min":0.17899999999999999},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":9.4610000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58499999999999996,"15min":0.50800000000000001},"min":{"1min":0.55300000000000005,"5min":0.245,"15min":0.20799999999999999},"max":{"1min":0.64000000000000001,"5min":0.82099999999999995,"15min":0.90700000000000003},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:53:09.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T15:53:09.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.826+0000 7f69c1806640 1 Processor -- start 2024-09-13T15:53:09.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.826+0000 7f69c1806640 1 -- start start 2024-09-13T15:53:09.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.826+0000 7f69c1806640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69bc0be340 0x7f69bc15a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:09.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.826+0000 7f69c1806640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69bc0c1130 con 0x7f69bc0b4600 2024-09-13T15:53:09.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.826+0000 7f69c1806640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69bc14e780 con 0x7f69bc0be340 2024-09-13T15:53:09.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.826+0000 7f69ba7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69bc0be340 0x7f69bc15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:09.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.826+0000 7f69baffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f69bc0b4600 0x7f69bc14dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55388/0 (socket says 172.21.15.40:55388) 2024-09-13T15:53:09.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.826+0000 7f69baffd640 1 -- 172.21.15.40:0/210156827 learned_addr learned my addr 172.21.15.40:0/210156827 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:53:09.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.826+0000 7f69ba7fc640 1 -- 172.21.15.40:0/210156827 >> v1:172.21.15.40:6789/0 conn(0x7f69bc0b4600 legacy=0x7f69bc14dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:09.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.826+0000 7f69ba7fc640 1 -- 172.21.15.40:0/210156827 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc14e450 con 0x7f69bc0be340 2024-09-13T15:53:09.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69ba7fc640 1 --2- 172.21.15.40:0/210156827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc0be340 0x7f69bc15a750 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009740 tx=0x7f69b001c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83508053a6f224e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:09.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69b9ffb640 1 -- 172.21.15.40:0/210156827 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69b00ab530 con 0x7f69bc0be340 2024-09-13T15:53:09.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69b9ffb640 1 -- 172.21.15.40:0/210156827 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b00a7050 con 0x7f69bc0be340 2024-09-13T15:53:09.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69b9ffb640 1 -- 172.21.15.40:0/210156827 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69b00ab7e0 con 0x7f69bc0be340 2024-09-13T15:53:09.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69c1806640 1 -- 172.21.15.40:0/210156827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc0be340 msgr2=0x7f69bc15a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:09.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69c1806640 1 --2- 172.21.15.40:0/210156827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc0be340 0x7f69bc15a750 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009740 tx=0x7f69b001c0d0 comp rx=0 tx=0).stop 2024-09-13T15:53:09.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69c1806640 1 -- 172.21.15.40:0/210156827 shutdown_connections 2024-09-13T15:53:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69c1806640 1 --2- 172.21.15.40:0/210156827 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc0be340 0x7f69bc15a750 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69c1806640 1 -- 172.21.15.40:0/210156827 >> 172.21.15.40:0/210156827 conn(0x7f69bc06a540 msgr2=0x7f69bc0a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69c1806640 1 -- 172.21.15.40:0/210156827 shutdown_connections 2024-09-13T15:53:09.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69c1806640 1 -- 172.21.15.40:0/210156827 wait complete. 2024-09-13T15:53:09.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69c1806640 1 Processor -- start 2024-09-13T15:53:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69c1806640 1 -- start start 2024-09-13T15:53:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69c1806640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc0b4600 0x7f69bc159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.830+0000 7f69c1806640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc0b8d10 con 0x7f69bc0b4600 2024-09-13T15:53:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69baffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc0b4600 0x7f69bc159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69baffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc0b4600 0x7f69bc159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42914/0 (socket says 172.21.15.40:42914) 2024-09-13T15:53:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69baffd640 1 -- 172.21.15.40:0/999890334 learned_addr learned my addr 172.21.15.40:0/999890334 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:53:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69baffd640 1 -- 172.21.15.40:0/999890334 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b0009420 con 0x7f69bc0b4600 2024-09-13T15:53:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69baffd640 1 --2- 172.21.15.40:0/999890334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc0b4600 0x7f69bc159430 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00c3a0 tx=0x7f69ac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69a3fff640 1 -- 172.21.15.40:0/999890334 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69ac005c20 con 0x7f69bc0b4600 2024-09-13T15:53:09.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69a3fff640 1 -- 172.21.15.40:0/999890334 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac005d80 con 0x7f69bc0b4600 2024-09-13T15:53:09.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69a3fff640 1 -- 172.21.15.40:0/999890334 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69ac007200 con 0x7f69bc0b4600 2024-09-13T15:53:09.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69c1806640 1 -- 172.21.15.40:0/999890334 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69bc148fc0 con 0x7f69bc0b4600 2024-09-13T15:53:09.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69c1806640 1 -- 172.21.15.40:0/999890334 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69bc1481c0 con 0x7f69bc0b4600 2024-09-13T15:53:09.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69a3fff640 1 -- 172.21.15.40:0/999890334 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f69ac007360 con 0x7f69bc0b4600 2024-09-13T15:53:09.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69c1806640 1 -- 172.21.15.40:0/999890334 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69bc15a750 con 0x7f69bc0b4600 2024-09-13T15:53:09.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69a3fff640 1 --2- 172.21.15.40:0/999890334 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f69a8035530 0x7f69a80379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69a3fff640 1 -- 172.21.15.40:0/999890334 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f69ac0473b0 con 0x7f69bc0b4600 2024-09-13T15:53:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69ba7fc640 1 --2- 172.21.15.40:0/999890334 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f69a8035530 0x7f69a80379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:09.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.834+0000 7f69ba7fc640 1 --2- 172.21.15.40:0/999890334 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f69a8035530 0x7f69a80379f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f69b00ad000 tx=0x7f69b00a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:09.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:09.838+0000 7f69a3fff640 1 -- 172.21.15.40:0/999890334 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69ac012400 con 0x7f69bc0b4600 2024-09-13T15:53:10.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.002+0000 7f69c1806640 1 -- 172.21.15.40:0/999890334 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f69bc0a3b40 con 0x7f69bc0b4600 2024-09-13T15:53:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.010+0000 7f69a3fff640 1 -- 172.21.15.40:0/999890334 <== mon.0 v2:172.21.15.40:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f69ac012400 con 0x7f69bc0b4600 2024-09-13T15:53:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.010+0000 7f69a3fff640 1 -- 172.21.15.40:0/999890334 <== mon.0 v2:172.21.15.40:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f69ac017020 con 0x7f69bc0b4600 2024-09-13T15:53:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.010+0000 7f69c1806640 1 -- 172.21.15.40:0/999890334 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f69a8035530 msgr2=0x7f69a80379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.010+0000 7f69c1806640 1 --2- 172.21.15.40:0/999890334 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f69a8035530 0x7f69a80379f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f69b00ad000 tx=0x7f69b00a6000 comp rx=0 tx=0).stop 2024-09-13T15:53:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.010+0000 7f69c1806640 1 -- 172.21.15.40:0/999890334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc0b4600 msgr2=0x7f69bc159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.010+0000 7f69c1806640 1 --2- 172.21.15.40:0/999890334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc0b4600 0x7f69bc159430 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00c3a0 tx=0x7f69ac00c860 comp rx=0 tx=0).stop 2024-09-13T15:53:10.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.010+0000 7f69c1806640 1 -- 172.21.15.40:0/999890334 shutdown_connections 2024-09-13T15:53:10.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.010+0000 7f69c1806640 1 --2- 172.21.15.40:0/999890334 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f69a8035530 0x7f69a80379f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:10.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.010+0000 7f69c1806640 1 --2- 172.21.15.40:0/999890334 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69bc0b4600 0x7f69bc159430 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:10.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.010+0000 7f69c1806640 1 -- 172.21.15.40:0/999890334 >> 172.21.15.40:0/999890334 conn(0x7f69bc06a540 msgr2=0x7f69bc14aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:10.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.010+0000 7f69c1806640 1 -- 172.21.15.40:0/999890334 shutdown_connections 2024-09-13T15:53:10.015 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.010+0000 7f69c1806640 1 -- 172.21.15.40:0/999890334 wait complete. 2024-09-13T15:53:10.031 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T15:53:10.032 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:53:10.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.142+0000 7f2aa2e28640 1 Processor -- start 2024-09-13T15:53:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.142+0000 7f2aa2e28640 1 -- start start 2024-09-13T15:53:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.142+0000 7f2aa2e28640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a9c0b7bd0 0x7f2a9c0c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:10.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2aa2e28640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9c0a7850 con 0x7f2a9c153f60 2024-09-13T15:53:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2aa2e28640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a9c08c4f0 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2a9bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a9c0b7bd0 0x7f2a9c0c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2a9bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a9c0b7bd0 0x7f2a9c0c06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42918/0 (socket says 172.21.15.40:42918) 2024-09-13T15:53:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2a9bfff640 1 -- 172.21.15.40:0/1214497414 learned_addr learned my addr 172.21.15.40:0/1214497414 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:53:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2a9bfff640 1 -- 172.21.15.40:0/1214497414 >> v1:172.21.15.40:6789/0 conn(0x7f2a9c153f60 legacy=0x7f2a9c0c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2a9bfff640 1 -- 172.21.15.40:0/1214497414 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c08bdb0 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2a9bfff640 1 --2- 172.21.15.40:0/1214497414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0b7bd0 0x7f2a9c0c06e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009820 tx=0x7f2a9001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e7c1ca6f2ab435 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:10.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2a9b7fe640 1 -- 172.21.15.40:0/1214497414 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a900ac560 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2a9b7fe640 1 -- 172.21.15.40:0/1214497414 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2a900ac6c0 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2a9b7fe640 1 -- 172.21.15.40:0/1214497414 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a900ac9a0 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1214497414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0b7bd0 msgr2=0x7f2a9c0c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2aa2e28640 1 --2- 172.21.15.40:0/1214497414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0b7bd0 0x7f2a9c0c06e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009820 tx=0x7f2a9001c4c0 comp rx=0 tx=0).stop 2024-09-13T15:53:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1214497414 shutdown_connections 2024-09-13T15:53:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2aa2e28640 1 --2- 172.21.15.40:0/1214497414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0b7bd0 0x7f2a9c0c06e0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1214497414 >> 172.21.15.40:0/1214497414 conn(0x7f2a9c0a8640 msgr2=0x7f2a9c065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1214497414 shutdown_connections 2024-09-13T15:53:10.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.146+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1214497414 wait complete. 2024-09-13T15:53:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2aa2e28640 1 Processor -- start 2024-09-13T15:53:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2aa2e28640 1 -- start start 2024-09-13T15:53:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2aa2e28640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0b7bd0 0x7f2a9c14f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2aa2e28640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9c14fd70 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2aa0bc4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0b7bd0 0x7f2a9c14f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:10.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2aa0bc4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0b7bd0 0x7f2a9c14f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42922/0 (socket says 172.21.15.40:42922) 2024-09-13T15:53:10.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2aa0bc4640 1 -- 172.21.15.40:0/1119413226 learned_addr learned my addr 172.21.15.40:0/1119413226 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:53:10.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2aa0bc4640 1 -- 172.21.15.40:0/1119413226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a900094d0 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2aa0bc4640 1 --2- 172.21.15.40:0/1119413226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0b7bd0 0x7f2a9c14f830 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c480 tx=0x7f2a8c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:10.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2a997fa640 1 -- 172.21.15.40:0/1119413226 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a8c005150 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2a997fa640 1 -- 172.21.15.40:0/1119413226 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2a8c0052b0 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2a997fa640 1 -- 172.21.15.40:0/1119413226 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a8c007030 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1119413226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a9c15ff40 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1119413226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9c1ec000 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1119413226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9c067510 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2a997fa640 1 -- 172.21.15.40:0/1119413226 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f2a8c007190 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2a997fa640 1 --2- 172.21.15.40:0/1119413226 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2a88035530 0x7f2a880379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:10.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2a997fa640 1 -- 172.21.15.40:0/1119413226 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f2a8c047270 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.150+0000 7f2a9bfff640 1 --2- 172.21.15.40:0/1119413226 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2a88035530 0x7f2a880379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:10.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.154+0000 7f2a9bfff640 1 --2- 172.21.15.40:0/1119413226 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2a88035530 0x7f2a880379f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009820 tx=0x7f2a900a7000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:10.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.158+0000 7f2a997fa640 1 -- 172.21.15.40:0/1119413226 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a8c010680 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.346+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1119413226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a9c15d730 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.350+0000 7f2a997fa640 1 -- 172.21.15.40:0/1119413226 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5487 (secure 0 0 0) 0x7f2a8c010680 con 0x7f2a9c0b7bd0 2024-09-13T15:53:10.352 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:53:10.352 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4148,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6827/1054435232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1054435232},{"type":"v1","addr":"172.21.15.40:6827","nonce":1054435232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6829/3516561034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3516561034},{"type":"v1","addr":"172.21.15.40:6829","nonce":3516561034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4943,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2447489234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2447489234},{"type":"v1","addr":"172.21.15.40:6833","nonce":2447489234}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4949,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6832/1797372598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6831","nonce":1797372598},{"type":"v1","addr":"172.21.15.40:6832","nonce":1797372598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:34:35.292383+0000","modified":"2024-09-13T15:34:38.300209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4153":{"gid":4153,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3668838086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3668838086},{"type":"v1","addr":"172.21.15.40:6835","nonce":3668838086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:53:10.352 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 19 2024-09-13T15:53:10.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.350+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1119413226 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2a88035530 msgr2=0x7f2a880379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.350+0000 7f2aa2e28640 1 --2- 172.21.15.40:0/1119413226 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2a88035530 0x7f2a880379f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2a90009820 tx=0x7f2a900a7000 comp rx=0 tx=0).stop 2024-09-13T15:53:10.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.350+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1119413226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0b7bd0 msgr2=0x7f2a9c14f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.350+0000 7f2aa2e28640 1 --2- 172.21.15.40:0/1119413226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0b7bd0 0x7f2a9c14f830 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c480 tx=0x7f2a8c00c940 comp rx=0 tx=0).stop 2024-09-13T15:53:10.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.350+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1119413226 shutdown_connections 2024-09-13T15:53:10.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.350+0000 7f2aa2e28640 1 --2- 172.21.15.40:0/1119413226 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f2a88035530 0x7f2a880379f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:10.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.350+0000 7f2aa2e28640 1 --2- 172.21.15.40:0/1119413226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a9c0b7bd0 0x7f2a9c14f830 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:10.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.350+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1119413226 >> 172.21.15.40:0/1119413226 conn(0x7f2a9c0a8640 msgr2=0x7f2a9c0c3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:10.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.350+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1119413226 shutdown_connections 2024-09-13T15:53:10.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.350+0000 7f2aa2e28640 1 -- 172.21.15.40:0/1119413226 wait complete. 2024-09-13T15:53:10.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:53:10.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.486+0000 7f9625788640 1 Processor -- start 2024-09-13T15:53:10.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.486+0000 7f9625788640 1 -- start start 2024-09-13T15:53:10.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f9625788640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96200b7e10 0x7f96200a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:10.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f9625788640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962008bb80 con 0x7f962008afa0 2024-09-13T15:53:10.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f9625788640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9620152730 con 0x7f96200b7e10 2024-09-13T15:53:10.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f961e7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96200b7e10 0x7f96200a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:10.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f961effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f962008afa0 0x7f9620151230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55392/0 (socket says 172.21.15.40:55392) 2024-09-13T15:53:10.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f961effd640 1 -- 172.21.15.40:0/1638498613 learned_addr learned my addr 172.21.15.40:0/1638498613 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:53:10.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f961dffb640 1 -- 172.21.15.40:0/1638498613 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281732872 0 0) 0x7f962008bb80 con 0x7f962008afa0 2024-09-13T15:53:10.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f961dffb640 1 -- 172.21.15.40:0/1638498613 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9608003530 con 0x7f962008afa0 2024-09-13T15:53:10.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f961e7fc640 1 -- 172.21.15.40:0/1638498613 >> v1:172.21.15.40:6789/0 conn(0x7f962008afa0 legacy=0x7f9620151230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f961e7fc640 1 -- 172.21.15.40:0/1638498613 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962008bdb0 con 0x7f96200b7e10 2024-09-13T15:53:10.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f961e7fc640 1 --2- 172.21.15.40:0/1638498613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96200b7e10 0x7f96200a7bb0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f9614009740 tx=0x7f961401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677430ae5c808d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:10.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f961dffb640 1 -- 172.21.15.40:0/1638498613 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96140ac540 con 0x7f96200b7e10 2024-09-13T15:53:10.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f961dffb640 1 -- 172.21.15.40:0/1638498613 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f96140ac6a0 con 0x7f96200b7e10 2024-09-13T15:53:10.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.490+0000 7f961dffb640 1 -- 172.21.15.40:0/1638498613 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96140ac960 con 0x7f96200b7e10 2024-09-13T15:53:10.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 -- 172.21.15.40:0/1638498613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96200b7e10 msgr2=0x7f96200a7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 --2- 172.21.15.40:0/1638498613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96200b7e10 0x7f96200a7bb0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f9614009740 tx=0x7f961401c390 comp rx=0 tx=0).stop 2024-09-13T15:53:10.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 -- 172.21.15.40:0/1638498613 shutdown_connections 2024-09-13T15:53:10.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 --2- 172.21.15.40:0/1638498613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96200b7e10 0x7f96200a7bb0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:10.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 -- 172.21.15.40:0/1638498613 >> 172.21.15.40:0/1638498613 conn(0x7f96200a84f0 msgr2=0x7f9620065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:10.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 -- 172.21.15.40:0/1638498613 shutdown_connections 2024-09-13T15:53:10.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 -- 172.21.15.40:0/1638498613 wait complete. 2024-09-13T15:53:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 Processor -- start 2024-09-13T15:53:10.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 -- start start 2024-09-13T15:53:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962008afa0 0x7f96200a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96200a1120 con 0x7f962008afa0 2024-09-13T15:53:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f961effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962008afa0 0x7f96200a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f961effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962008afa0 0x7f96200a04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42938/0 (socket says 172.21.15.40:42938) 2024-09-13T15:53:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f961effd640 1 -- 172.21.15.40:0/1795139221 learned_addr learned my addr 172.21.15.40:0/1795139221 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:53:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f961effd640 1 -- 172.21.15.40:0/1795139221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614009420 con 0x7f962008afa0 2024-09-13T15:53:10.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f961effd640 1 --2- 172.21.15.40:0/1795139221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962008afa0 0x7f96200a04c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f961000c3d0 tx=0x7f961000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:10.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f96077fe640 1 -- 172.21.15.40:0/1795139221 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9610005ce0 con 0x7f962008afa0 2024-09-13T15:53:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f96077fe640 1 -- 172.21.15.40:0/1795139221 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9610005e40 con 0x7f962008afa0 2024-09-13T15:53:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 -- 172.21.15.40:0/1795139221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96200a0a00 con 0x7f962008afa0 2024-09-13T15:53:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f96077fe640 1 -- 172.21.15.40:0/1795139221 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9610007240 con 0x7f962008afa0 2024-09-13T15:53:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.494+0000 7f9625788640 1 -- 172.21.15.40:0/1795139221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96200a3860 con 0x7f962008afa0 2024-09-13T15:53:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.498+0000 7f96077fe640 1 -- 172.21.15.40:0/1795139221 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f9610007460 con 0x7f962008afa0 2024-09-13T15:53:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.498+0000 7f9625788640 1 -- 172.21.15.40:0/1795139221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96201521e0 con 0x7f962008afa0 2024-09-13T15:53:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.498+0000 7f96077fe640 1 --2- 172.21.15.40:0/1795139221 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f960c0354e0 0x7f960c0379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.498+0000 7f96077fe640 1 -- 172.21.15.40:0/1795139221 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f96100473d0 con 0x7f962008afa0 2024-09-13T15:53:10.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.498+0000 7f961e7fc640 1 --2- 172.21.15.40:0/1795139221 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f960c0354e0 0x7f960c0379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:10.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.498+0000 7f961e7fc640 1 --2- 172.21.15.40:0/1795139221 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f960c0354e0 0x7f960c0379a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f96140ae000 tx=0x7f96140a6040 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:10.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.502+0000 7f96077fe640 1 -- 172.21.15.40:0/1795139221 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f96100198b0 con 0x7f962008afa0 2024-09-13T15:53:10.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.686+0000 7f9625788640 1 -- 172.21.15.40:0/1795139221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9620161730 con 0x7f962008afa0 2024-09-13T15:53:10.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.686+0000 7f96077fe640 1 -- 172.21.15.40:0/1795139221 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5487 (secure 0 0 0) 0x7f9610017090 con 0x7f962008afa0 2024-09-13T15:53:10.690 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:53:10.690 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4148,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6827/1054435232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":1054435232},{"type":"v1","addr":"172.21.15.40:6827","nonce":1054435232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4149,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6829/3516561034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3516561034},{"type":"v1","addr":"172.21.15.40:6829","nonce":3516561034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4943,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/2447489234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":2447489234},{"type":"v1","addr":"172.21.15.40:6833","nonce":2447489234}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4949,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6832/1797372598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6831","nonce":1797372598},{"type":"v1","addr":"172.21.15.40:6832","nonce":1797372598}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:34:35.292383+0000","modified":"2024-09-13T15:34:38.300209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4153},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4153":{"gid":4153,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.40:6835/3668838086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":3668838086},{"type":"v1","addr":"172.21.15.40:6835","nonce":3668838086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:53:10.691 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 19 2024-09-13T15:53:10.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.690+0000 7f9625788640 1 -- 172.21.15.40:0/1795139221 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f960c0354e0 msgr2=0x7f960c0379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.690+0000 7f9625788640 1 --2- 172.21.15.40:0/1795139221 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f960c0354e0 0x7f960c0379a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f96140ae000 tx=0x7f96140a6040 comp rx=0 tx=0).stop 2024-09-13T15:53:10.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.690+0000 7f9625788640 1 -- 172.21.15.40:0/1795139221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962008afa0 msgr2=0x7f96200a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.690+0000 7f9625788640 1 --2- 172.21.15.40:0/1795139221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962008afa0 0x7f96200a04c0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f961000c3d0 tx=0x7f961000c890 comp rx=0 tx=0).stop 2024-09-13T15:53:10.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.690+0000 7f9625788640 1 -- 172.21.15.40:0/1795139221 shutdown_connections 2024-09-13T15:53:10.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.690+0000 7f9625788640 1 --2- 172.21.15.40:0/1795139221 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f960c0354e0 0x7f960c0379a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:10.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.690+0000 7f9625788640 1 --2- 172.21.15.40:0/1795139221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962008afa0 0x7f96200a04c0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:10.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.690+0000 7f9625788640 1 -- 172.21.15.40:0/1795139221 >> 172.21.15.40:0/1795139221 conn(0x7f96200a84f0 msgr2=0x7f96201531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:10.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.690+0000 7f9625788640 1 -- 172.21.15.40:0/1795139221 shutdown_connections 2024-09-13T15:53:10.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.690+0000 7f9625788640 1 -- 172.21.15.40:0/1795139221 wait complete. 2024-09-13T15:53:10.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:53:10.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.822+0000 7f1285504640 1 Processor -- start 2024-09-13T15:53:10.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.822+0000 7f1285504640 1 -- start start 2024-09-13T15:53:10.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.826+0000 7f1285504640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12800b4010 0x7f12800a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:10.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.826+0000 7f1285504640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12801515b0 con 0x7f12800bebb0 2024-09-13T15:53:10.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.826+0000 7f1285504640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128014e2c0 con 0x7f12800b4010 2024-09-13T15:53:10.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.826+0000 7f127e7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f12800b4010 0x7f12800a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:10.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.826+0000 7f127effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f12800bebb0 0x7f128006e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55408/0 (socket says 172.21.15.40:55408) 2024-09-13T15:53:10.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.826+0000 7f127effd640 1 -- 172.21.15.40:0/1206760037 learned_addr learned my addr 172.21.15.40:0/1206760037 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:53:10.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.826+0000 7f127e7fc640 1 -- 172.21.15.40:0/1206760037 >> v1:172.21.15.40:6789/0 conn(0x7f12800bebb0 legacy=0x7f128006e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.826+0000 7f127e7fc640 1 -- 172.21.15.40:0/1206760037 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128006f830 con 0x7f12800b4010 2024-09-13T15:53:10.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.826+0000 7f127e7fc640 1 --2- 172.21.15.40:0/1206760037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12800b4010 0x7f12800a4d70 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f1274009740 tx=0x7f127401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d34bf2b6f12e4af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:10.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.826+0000 7f127dffb640 1 -- 172.21.15.40:0/1206760037 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12800b6bc0 con 0x7f12800b4010 2024-09-13T15:53:10.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.826+0000 7f127dffb640 1 -- 172.21.15.40:0/1206760037 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f12740a7050 con 0x7f12800b4010 2024-09-13T15:53:10.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.826+0000 7f127dffb640 1 -- 172.21.15.40:0/1206760037 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12740ab6a0 con 0x7f12800b4010 2024-09-13T15:53:10.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 -- 172.21.15.40:0/1206760037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12800b4010 msgr2=0x7f12800a4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 --2- 172.21.15.40:0/1206760037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12800b4010 0x7f12800a4d70 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f1274009740 tx=0x7f127401c420 comp rx=0 tx=0).stop 2024-09-13T15:53:10.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 -- 172.21.15.40:0/1206760037 shutdown_connections 2024-09-13T15:53:10.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 --2- 172.21.15.40:0/1206760037 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12800b4010 0x7f12800a4d70 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:10.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 -- 172.21.15.40:0/1206760037 >> 172.21.15.40:0/1206760037 conn(0x7f128006a540 msgr2=0x7f12800a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:10.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 -- 172.21.15.40:0/1206760037 shutdown_connections 2024-09-13T15:53:10.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 -- 172.21.15.40:0/1206760037 wait complete. 2024-09-13T15:53:10.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 Processor -- start 2024-09-13T15:53:10.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 -- start start 2024-09-13T15:53:10.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12800b4010 0x7f1280147f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:10.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128015f2c0 con 0x7f12800b4010 2024-09-13T15:53:10.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f127effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12800b4010 0x7f1280147f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:10.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f127effd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12800b4010 0x7f1280147f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42962/0 (socket says 172.21.15.40:42962) 2024-09-13T15:53:10.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f127effd640 1 -- 172.21.15.40:0/3847106595 learned_addr learned my addr 172.21.15.40:0/3847106595 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:53:10.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f127effd640 1 -- 172.21.15.40:0/3847106595 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1274009420 con 0x7f12800b4010 2024-09-13T15:53:10.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f127effd640 1 --2- 172.21.15.40:0/3847106595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12800b4010 0x7f1280147f70 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f127000c480 tx=0x7f127000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:10.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f12677fe640 1 -- 172.21.15.40:0/3847106595 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1270005c20 con 0x7f12800b4010 2024-09-13T15:53:10.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f12677fe640 1 -- 172.21.15.40:0/3847106595 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1270005d80 con 0x7f12800b4010 2024-09-13T15:53:10.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 -- 172.21.15.40:0/3847106595 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12800b8c10 con 0x7f12800b4010 2024-09-13T15:53:10.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f12677fe640 1 -- 172.21.15.40:0/3847106595 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12700071a0 con 0x7f12800b4010 2024-09-13T15:53:10.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 -- 172.21.15.40:0/3847106595 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128015ee20 con 0x7f12800b4010 2024-09-13T15:53:10.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f12677fe640 1 -- 172.21.15.40:0/3847106595 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f1270007300 con 0x7f12800b4010 2024-09-13T15:53:10.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f1285504640 1 -- 172.21.15.40:0/3847106595 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12800a4d70 con 0x7f12800b4010 2024-09-13T15:53:10.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f12677fe640 1 --2- 172.21.15.40:0/3847106595 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f126c035530 0x7f126c0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:10.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f12677fe640 1 -- 172.21.15.40:0/3847106595 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f12700472d0 con 0x7f12800b4010 2024-09-13T15:53:10.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.830+0000 7f127e7fc640 1 --2- 172.21.15.40:0/3847106595 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f126c035530 0x7f126c0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:10.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.834+0000 7f127e7fc640 1 --2- 172.21.15.40:0/3847106595 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f126c035530 0x7f126c0379f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f12740ad000 tx=0x7f12740a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:10.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.838+0000 7f12677fe640 1 -- 172.21.15.40:0/3847106595 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f127001b3b0 con 0x7f12800b4010 2024-09-13T15:53:10.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.990+0000 7f1285504640 1 -- 172.21.15.40:0/3847106595 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f128015f4c0 con 0x7f12800b4010 2024-09-13T15:53:10.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.994+0000 7f12677fe640 1 -- 172.21.15.40:0/3847106595 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+13015 (secure 0 0 0) 0x7f1270017090 con 0x7f12800b4010 2024-09-13T15:53:10.994 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-09-13T15:53:10.995 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":58,"fsid":"0a577d39-ad8f-45a9-8f50-4745653ec5d3","created":"2024-09-13T15:34:14.133253+0000","modified":"2024-09-13T15:51:03.098535+0000","last_up_change":"2024-09-13T15:34:23.867708+0000","last_in_change":"2024-09-13T15:34:15.045388+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:34:25.125767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:34:33.833957+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.0299999713897705,"score_stable":1.0299999713897705,"optimal_score":1,"raw_score_acting":1.0299999713897705,"raw_score_stable":1.0299999713897705,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:34:34.276037+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.2699999809265137,"score_stable":1.2699999809265137,"optimal_score":1,"raw_score_acting":1.2699999809265137,"raw_score_stable":1.2699999809265137,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4c63eaa2-bbc3-4d24-b5a2-273b613288e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6809","nonce":3314126899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6811","nonce":3314126899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6815","nonce":3314126899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":3314126899},{"type":"v1","addr":"172.21.15.40:6813","nonce":3314126899}]},"public_addr":"172.21.15.40:6809/3314126899","cluster_addr":"172.21.15.40:6811/3314126899","heartbeat_back_addr":"172.21.15.40:6815/3314126899","heartbeat_front_addr":"172.21.15.40:6813/3314126899","state":["exists","up"]},{"osd":1,"uuid":"379bdd5f-9524-4dc4-ab42-d1df72a6efb2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6801","nonce":884315373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6803","nonce":884315373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6807","nonce":884315373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":884315373},{"type":"v1","addr":"172.21.15.40:6805","nonce":884315373}]},"public_addr":"172.21.15.40:6801/884315373","cluster_addr":"172.21.15.40:6803/884315373","heartbeat_back_addr":"172.21.15.40:6807/884315373","heartbeat_front_addr":"172.21.15.40:6805/884315373","state":["exists","up"]},{"osd":2,"uuid":"6b7fc5d5-3632-436a-a2a6-bd0beb5490a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6817","nonce":1072951307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6819","nonce":1072951307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6823","nonce":1072951307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":1072951307},{"type":"v1","addr":"172.21.15.40:6821","nonce":1072951307}]},"public_addr":"172.21.15.40:6817/1072951307","cluster_addr":"172.21.15.40:6819/1072951307","heartbeat_back_addr":"172.21.15.40:6823/1072951307","heartbeat_front_addr":"172.21.15.40:6821/1072951307","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.632851+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.504734+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:34:20.130506+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1c","mappings":[{"from":0,"to":2}]},{"pgid":"3.24","mappings":[{"from":0,"to":1}]},{"pgid":"3.2b","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:0/2772625282":"2024-09-13T16:50:59.680754+0000","172.21.15.40:6832/3545499514":"2024-09-14T15:51:00.082976+0000","172.21.15.40:6831/3545499514":"2024-09-14T15:51:00.082976+0000","172.21.15.40:0/2310847763":"2024-09-13T16:50:58.674341+0000","172.21.15.40:6833/3266942466":"2024-09-14T15:50:56.633962+0000","172.21.15.40:0/3574317467":"2024-09-13T16:50:27.040813+0000","172.21.15.40:0/3464899269":"2024-09-13T16:49:52.021920+0000","172.21.15.40:0/2020191347":"2024-09-13T16:39:12.695853+0000","172.21.15.40:0/3215060720":"2024-09-13T16:37:48.656072+0000","172.21.15.40:0/2096071371":"2024-09-13T16:41:43.833379+0000","172.21.15.40:0/1024811135":"2024-09-13T16:46:02.884335+0000","172.21.15.40:0/1371435748":"2024-09-13T16:49:08.427332+0000","172.21.15.40:0/1725367853":"2024-09-13T16:38:36.652988+0000","172.21.15.40:0/2070755866":"2024-09-13T16:38:12.598575+0000","172.21.15.40:0/695475091":"2024-09-13T16:40:02.785567+0000","172.21.15.40:0/276304017":"2024-09-13T16:45:37.498754+0000","172.21.15.40:0/3286012502":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/2241829794":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/2301478808":"2024-09-13T16:40:27.738146+0000","172.21.15.40:0/2561014458":"2024-09-13T16:50:58.307880+0000","172.21.15.40:6824/3185150828":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/690822190":"2024-09-13T16:39:37.683949+0000","172.21.15.40:0/414904326":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/3777702470":"2024-09-13T16:43:17.229644+0000","172.21.15.40:0/3514360215":"2024-09-13T16:44:32.325869+0000","172.21.15.40:0/3853947452":"2024-09-13T16:46:26.907170+0000","172.21.15.40:0/1991235795":"2024-09-13T16:40:52.760615+0000","172.21.15.40:6825/3185150828":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/1455634917":"2024-09-13T16:47:13.340610+0000","172.21.15.40:0/2753473479":"2024-09-13T16:42:16.865910+0000","172.21.15.40:0/3230130657":"2024-09-13T16:42:51.908956+0000","172.21.15.40:6830/3266942466":"2024-09-14T15:50:56.633962+0000","172.21.15.40:0/3833267415":"2024-09-13T16:48:42.495533+0000","172.21.15.40:0/1708466797":"2024-09-13T16:43:42.271124+0000","172.21.15.40:0/3629684271":"2024-09-14T15:37:01.425806+0000","172.21.15.40:0/3494260782":"2024-09-13T16:41:17.861368+0000","172.21.15.40:0/1861863246":"2024-09-13T16:44:07.288889+0000","172.21.15.40:0/1129415438":"2024-09-13T16:47:37.323733+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:53:10.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.994+0000 7f1285504640 1 -- 172.21.15.40:0/3847106595 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f126c035530 msgr2=0x7f126c0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.994+0000 7f1285504640 1 --2- 172.21.15.40:0/3847106595 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f126c035530 0x7f126c0379f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f12740ad000 tx=0x7f12740a6000 comp rx=0 tx=0).stop 2024-09-13T15:53:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.994+0000 7f1285504640 1 -- 172.21.15.40:0/3847106595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12800b4010 msgr2=0x7f1280147f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.994+0000 7f1285504640 1 --2- 172.21.15.40:0/3847106595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12800b4010 0x7f1280147f70 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f127000c480 tx=0x7f127000c940 comp rx=0 tx=0).stop 2024-09-13T15:53:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.994+0000 7f1285504640 1 -- 172.21.15.40:0/3847106595 shutdown_connections 2024-09-13T15:53:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.994+0000 7f1285504640 1 --2- 172.21.15.40:0/3847106595 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f126c035530 0x7f126c0379f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.994+0000 7f1285504640 1 --2- 172.21.15.40:0/3847106595 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f12800b4010 0x7f1280147f70 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.994+0000 7f1285504640 1 -- 172.21.15.40:0/3847106595 >> 172.21.15.40:0/3847106595 conn(0x7f128006a540 msgr2=0x7f12800707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.994+0000 7f1285504640 1 -- 172.21.15.40:0/3847106595 shutdown_connections 2024-09-13T15:53:10.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:10.994+0000 7f1285504640 1 -- 172.21.15.40:0/3847106595 wait complete. 2024-09-13T15:53:11.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T15:53:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.134+0000 7f3182b0b640 1 Processor -- start 2024-09-13T15:53:11.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.134+0000 7f3182b0b640 1 -- start start 2024-09-13T15:53:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.134+0000 7f3182b0b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f317c06b6a0 0x7f317c0bdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.134+0000 7f3182b0b640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317c0bec50 con 0x7f317c0b3f70 2024-09-13T15:53:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.134+0000 7f3182b0b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317c0bf080 con 0x7f317c06b6a0 2024-09-13T15:53:11.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.134+0000 7f31808a7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f317c06b6a0 0x7f317c0bdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.134+0000 7f317bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f317c0b3f70 0x7f317c0b5330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55416/0 (socket says 172.21.15.40:55416) 2024-09-13T15:53:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.134+0000 7f317bfff640 1 -- 172.21.15.40:0/2150736312 learned_addr learned my addr 172.21.15.40:0/2150736312 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:53:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.134+0000 7f31808a7640 1 -- 172.21.15.40:0/2150736312 >> v1:172.21.15.40:6789/0 conn(0x7f317c0b3f70 legacy=0x7f317c0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.134+0000 7f317b7fe640 1 -- 172.21.15.40:0/2150736312 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911558229 0 0) 0x7f317c0bec50 con 0x7f317c0b3f70 2024-09-13T15:53:11.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.134+0000 7f31808a7640 1 -- 172.21.15.40:0/2150736312 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c0b63d0 con 0x7f317c06b6a0 2024-09-13T15:53:11.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.138+0000 7f31808a7640 1 --2- 172.21.15.40:0/2150736312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317c06b6a0 0x7f317c0bdf20 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f316c009740 tx=0x7f316c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84af7742a4c1d45e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:11.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.138+0000 7f317b7fe640 1 -- 172.21.15.40:0/2150736312 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316c0ab550 con 0x7f317c06b6a0 2024-09-13T15:53:11.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.138+0000 7f317b7fe640 1 -- 172.21.15.40:0/2150736312 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f316c0ab6b0 con 0x7f317c06b6a0 2024-09-13T15:53:11.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.138+0000 7f317b7fe640 1 -- 172.21.15.40:0/2150736312 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316c0ab990 con 0x7f317c06b6a0 2024-09-13T15:53:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.138+0000 7f3182b0b640 1 -- 172.21.15.40:0/2150736312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317c06b6a0 msgr2=0x7f317c0bdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.138+0000 7f3182b0b640 1 --2- 172.21.15.40:0/2150736312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317c06b6a0 0x7f317c0bdf20 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f316c009740 tx=0x7f316c01c400 comp rx=0 tx=0).stop 2024-09-13T15:53:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.138+0000 7f3182b0b640 1 -- 172.21.15.40:0/2150736312 shutdown_connections 2024-09-13T15:53:11.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.138+0000 7f3182b0b640 1 --2- 172.21.15.40:0/2150736312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317c06b6a0 0x7f317c0bdf20 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.138+0000 7f3182b0b640 1 -- 172.21.15.40:0/2150736312 >> 172.21.15.40:0/2150736312 conn(0x7f317c06a370 msgr2=0x7f317c06a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.138+0000 7f3182b0b640 1 -- 172.21.15.40:0/2150736312 shutdown_connections 2024-09-13T15:53:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.138+0000 7f3182b0b640 1 -- 172.21.15.40:0/2150736312 wait complete. 2024-09-13T15:53:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f3182b0b640 1 Processor -- start 2024-09-13T15:53:11.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f3182b0b640 1 -- start start 2024-09-13T15:53:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f3182b0b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317c06b6a0 0x7f317c14b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f3182b0b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317c146390 con 0x7f317c06b6a0 2024-09-13T15:53:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f31808a7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317c06b6a0 0x7f317c14b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f31808a7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317c06b6a0 0x7f317c14b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42986/0 (socket says 172.21.15.40:42986) 2024-09-13T15:53:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f31808a7640 1 -- 172.21.15.40:0/1446671622 learned_addr learned my addr 172.21.15.40:0/1446671622 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:53:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f31808a7640 1 -- 172.21.15.40:0/1446671622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c009420 con 0x7f317c06b6a0 2024-09-13T15:53:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f31808a7640 1 --2- 172.21.15.40:0/1446671622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317c06b6a0 0x7f317c14b680 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f316c019010 tx=0x7f316c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:11.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f31797fa640 1 -- 172.21.15.40:0/1446671622 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316c0abd50 con 0x7f317c06b6a0 2024-09-13T15:53:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f31797fa640 1 -- 172.21.15.40:0/1446671622 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f316c0bf410 con 0x7f317c06b6a0 2024-09-13T15:53:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f3182b0b640 1 -- 172.21.15.40:0/1446671622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c0c0680 con 0x7f317c06b6a0 2024-09-13T15:53:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f31797fa640 1 -- 172.21.15.40:0/1446671622 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f316c0bf5e0 con 0x7f317c06b6a0 2024-09-13T15:53:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f3182b0b640 1 -- 172.21.15.40:0/1446671622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317c1ebfc0 con 0x7f317c06b6a0 2024-09-13T15:53:11.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f31797fa640 1 -- 172.21.15.40:0/1446671622 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f316c0b5400 con 0x7f317c06b6a0 2024-09-13T15:53:11.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f3182b0b640 1 -- 172.21.15.40:0/1446671622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317c1461e0 con 0x7f317c06b6a0 2024-09-13T15:53:11.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f31797fa640 1 --2- 172.21.15.40:0/1446671622 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3168035530 0x7f31680379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:11.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f31797fa640 1 -- 172.21.15.40:0/1446671622 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5160+0+0 (secure 0 0 0) 0x7f316c0e2b80 con 0x7f317c06b6a0 2024-09-13T15:53:11.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f317bfff640 1 --2- 172.21.15.40:0/1446671622 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3168035530 0x7f31680379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:11.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.142+0000 7f317bfff640 1 --2- 172.21.15.40:0/1446671622 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3168035530 0x7f31680379f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3170007fd0 tx=0x7f3170007940 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:11.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.146+0000 7f31797fa640 1 -- 172.21.15.40:0/1446671622 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f316c0b56b0 con 0x7f317c06b6a0 2024-09-13T15:53:11.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.334+0000 7f3182b0b640 1 -- 172.21.15.40:0/1446671622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f317c0c04c0 con 0x7f317c06b6a0 2024-09-13T15:53:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.346+0000 7f31797fa640 1 -- 172.21.15.40:0/1446671622 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f316c0b2310 con 0x7f317c06b6a0 2024-09-13T15:53:11.348 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T15:53:11.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.350+0000 7f3182b0b640 1 -- 172.21.15.40:0/1446671622 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3168035530 msgr2=0x7f31680379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:11.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.350+0000 7f3182b0b640 1 --2- 172.21.15.40:0/1446671622 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3168035530 0x7f31680379f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3170007fd0 tx=0x7f3170007940 comp rx=0 tx=0).stop 2024-09-13T15:53:11.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.350+0000 7f3182b0b640 1 -- 172.21.15.40:0/1446671622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317c06b6a0 msgr2=0x7f317c14b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:11.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.350+0000 7f3182b0b640 1 --2- 172.21.15.40:0/1446671622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317c06b6a0 0x7f317c14b680 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f316c019010 tx=0x7f316c01ac40 comp rx=0 tx=0).stop 2024-09-13T15:53:11.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.350+0000 7f3182b0b640 1 -- 172.21.15.40:0/1446671622 shutdown_connections 2024-09-13T15:53:11.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.350+0000 7f3182b0b640 1 --2- 172.21.15.40:0/1446671622 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f3168035530 0x7f31680379f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:11.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.350+0000 7f3182b0b640 1 --2- 172.21.15.40:0/1446671622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f317c06b6a0 0x7f317c14b680 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:11.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.350+0000 7f3182b0b640 1 -- 172.21.15.40:0/1446671622 >> 172.21.15.40:0/1446671622 conn(0x7f317c06a370 msgr2=0x7f317c06ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:11.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.350+0000 7f3182b0b640 1 -- 172.21.15.40:0/1446671622 shutdown_connections 2024-09-13T15:53:11.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.350+0000 7f3182b0b640 1 -- 172.21.15.40:0/1446671622 wait complete. 2024-09-13T15:53:11.372 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T15:53:11.399 INFO:tasks.ceph.mds.e.smithi040.stdout:starting mds.e at 2024-09-13T15:53:11.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.490+0000 7f46c52fa640 1 Processor -- start 2024-09-13T15:53:11.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.490+0000 7f46c52fa640 1 -- start start 2024-09-13T15:53:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.490+0000 7f46c52fa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46c00b7bd0 0x7f46c00c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.490+0000 7f46c52fa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c00a7850 con 0x7f46c0153f60 2024-09-13T15:53:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.490+0000 7f46c52fa640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c008c4f0 con 0x7f46c00b7bd0 2024-09-13T15:53:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.490+0000 7f46beffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f46c0153f60 0x7f46c00c4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55432/0 (socket says 172.21.15.40:55432) 2024-09-13T15:53:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.490+0000 7f46beffd640 1 -- 172.21.15.40:0/3670772213 learned_addr learned my addr 172.21.15.40:0/3670772213 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:53:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.490+0000 7f46be7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46c00b7bd0 0x7f46c00c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.490+0000 7f46bdffb640 1 -- 172.21.15.40:0/3670772213 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790361417 0 0) 0x7f46c00a7850 con 0x7f46c0153f60 2024-09-13T15:53:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.490+0000 7f46bdffb640 1 -- 172.21.15.40:0/3670772213 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a8003530 con 0x7f46c0153f60 2024-09-13T15:53:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.490+0000 7f46be7fc640 1 -- 172.21.15.40:0/3670772213 >> v1:172.21.15.40:6789/0 conn(0x7f46c0153f60 legacy=0x7f46c00c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:11.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.490+0000 7f46be7fc640 1 -- 172.21.15.40:0/3670772213 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c008bdb0 con 0x7f46c00b7bd0 2024-09-13T15:53:11.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46be7fc640 1 --2- 172.21.15.40:0/3670772213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c00b7bd0 0x7f46c00c06e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009770 tx=0x7f46b401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cfc4c289c2269d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:11.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46bdffb640 1 -- 172.21.15.40:0/3670772213 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46b40ab530 con 0x7f46c00b7bd0 2024-09-13T15:53:11.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46bdffb640 1 -- 172.21.15.40:0/3670772213 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f46b40a7050 con 0x7f46c00b7bd0 2024-09-13T15:53:11.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46bdffb640 1 -- 172.21.15.40:0/3670772213 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46b40ab7e0 con 0x7f46c00b7bd0 2024-09-13T15:53:11.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46c52fa640 1 -- 172.21.15.40:0/3670772213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c00b7bd0 msgr2=0x7f46c00c06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:11.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46c52fa640 1 --2- 172.21.15.40:0/3670772213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c00b7bd0 0x7f46c00c06e0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009770 tx=0x7f46b401c420 comp rx=0 tx=0).stop 2024-09-13T15:53:11.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46c52fa640 1 -- 172.21.15.40:0/3670772213 shutdown_connections 2024-09-13T15:53:11.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46c52fa640 1 --2- 172.21.15.40:0/3670772213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c00b7bd0 0x7f46c00c06e0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:11.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46c52fa640 1 -- 172.21.15.40:0/3670772213 >> 172.21.15.40:0/3670772213 conn(0x7f46c00a8640 msgr2=0x7f46c0065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:11.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46c52fa640 1 -- 172.21.15.40:0/3670772213 shutdown_connections 2024-09-13T15:53:11.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46c52fa640 1 -- 172.21.15.40:0/3670772213 wait complete. 2024-09-13T15:53:11.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46c52fa640 1 Processor -- start 2024-09-13T15:53:11.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.494+0000 7f46c52fa640 1 -- start start 2024-09-13T15:53:11.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46c52fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c00b7bd0 0x7f46c00b85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:11.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46c52fa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00b80f0 con 0x7f46c00b7bd0 2024-09-13T15:53:11.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46beffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c00b7bd0 0x7f46c00b85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:11.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46beffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c00b7bd0 0x7f46c00b85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43022/0 (socket says 172.21.15.40:43022) 2024-09-13T15:53:11.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46beffd640 1 -- 172.21.15.40:0/491613110 learned_addr learned my addr 172.21.15.40:0/491613110 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:53:11.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46beffd640 1 -- 172.21.15.40:0/491613110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4009420 con 0x7f46c00b7bd0 2024-09-13T15:53:11.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46beffd640 1 --2- 172.21.15.40:0/491613110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c00b7bd0 0x7f46c00b85b0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f46b800cb40 tx=0x7f46b80021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:11.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46a77fe640 1 -- 172.21.15.40:0/491613110 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46b800ab80 con 0x7f46c00b7bd0 2024-09-13T15:53:11.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46a77fe640 1 -- 172.21.15.40:0/491613110 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f46b800ace0 con 0x7f46c00b7bd0 2024-09-13T15:53:11.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46a77fe640 1 -- 172.21.15.40:0/491613110 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f46b8012400 con 0x7f46c00b7bd0 2024-09-13T15:53:11.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46c52fa640 1 -- 172.21.15.40:0/491613110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c01ea770 con 0x7f46c00b7bd0 2024-09-13T15:53:11.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46c52fa640 1 -- 172.21.15.40:0/491613110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c01ebed0 con 0x7f46c00b7bd0 2024-09-13T15:53:11.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46c52fa640 1 -- 172.21.15.40:0/491613110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c0067510 con 0x7f46c00b7bd0 2024-09-13T15:53:11.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46a77fe640 1 -- 172.21.15.40:0/491613110 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f46b8007070 con 0x7f46c00b7bd0 2024-09-13T15:53:11.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46a77fe640 1 --2- 172.21.15.40:0/491613110 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f46ac035530 0x7f46ac0379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:11.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46a77fe640 1 -- 172.21.15.40:0/491613110 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5246+0+0 (secure 0 0 0) 0x7f46b8047e30 con 0x7f46c00b7bd0 2024-09-13T15:53:11.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46be7fc640 1 --2- 172.21.15.40:0/491613110 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f46ac035530 0x7f46ac0379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:11.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.498+0000 7f46be7fc640 1 --2- 172.21.15.40:0/491613110 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f46ac035530 0x7f46ac0379f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009770 tx=0x7f46b40a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:11.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.506+0000 7f46a77fe640 1 -- 172.21.15.40:0/491613110 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f46b80198b0 con 0x7f46c00b7bd0 2024-09-13T15:53:11.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:11.698+0000 7f46c52fa640 1 -- 172.21.15.40:0/491613110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f46c0153790 con 0x7f46c00b7bd0 2024-09-13T15:53:12.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.350+0000 7f46a77fe640 1 -- 172.21.15.40:0/491613110 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f46b80170a0 con 0x7f46c00b7bd0 2024-09-13T15:53:12.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.354+0000 7f46c52fa640 1 -- 172.21.15.40:0/491613110 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f46ac035530 msgr2=0x7f46ac0379f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:12.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.354+0000 7f46c52fa640 1 --2- 172.21.15.40:0/491613110 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f46ac035530 0x7f46ac0379f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009770 tx=0x7f46b40a6000 comp rx=0 tx=0).stop 2024-09-13T15:53:12.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.354+0000 7f46c52fa640 1 -- 172.21.15.40:0/491613110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c00b7bd0 msgr2=0x7f46c00b85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:12.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.354+0000 7f46c52fa640 1 --2- 172.21.15.40:0/491613110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c00b7bd0 0x7f46c00b85b0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f46b800cb40 tx=0x7f46b80021f0 comp rx=0 tx=0).stop 2024-09-13T15:53:12.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.354+0000 7f46c52fa640 1 -- 172.21.15.40:0/491613110 shutdown_connections 2024-09-13T15:53:12.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.354+0000 7f46c52fa640 1 --2- 172.21.15.40:0/491613110 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f46ac035530 0x7f46ac0379f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:12.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.354+0000 7f46c52fa640 1 --2- 172.21.15.40:0/491613110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46c00b7bd0 0x7f46c00b85b0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:12.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.354+0000 7f46c52fa640 1 -- 172.21.15.40:0/491613110 >> 172.21.15.40:0/491613110 conn(0x7f46c00a8640 msgr2=0x7f46c01616f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:12.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.354+0000 7f46c52fa640 1 -- 172.21.15.40:0/491613110 shutdown_connections 2024-09-13T15:53:12.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.354+0000 7f46c52fa640 1 -- 172.21.15.40:0/491613110 wait complete. 2024-09-13T15:53:12.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T15:53:12.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.554+0000 7f63f3133640 1 Processor -- start 2024-09-13T15:53:12.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.554+0000 7f63f3133640 1 -- start start 2024-09-13T15:53:12.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.554+0000 7f63f3133640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63ec0be340 0x7f63ec15a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:12.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63f3133640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec0c1130 con 0x7f63ec0b4600 2024-09-13T15:53:12.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63f3133640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec14e780 con 0x7f63ec0be340 2024-09-13T15:53:12.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63f0ecf640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f63ec0b4600 0x7f63ec14dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55438/0 (socket says 172.21.15.40:55438) 2024-09-13T15:53:12.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63f0ecf640 1 -- 172.21.15.40:0/1501450969 learned_addr learned my addr 172.21.15.40:0/1501450969 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:53:12.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63ebfff640 1 --2- 172.21.15.40:0/1501450969 >> v2:172.21.15.40:3300/0 conn(0x7f63ec0be340 0x7f63ec15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63eb7fe640 1 -- 172.21.15.40:0/1501450969 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436260785 0 0) 0x7f63ec0c1130 con 0x7f63ec0b4600 2024-09-13T15:53:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63eb7fe640 1 -- 172.21.15.40:0/1501450969 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63dc005740 con 0x7f63ec0b4600 2024-09-13T15:53:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63ebfff640 1 -- 172.21.15.40:0/1501450969 >> v1:172.21.15.40:6789/0 conn(0x7f63ec0b4600 legacy=0x7f63ec14dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:12.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63ebfff640 1 -- 172.21.15.40:0/1501450969 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec14e450 con 0x7f63ec0be340 2024-09-13T15:53:12.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63ebfff640 1 --2- 172.21.15.40:0/1501450969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0be340 0x7f63ec15a750 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009740 tx=0x7f63d801c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189c23ae0364b531 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:12.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63eb7fe640 1 -- 172.21.15.40:0/1501450969 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63d80ab530 con 0x7f63ec0be340 2024-09-13T15:53:12.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63eb7fe640 1 -- 172.21.15.40:0/1501450969 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f63d80a7050 con 0x7f63ec0be340 2024-09-13T15:53:12.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63eb7fe640 1 -- 172.21.15.40:0/1501450969 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63d80ab800 con 0x7f63ec0be340 2024-09-13T15:53:12.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63f3133640 1 -- 172.21.15.40:0/1501450969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0be340 msgr2=0x7f63ec15a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:12.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63f3133640 1 --2- 172.21.15.40:0/1501450969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0be340 0x7f63ec15a750 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009740 tx=0x7f63d801c0d0 comp rx=0 tx=0).stop 2024-09-13T15:53:12.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63f3133640 1 -- 172.21.15.40:0/1501450969 shutdown_connections 2024-09-13T15:53:12.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63f3133640 1 --2- 172.21.15.40:0/1501450969 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0be340 0x7f63ec15a750 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:12.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63f3133640 1 -- 172.21.15.40:0/1501450969 >> 172.21.15.40:0/1501450969 conn(0x7f63ec06a540 msgr2=0x7f63ec0a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:12.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63f3133640 1 -- 172.21.15.40:0/1501450969 shutdown_connections 2024-09-13T15:53:12.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.558+0000 7f63f3133640 1 -- 172.21.15.40:0/1501450969 wait complete. 2024-09-13T15:53:12.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63f3133640 1 Processor -- start 2024-09-13T15:53:12.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63f3133640 1 -- start start 2024-09-13T15:53:12.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63f3133640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0b4600 0x7f63ec148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:12.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63f3133640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec15f080 con 0x7f63ec0b4600 2024-09-13T15:53:12.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63f0ecf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0b4600 0x7f63ec148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:12.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63f0ecf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0b4600 0x7f63ec148670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43040/0 (socket says 172.21.15.40:43040) 2024-09-13T15:53:12.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63f0ecf640 1 -- 172.21.15.40:0/570485092 learned_addr learned my addr 172.21.15.40:0/570485092 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:53:12.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63f0ecf640 1 -- 172.21.15.40:0/570485092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d8009420 con 0x7f63ec0b4600 2024-09-13T15:53:12.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63f0ecf640 1 --2- 172.21.15.40:0/570485092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0b4600 0x7f63ec148670 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c450 tx=0x7f63e000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:12.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63e97fa640 1 -- 172.21.15.40:0/570485092 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63e0005c20 con 0x7f63ec0b4600 2024-09-13T15:53:12.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63e97fa640 1 -- 172.21.15.40:0/570485092 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f63e0005d80 con 0x7f63ec0b4600 2024-09-13T15:53:12.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63f3133640 1 -- 172.21.15.40:0/570485092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec148c60 con 0x7f63ec0b4600 2024-09-13T15:53:12.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63e97fa640 1 -- 172.21.15.40:0/570485092 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f63e00071a0 con 0x7f63ec0b4600 2024-09-13T15:53:12.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63f3133640 1 -- 172.21.15.40:0/570485092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec15ea00 con 0x7f63ec0b4600 2024-09-13T15:53:12.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63f3133640 1 -- 172.21.15.40:0/570485092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec146210 con 0x7f63ec0b4600 2024-09-13T15:53:12.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.562+0000 7f63e97fa640 1 -- 172.21.15.40:0/570485092 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f63e0007300 con 0x7f63ec0b4600 2024-09-13T15:53:12.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.566+0000 7f63e97fa640 1 --2- 172.21.15.40:0/570485092 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f63d00354e0 0x7f63d00379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:12.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.566+0000 7f63e97fa640 1 -- 172.21.15.40:0/570485092 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5246+0+0 (secure 0 0 0) 0x7f63e00478b0 con 0x7f63ec0b4600 2024-09-13T15:53:12.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.566+0000 7f63ebfff640 1 --2- 172.21.15.40:0/570485092 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f63d00354e0 0x7f63d00379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:12.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.566+0000 7f63ebfff640 1 --2- 172.21.15.40:0/570485092 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f63d00354e0 0x7f63d00379a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f63d80ad000 tx=0x7f63d80a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:12.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.570+0000 7f63e97fa640 1 -- 172.21.15.40:0/570485092 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f63e001b3b0 con 0x7f63ec0b4600 2024-09-13T15:53:12.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:12.722+0000 7f63f3133640 1 -- 172.21.15.40:0/570485092 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f63ec15a750 con 0x7f63ec0b4600 2024-09-13T15:53:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.362+0000 7f63e97fa640 1 -- 172.21.15.40:0/570485092 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 181+0+0 (secure 0 0 0) 0x7f63e0017020 con 0x7f63ec0b4600 2024-09-13T15:53:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2024-09-13T15:53:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.366+0000 7f63f3133640 1 -- 172.21.15.40:0/570485092 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f63d00354e0 msgr2=0x7f63d00379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.366+0000 7f63f3133640 1 --2- 172.21.15.40:0/570485092 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f63d00354e0 0x7f63d00379a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f63d80ad000 tx=0x7f63d80a6000 comp rx=0 tx=0).stop 2024-09-13T15:53:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.366+0000 7f63f3133640 1 -- 172.21.15.40:0/570485092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0b4600 msgr2=0x7f63ec148670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.366+0000 7f63f3133640 1 --2- 172.21.15.40:0/570485092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0b4600 0x7f63ec148670 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c450 tx=0x7f63e000c910 comp rx=0 tx=0).stop 2024-09-13T15:53:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.366+0000 7f63f3133640 1 -- 172.21.15.40:0/570485092 shutdown_connections 2024-09-13T15:53:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.366+0000 7f63f3133640 1 --2- 172.21.15.40:0/570485092 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f63d00354e0 0x7f63d00379a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.366+0000 7f63f3133640 1 --2- 172.21.15.40:0/570485092 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ec0b4600 0x7f63ec148670 secure :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f63e000c450 tx=0x7f63e000c910 comp rx=0 tx=0).stop 2024-09-13T15:53:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.366+0000 7f63f3133640 1 -- 172.21.15.40:0/570485092 >> 172.21.15.40:0/570485092 conn(0x7f63ec06a540 msgr2=0x7f63ec06ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.366+0000 7f63f3133640 1 -- 172.21.15.40:0/570485092 shutdown_connections 2024-09-13T15:53:13.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.366+0000 7f63f3133640 1 -- 172.21.15.40:0/570485092 wait complete. 2024-09-13T15:53:13.392 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T15:53:13.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.522+0000 7f99a77cf640 1 Processor -- start 2024-09-13T15:53:13.524 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.522+0000 7f99a77cf640 1 -- start start 2024-09-13T15:53:13.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.522+0000 7f99a77cf640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99a00be340 0x7f99a015a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:13.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.522+0000 7f99a77cf640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a00c1130 con 0x7f99a00b4600 2024-09-13T15:53:13.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.522+0000 7f99a77cf640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a014e780 con 0x7f99a00be340 2024-09-13T15:53:13.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.522+0000 7f99a556b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f99a00b4600 0x7f99a014dd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55450/0 (socket says 172.21.15.40:55450) 2024-09-13T15:53:13.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.522+0000 7f99a556b640 1 -- 172.21.15.40:0/3206228024 learned_addr learned my addr 172.21.15.40:0/3206228024 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-09-13T15:53:13.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.522+0000 7f99a4d6a640 1 --2- 172.21.15.40:0/3206228024 >> v2:172.21.15.40:3300/0 conn(0x7f99a00be340 0x7f99a015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:13.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.522+0000 7f9997fff640 1 -- 172.21.15.40:0/3206228024 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269390935 0 0) 0x7f99a00c1130 con 0x7f99a00b4600 2024-09-13T15:53:13.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.522+0000 7f9997fff640 1 -- 172.21.15.40:0/3206228024 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f998c003530 con 0x7f99a00b4600 2024-09-13T15:53:13.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f99a4d6a640 1 -- 172.21.15.40:0/3206228024 >> v1:172.21.15.40:6789/0 conn(0x7f99a00b4600 legacy=0x7f99a014dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:13.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f99a4d6a640 1 -- 172.21.15.40:0/3206228024 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a014e450 con 0x7f99a00be340 2024-09-13T15:53:13.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f99a4d6a640 1 --2- 172.21.15.40:0/3206228024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a00be340 0x7f99a015a750 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f9990009740 tx=0x7f999001c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25376bb31e226437 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:13.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f9997fff640 1 -- 172.21.15.40:0/3206228024 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99900ab530 con 0x7f99a00be340 2024-09-13T15:53:13.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f9997fff640 1 -- 172.21.15.40:0/3206228024 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f99900a7050 con 0x7f99a00be340 2024-09-13T15:53:13.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f9997fff640 1 -- 172.21.15.40:0/3206228024 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f99900ab7e0 con 0x7f99a00be340 2024-09-13T15:53:13.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f99a77cf640 1 -- 172.21.15.40:0/3206228024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a00be340 msgr2=0x7f99a015a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:13.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f99a77cf640 1 --2- 172.21.15.40:0/3206228024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a00be340 0x7f99a015a750 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f9990009740 tx=0x7f999001c0d0 comp rx=0 tx=0).stop 2024-09-13T15:53:13.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f99a77cf640 1 -- 172.21.15.40:0/3206228024 shutdown_connections 2024-09-13T15:53:13.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f99a77cf640 1 --2- 172.21.15.40:0/3206228024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a00be340 0x7f99a015a750 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:13.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f99a77cf640 1 -- 172.21.15.40:0/3206228024 >> 172.21.15.40:0/3206228024 conn(0x7f99a006a540 msgr2=0x7f99a00a4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:13.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f99a77cf640 1 -- 172.21.15.40:0/3206228024 shutdown_connections 2024-09-13T15:53:13.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.526+0000 7f99a77cf640 1 -- 172.21.15.40:0/3206228024 wait complete. 2024-09-13T15:53:13.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a77cf640 1 Processor -- start 2024-09-13T15:53:13.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a77cf640 1 -- start start 2024-09-13T15:53:13.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a77cf640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a00b4600 0x7f99a0161680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:13.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a77cf640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00bc540 con 0x7f99a00b4600 2024-09-13T15:53:13.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a556b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a00b4600 0x7f99a0161680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:13.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a556b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a00b4600 0x7f99a0161680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43052/0 (socket says 172.21.15.40:43052) 2024-09-13T15:53:13.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a556b640 1 -- 172.21.15.40:0/3431292967 learned_addr learned my addr 172.21.15.40:0/3431292967 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-09-13T15:53:13.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a556b640 1 -- 172.21.15.40:0/3431292967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9990009420 con 0x7f99a00b4600 2024-09-13T15:53:13.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a556b640 1 --2- 172.21.15.40:0/3431292967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a00b4600 0x7f99a0161680 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f999c00c3d0 tx=0x7f999c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:13.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f9995ffb640 1 -- 172.21.15.40:0/3431292967 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f999c005ce0 con 0x7f99a00b4600 2024-09-13T15:53:13.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f9995ffb640 1 -- 172.21.15.40:0/3431292967 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f999c005e40 con 0x7f99a00b4600 2024-09-13T15:53:13.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f9995ffb640 1 -- 172.21.15.40:0/3431292967 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f999c007240 con 0x7f99a00b4600 2024-09-13T15:53:13.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a77cf640 1 -- 172.21.15.40:0/3431292967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a00baf00 con 0x7f99a00b4600 2024-09-13T15:53:13.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a77cf640 1 -- 172.21.15.40:0/3431292967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a0144d90 con 0x7f99a00b4600 2024-09-13T15:53:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a77cf640 1 -- 172.21.15.40:0/3431292967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a015a750 con 0x7f99a00b4600 2024-09-13T15:53:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f9995ffb640 1 -- 172.21.15.40:0/3431292967 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 11) v1 ==== 43373+0+0 (secure 0 0 0) 0x7f999c007460 con 0x7f99a00b4600 2024-09-13T15:53:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f9995ffb640 1 --2- 172.21.15.40:0/3431292967 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f99840354e0 0x7f99840379a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:53:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f9995ffb640 1 -- 172.21.15.40:0/3431292967 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4779+0+0 (secure 0 0 0) 0x7f999c047320 con 0x7f99a00b4600 2024-09-13T15:53:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a4d6a640 1 --2- 172.21.15.40:0/3431292967 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f99840354e0 0x7f99840379a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:53:13.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.530+0000 7f99a4d6a640 1 --2- 172.21.15.40:0/3431292967 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f99840354e0 0x7f99840379a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f99900ad000 tx=0x7f99900a6000 comp rx=0 tx=0).ready entity=mgr.4386 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:53:13.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.534+0000 7f9995ffb640 1 -- 172.21.15.40:0/3431292967 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f999c019b20 con 0x7f99a00b4600 2024-09-13T15:53:13.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:13.694+0000 7f99a77cf640 1 -- 172.21.15.40:0/3431292967 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f99a00a3b40 con 0x7f99a00b4600 2024-09-13T15:53:14.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:14.370+0000 7f9995ffb640 1 -- 172.21.15.40:0/3431292967 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 169+0+0 (secure 0 0 0) 0x7f999c019730 con 0x7f99a00b4600 2024-09-13T15:53:14.375 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2024-09-13T15:53:14.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:14.378+0000 7f99a77cf640 1 -- 172.21.15.40:0/3431292967 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f99840354e0 msgr2=0x7f99840379a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:14.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:14.378+0000 7f99a77cf640 1 --2- 172.21.15.40:0/3431292967 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f99840354e0 0x7f99840379a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f99900ad000 tx=0x7f99900a6000 comp rx=0 tx=0).stop 2024-09-13T15:53:14.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:14.378+0000 7f99a77cf640 1 -- 172.21.15.40:0/3431292967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a00b4600 msgr2=0x7f99a0161680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:53:14.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:14.378+0000 7f99a77cf640 1 --2- 172.21.15.40:0/3431292967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a00b4600 0x7f99a0161680 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f999c00c3d0 tx=0x7f999c00c890 comp rx=0 tx=0).stop 2024-09-13T15:53:14.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:14.378+0000 7f99a77cf640 1 -- 172.21.15.40:0/3431292967 shutdown_connections 2024-09-13T15:53:14.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:14.378+0000 7f99a77cf640 1 --2- 172.21.15.40:0/3431292967 >> [v2:172.21.15.40:6824/3416149431,v1:172.21.15.40:6825/3416149431] conn(0x7f99840354e0 0x7f99840379a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:14.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:14.378+0000 7f99a77cf640 1 --2- 172.21.15.40:0/3431292967 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99a00b4600 0x7f99a0161680 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:53:14.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:14.378+0000 7f99a77cf640 1 -- 172.21.15.40:0/3431292967 >> 172.21.15.40:0/3431292967 conn(0x7f99a006a540 msgr2=0x7f99a014dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:53:14.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:14.378+0000 7f99a77cf640 1 -- 172.21.15.40:0/3431292967 shutdown_connections 2024-09-13T15:53:14.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-09-13T15:53:14.378+0000 7f99a77cf640 1 -- 172.21.15.40:0/3431292967 wait complete. 2024-09-13T15:53:14.406 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T15:53:14.406 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T15:53:14.406 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:53:14.419 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T15:53:14.419 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T15:53:14.419 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:53:14.481 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T15:53:14.481 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T15:53:14.481 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:53:14.540 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T15:53:14.541 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T15:53:14.541 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:53:14.609 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T15:53:14.610 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-13T15:53:14.610 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:53:14.665 INFO:tasks.ceph.mds.e:Stopped 2024-09-13T15:53:14.666 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T15:53:14.666 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T15:53:14.666 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:53:15.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-13T15:53:20.768 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T15:53:20.768 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T15:53:20.768 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:53:21.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-13T15:53:21.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-13T15:53:26.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~5s 2024-09-13T15:53:26.870 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T15:53:26.870 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T15:53:26.870 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:53:26.950 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T15:53:26.950 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T15:53:26.950 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T15:53:26.950 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:53:26.982 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T15:53:26.982 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T15:53:26.982 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T15:53:26.983 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:53:27.041 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T15:53:27.042 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T15:53:27.042 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T15:53:27.144 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:53:27.145 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T15:53:27.325 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:53:27.325 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T15:53:27.594 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:53:27.594 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T15:53:27.767 INFO:tasks.ceph:Archiving mon data... 2024-09-13T15:53:27.769 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903738/data/mon.a.tgz 2024-09-13T15:53:27.769 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-09-13T15:53:27.774 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.Eh29rcLBJA 2024-09-13T15:53:27.774 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Eh29rcLBJA 2024-09-13T15:53:27.915 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.Eh29rcLBJA 2024-09-13T15:53:28.022 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.Eh29rcLBJA is 338KB 2024-09-13T15:53:28.209 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.Eh29rcLBJA 2024-09-13T15:53:28.224 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T15:53:28.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T15:53:28.288 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T15:53:28.288 DEBUG:teuthology.orchestra.run.smithi040:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T15:53:28.369 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T15:53:28.373 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T15:53:29.151 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903738/remote/smithi040/crash 2024-09-13T15:53:29.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T15:53:29.251 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T15:53:29.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:53:29.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T15:53:29.387 INFO:tasks.ceph:Compressing logs... 2024-09-13T15:53:29.388 DEBUG:teuthology.orchestra.run.smithi040:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T15:53:31.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-13T15:59:15.859 INFO:tasks.ceph:Archiving logs... 2024-09-13T15:59:15.899 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903738/remote/smithi040/log 2024-09-13T15:59:15.901 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T15:59:44.667 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T15:59:44.678 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T15:59:44.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T15:59:44.736 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T15:59:44.746 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T15:59:44.746 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:59:44.781 INFO:teuthology.orchestra.run.smithi040.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T15:59:44.781 INFO:teuthology.orchestra.run.smithi040.stdout:============================================================================== 2024-09-13T15:59:44.781 INFO:teuthology.orchestra.run.smithi040.stdout:*hv01.front.sepi 67.205.162.81 3 u 45 64 377 0.083 -1.747 0.333 2024-09-13T15:59:44.781 INFO:teuthology.orchestra.run.smithi040.stdout:+hv02.front.sepi 63.231.80.2 3 u 55 64 377 0.096 -0.773 0.367 2024-09-13T15:59:44.781 INFO:teuthology.orchestra.run.smithi040.stdout:+hv03.front.sepi 74.6.168.72 3 u 58 64 377 0.088 -2.174 0.367 2024-09-13T15:59:44.781 INFO:teuthology.orchestra.run.smithi040.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-13T15:59:44.782 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T15:59:44.792 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T15:59:44.793 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T15:59:44.819 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T15:59:44.861 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T15:59:44.903 INFO:teuthology.task.internal:Duration was 2163.001106 seconds 2024-09-13T15:59:44.903 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T15:59:44.944 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T15:59:44.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T15:59:45.086 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T15:59:45.086 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2024-09-13T15:59:45.086 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T15:59:45.097 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T15:59:45.098 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T15:59:45.181 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T15:59:45.181 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T15:59:45.325 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T15:59:45.338 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T15:59:45.339 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T15:59:45.369 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T15:59:45.387 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T15:59:45.437 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2024-09-13T15:59:45.463 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T15:59:45.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:59:45.511 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T15:59:45.522 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T15:59:45.524 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903738/remote/smithi040 2024-09-13T15:59:45.524 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T15:59:45.577 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T15:59:45.578 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T15:59:45.620 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T15:59:45.632 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T15:59:45.633 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T15:59:45.663 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T15:59:45.663 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T15:59:45.669 INFO:teuthology.orchestra.run.smithi040.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 15:59 /home/ubuntu/cephtest 2024-09-13T15:59:45.671 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T15:59:45.714 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T15:59:45.816 INFO:teuthology.run:Summary data: description: fs/mirror-ha/{begin/{0-install 1-ceph 2-logrotate 3-modules} cephfs-mirror/{1-volume-create-rm 2-three-per-cluster} clients/{mirror} cluster/{1-node} conf/{client mds mgr mon osd} objectstore/bluestore-bitmap overrides/{ignorelist_health pg_health} supported-random-distro$/{ubuntu_latest} workloads/cephfs-mirror-ha-workunit} duration: 2163.00110578537 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T15:59:45.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T15:59:45.947 INFO:teuthology.run:pass